Results for “llm optimization”

81 tools in the directory · Updated 2 Nov 2026

“llm optimization”Runs on Command lineUpdated: last 7 daysShowing 81 tools

LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
vLLMby vLLMLLM inference and serving library.Free
Kensho LLM-Ready APIby S&P GlobalPython client and MCP server for querying S&P Global financial datasets from LLM applicationsContact sales
Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
.txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
CodeHealth MCP Serverby CodeSceneLocal MCP server that gives AI coding agents CodeHealth feedbackPaidFree trial
PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
Bifrostby Maxim AIAI gateway and laptop-level AI traffic governance for enterprisesFreemium
Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Agentic Document Extractionby LandingAIVision-first API that parses, splits, and extracts structured data from documents.Pay as you go