ToolsCompaniesAbout

Results for “llm proxy”

189 tools in this category · Updated

“llm proxy”CodingRuns on APIShowing 189 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
  • Nutrient DWS AI Gateway APIby NutrientOpenAI-compatible LLM gateway for document workflowsFreemium
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • Sentry Agent Tracingby SentryTraces AI agent runs and LLM calls inside Sentry application monitoringFreemium
  • Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
  • AI Gatewayby TrueFoundrySingle gateway for routing, governing, and monitoring LLM and MCP trafficFreemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • Lunaryby LunaryMonitor LLM applications, review conversations and improve prompts$20+/user/mo
  • JFrog MLby JFrogBuild, deploy, manage and monitor AI and ML workflows from GenAI and LLMs to classic ML.Contact sales
  • Bitoby BitoGovernor: an LLM router that grounds coding-agent requests in your codebase to cut token use and price per tokenContact sales
  • Ragasby RagasOpen-source library for evaluating LLM applications with metrics and eval loopsUnknown
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go