NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-routing”

350 tools in the directory · Updated

“llm-routing”Showing 350 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • fillmoreby MetaviewRun outbound recruiting from a Slack-based AI coworkerContact sales
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
  • AI Gatewayby TrueFoundrySingle gateway for routing, governing, and monitoring LLM and MCP trafficFreemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • CallMinerby CallMinerConversation intelligence and virtual agents for customer experience teamsContact sales
  • vLLMby vLLMLLM inference and serving library.Free
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • Kensho LLM-Ready APIby S&P GlobalPython client and MCP server for querying S&P Global financial datasets from LLM applicationsContact sales
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
  • LLMrefsby LLMrefsTrack brand visibility and citations across AI search engines by keyword$79/moFree trial
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • ChatLLMby Abacus.AIAI super assistant with chat, agent and company knowledge modes$10/mo
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • Bitoby BitoGovernor: an LLM router that grounds coding-agent requests in your codebase to cut token use and price per tokenContact sales
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-routing” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how