NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-routing”

14 tools in the directory · Updated

“llm-routing”Download or installWays to use: APIShowing 14 tools
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
  • OpenClawby OpenClaw FoundationSelf-hosted open-source AI assistant you message from your existing chat apps.Free
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • IBM Langflowby IBMVisual builder for AI agent workflows, extensible in PythonUnknown
  • OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • OpenCodeby AnomalyYC W21Open source AI coding agent for terminal, desktop, and IDEFreemium
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free

That’s all 14 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-routing” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how