NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-gateway”

30 tools in the directory · Updated

“llm-gateway”Download or installWays to use: SDK / libraryShowing 30 tools
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
  • Ragasby RagasOpen-source library for evaluating LLM applications with metrics and eval loopsUnknown
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
  • OpenClawby OpenClaw FoundationSelf-hosted open-source AI assistant you message from your existing chat apps.Free
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • LangMem SDKby LangChainPython library that gives agents long-term memory and prompt-based learningFree
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • Elysiaby WeaviateOpen-source agentic platform that routes queries through a decision tree of tools.Free
  • Stripe Agent Toolkitby StripeGive AI agents access to Stripe tools and data, and charge for AI featuresUnknown
  • mini-SWE-agentby SWE-agentA minimal bash-only AI coding agent for the command line and Python.Unknown
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-gateway” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how