NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm gateway”

35 tools in the directory · Updated

“llm gateway”Ways to use: APIUpdated: last 7 daysShowing 35 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • EvoLinkby EvoLinkA unified API gateway for language, image, video and audio models.Pay as you go
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
  • Generate Enterpriseby Iterate.aiSelf-hosted AI workspace for enterprise knowledge, agents, and workflows.Contact sales
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • Tonic Textualby Tonic.aiTonic Textual detects sensitive information in unstructured data and redacts it or replaces it with synthetic values.Contact sales
  • Syntheticby SyntheticHosted access to open-source language models through a web app and compatible APIs.$9+/mo
  • PageIndexby VectifyAIDocument retrieval and question-answering tools for long, complex documents.Freemium
  • TestSavant.AIby TestSavant.AIAI testing and assurance platform for evaluating applications and tracking release risks.Freemium
  • Nexlaby NexlaEnterprise data integration and governed MCP access for AI agents.Contact sales
  • Bluefishby BluefishAn enterprise marketing platform for monitoring, optimizing, and measuring how AI represents brands.Contact sales
  • Aembitby AembitIdentity and access control for AI agents and workloadsFreemium
  • Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
  • AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm gateway” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how