NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-gateway”

52 tools in the directory · Updated

“llm-gateway”Updated: last 7 daysShowing 52 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • EvoLinkby EvoLinkA unified API gateway for language, image, video and audio models.Pay as you go
  • HODORby HODORAn MCP security gateway for governing AI agents’ access to connected applications.€10+/user/mo
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
  • Adapt Company Agentby AdaptCompany agents that use shared knowledge and connected business toolsFreemium
  • LearnWise AIby LearnWiseInstitution-wide AI support, tutoring, feedback and course operations for education.Contact sales
  • Generate Enterpriseby Iterate.aiSelf-hosted AI workspace for enterprise knowledge, agents, and workflows.Contact sales
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Envive Adaptive Storefrontby EnviveAI shopping experiences and intent insights for Shopify brands.Contact sales
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • DataLineby DataLineChat with data to generate tables, charts, and dashboards.Unknown
  • Tonic Textualby Tonic.aiTonic Textual detects sensitive information in unstructured data and redacts it or replaces it with synthetic values.Contact sales
  • Syntheticby SyntheticHosted access to open-source language models through a web app and compatible APIs.$9+/mo
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-gateway” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how