NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm serving”

35 tools in the directory · Updated

“llm serving”Ways to use: WebUpdated: last 7 daysShowing 35 tools
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • Trajectoryby TrajectoryA continual-learning platform for observing, steering, and improving AI products from usage signals.Contact sales
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • LearnWise AIby LearnWiseInstitution-wide AI support, tutoring, feedback and course operations for education.Contact sales
  • H Platformby H CompanyA platform for building, running, and monitoring computer-use agents across browser, desktop, and enterprise environments.Freemium
  • Quail Voice Focusby ai-cousticsReal-time isolation of a primary speaker from background speech and noise for voice AI.$135+/mo
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • EvoLinkby EvoLinkA unified API gateway for language, image, video and audio models.Pay as you go
  • DataLineby DataLineChat with data to generate tables, charts, and dashboards.Unknown
  • AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
  • Tonic Textualby Tonic.aiTonic Textual detects sensitive information in unstructured data and redacts it or replaces it with synthetic values.Contact sales
  • Syntheticby SyntheticHosted access to open-source language models through a web app and compatible APIs.$9+/mo
  • PageIndexby VectifyAIDocument retrieval and question-answering tools for long, complex documents.Freemium
  • TestSavant.AIby TestSavant.AIAI testing and assurance platform for evaluating applications and tracking release risks.Freemium
  • Mindbreeze InSpireby MindbreezeEnterprise knowledge and AI search platform that connects business information for contextual answers and AI-enabled workflows.Contact sales
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm serving” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how