NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm inference”

17 tools in the directory · Updated

“llm inference”Ways to use: MCP serverUpdated: last 7 daysShowing 17 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • EvoLinkby EvoLinkA unified API gateway for language, image, video and audio models.Pay as you go
  • AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
  • Tonic Textualby Tonic.aiTonic Textual detects sensitive information in unstructured data and redacts it or replaces it with synthetic values.Contact sales
  • PageIndexby VectifyAIDocument retrieval and question-answering tools for long, complex documents.Freemium
  • Bluefishby BluefishAn enterprise marketing platform for monitoring, optimizing, and measuring how AI represents brands.Contact sales
  • Lingo.devby Lingo.devYC F24Localization engineering and translation-quality platform for product teams.Freemium
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
  • Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium

That’s all 17 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how