NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm inference”

17 tools in the directory · Updated

“llm inference”Sign up onlineUpdated: last 7 daysShowing 17 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • MiroThinkerby MiroMindMiroThinker is a deep-research agent and open-source model family for research and prediction tasks.Freemium
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
  • EvoLinkby EvoLinkA unified API gateway for language, image, video and audio models.Pay as you go
  • Syntheticby SyntheticHosted access to open-source language models through a web app and compatible APIs.$9+/mo
  • Epsillaby EpsillaYC S23A no-code and configurable platform for building domain-specific AI agents with private knowledge.Freemium
  • Magic Loopsby Magic LoopsYC S23A no-code platform for building AI-native apps.Freemium
  • a0.devby a0.devYC W25AI coding agent for building and publishing mobile apps.Unknown

That’s all 17 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how