NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “fast inference”

21 tools in the directory · Updated

“fast inference”Get an API keyShowing 21 tools
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • Together Inferenceby Together AIPay-per-token API for running open-source models across text, image, video, code and voicePay as you go
  • Inceptionby InceptionDiffusion-based LLMs that generate tokens in parallel for fast responsesFreemium
  • Morphby MorphYC S23Hosted inference API for coding agents, with search, edit-apply, and compaction modelsUnknown
  • Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • NEAR AI Cloudby NEAR AIPrivate AI inference with hardware-signed proof on every responsePay as you go
  • Inworld AIby Inworld AIVoice and open-model inference for consumer AI appsFreemium
  • Meta Model APIby MetaInference API for Meta's Muse text, image, speech and segmentation modelsPay as you go
  • Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
  • GroqCloudby GroqHosted API for running open-weight language and speech models on Groq hardwareFreemium
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Parallel Search APIby Parallel Web SystemsWeb search API that returns ranked URLs and compressed excerpts for AI agentsFreemium
  • Brave Search APIby BraveSearch API that returns pre-extracted, ranked page content for AI agents and grounding.Pay as you go
  • You.com APIsby You.comLive web search, cited answers, and deep research APIs for AI applicationsFreemium
  • Poe APIby QuoraOne OpenAI-compatible endpoint for hundreds of models, billed against Poe subscription pointsUnknown
  • Kimi APIby Moonshot AIPay-as-you-go API for Kimi K3-series language models with OpenAI- and Anthropic-compatible endpointsPay as you go
  • Cohere APIby CohereCohere API for building retrieval, generation, and embedding featuresPay as you go

That’s all 21 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “fast inference” there, and it checks these same records.