NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “batch inference”

19 tools in the directory · Updated

“batch inference”Get an API keyWays to use: SDK / libraryShowing 19 tools
  • Together Inferenceby Together AIPay-per-token API for running open-source models across text, image, video, code and voicePay as you go
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
  • Voyage AIby Voyage AIEmbedding and reranking models via standalone API or inside MongoDB Atlas.Freemium
  • Gemini APIby GoogleDeveloper API for Gemini models, agents, and multimodal generationFreemium
  • ElevenAPIby ElevenLabsDeveloper API for text to speech, transcription, music, sound effects, dubbing and voice agents.Freemium
  • Linkupby LinkupWeb search API for AI applications, with sourced answers and a Bring Your Own Cloud option.Pay as you go
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Inceptionby InceptionDiffusion-based LLMs that generate tokens in parallel for fast responsesFreemium
  • Grok Imagineby xAIxAI's API for generating and editing images and video from text or image promptsPay as you go
  • You.com APIsby You.comLive web search, cited answers, and deep research APIs for AI applicationsFreemium
  • GroqCloudby GroqHosted API for running open-weight language and speech models on Groq hardwareFreemium
  • Cloud Translationby GoogleMachine translation API for text, documents, and media workflowsPay as you go
  • Cohere APIby CohereCohere API for building retrieval, generation, and embedding featuresPay as you go
  • Claude Developer Platformby AnthropicUse Claude models and agent tools in your own applications through an API.Pay as you go
  • Adobe Firefly Servicesby AdobeAdobe's generative AI and Creative Cloud APIs for automating content production at scaleUnknown

That’s all 19 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “batch inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how