NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “inference optimization”

11 tools in the directory · Updated

“inference optimization”Get an API keyWays to use: SDK / libraryShowing 11 tools
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • Together Inferenceby Together AIPay-per-token API for running open-source models across text, image, video, code and voicePay as you go
  • Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Inceptionby InceptionDiffusion-based LLMs that generate tokens in parallel for fast responsesFreemium
  • You.com APIsby You.comLive web search, cited answers, and deep research APIs for AI applicationsFreemium
  • GroqCloudby GroqHosted API for running open-weight language and speech models on Groq hardwareFreemium
  • Cohere APIby CohereCohere API for building retrieval, generation, and embedding featuresPay as you go

That’s all 11 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “inference optimization” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how