NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “inference infrastructure”

20 tools in the directory · Updated

“inference infrastructure”Get an API keyWays to use: SDK / libraryShowing 20 tools
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • Together Inferenceby Together AIPay-per-token API for running open-source models across text, image, video, code and voicePay as you go
  • Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
  • GroqCloudby GroqHosted API for running open-weight language and speech models on Groq hardwareFreemium
  • Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
  • Baidu Qianfanby BaiduBaidu's API platform for accessing ERNIE and open-source foundation models and building Agent applications.Pay as you go
  • Tensorlake Sandboxesby TensorlakeIsolated cloud sandboxes for running AI agents, code, and workloads.Freemium
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Jevby TypeSafeReturn typed AI judgments that software can use directlyPay as you go
  • Claude Developer Platformby AnthropicUse Claude models and agent tools in your own applications through an API.Pay as you go
  • Freestyle VMsby FreestyleYC S24Give AI agents persistent Linux machines for long-running tasksFreemium
  • TwelveLabsby TwelveLabsSearch video libraries and extract timestamped information with AIFreemium
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
  • Gradiumby GradiumStreaming speech models for realtime voice applicationsFreemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Inceptionby InceptionDiffusion-based LLMs that generate tokens in parallel for fast responsesFreemium
  • You.com APIsby You.comLive web search, cited answers, and deep research APIs for AI applicationsFreemium
  • Pinecone Assistantby PineconeManaged RAG assistant that answers questions over uploaded documents with citationsFreemium
  • Cohere APIby CohereCohere API for building retrieval, generation, and embedding featuresPay as you go

That’s all 20 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “inference infrastructure” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how