NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “batch inference”

21 tools in Coding · Updated

“batch inference”Coding › MCP and agent toolsShowing 21 tools
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • Gimlet Cloudby Gimlet LabsManaged inference API for agentic AI workloads across heterogeneous hardwareUnknown
  • Morphby MorphYC S23Hosted inference API for coding agents, with search, edit-apply, and compaction modelsUnknown
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • Tiptap AI Toolkitby TiptapYC S23Lets AI agents read and edit rich-text Tiptap documents in placeContact sales
  • Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
  • Open Finetuningby LyzrFine-tunes open models on your documents and routes tasks to them.$35K/yr
  • Linkupby LinkupWeb search API for AI applications, with sourced answers and a Bring Your Own Cloud option.Pay as you go
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • Couchbase AI Data Planeby CouchbaseManaged AI infrastructure for hosting models, agent memory, and vector data alongside CouchbaseUnknown
  • Brave Search APIby BraveSearch API that returns pre-extracted, ranked page content for AI agents and grounding.Pay as you go
  • You.com APIsby You.comLive web search, cited answers, and deep research APIs for AI applicationsFreemium
  • Sourcegraphby SourcegraphCode search, AI-assisted codebase Q&A, and large-scale code changes for enterprise teamsContact sales
  • Heroku AIby SalesforceManaged AI model access, agent tool execution and vector search for apps built on Heroku.Pay as you go
  • BAMLby BoundaryYC W23A typed programming language for AI agents and existing codebases.Free

That’s all 21 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “batch inference” there, and it checks these same records.