NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm inference”

56 tools in Coding · Updated

“llm inference”Coding › MCP and agent toolsShowing 56 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • Morphby MorphYC S23Hosted inference API for coding agents, with search, edit-apply, and compaction modelsUnknown
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
  • BrazeAI Agent Consoleby BrazeBraze's no-code dashboard for building custom LLM-powered agents that enrich data and personalize Canvas journeys.Contact sales
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • Gimlet Cloudby Gimlet LabsManaged inference API for agentic AI workloads across heterogeneous hardwareUnknown
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • Couchbase AI Data Planeby CouchbaseManaged AI infrastructure for hosting models, agent memory, and vector data alongside CouchbaseUnknown
  • Brave Search APIby BraveSearch API that returns pre-extracted, ranked page content for AI agents and grounding.Pay as you go
  • You.com APIsby You.comLive web search, cited answers, and deep research APIs for AI applicationsFreemium
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • Confluent Streaming Agentsby ConfluentEvent-driven AI agents built on Flink and KafkaUnknown
  • Boomi AI Gatewayby BoomiGovernance, observability, and cost control for AI model and MCP trafficContact sales
  • SnapLogic AgentCreatorby SnapLogicBuild, govern and observe AI agents on the SnapLogic integration platform.Contact sales
  • CodeHealth MCP Serverby CodeSceneLocal MCP server that gives AI coding agents CodeHealth feedbackPaidFree trial
  • Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
  • Open Finetuningby LyzrFine-tunes open models on your documents and routes tasks to them.$35K/yr
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how