NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm inference”

62 tools in the directory · Updated

“llm inference”Updated: last 7 daysShowing 62 tools
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
  • Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
  • LearnWise AIby LearnWiseInstitution-wide AI support, tutoring, feedback and course operations for education.Contact sales
  • WALTby WALT AIAutonomous data-engineering agents for building and operating data platforms.Contact sales
  • Generate Enterpriseby Iterate.aiSelf-hosted AI workspace for enterprise knowledge, agents, and workflows.Contact sales
  • MiroThinkerby MiroMindMiroThinker is a deep-research agent and open-source model family for research and prediction tasks.Freemium
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how