NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm infrastructure”

51 tools in the directory · Updated

“llm infrastructure”Ways to use: Command lineUpdated: last 7 daysShowing 51 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Dosuby DosuShared knowledge infrastructure that keeps team documentation current and supplies coding agents with reusable context.Freemium
  • Cargoby CargoYC S23Go-to-market infrastructure where coding agents build and run GTM agents and workflows as code.Pay as you go
  • Corgeaby CorgeaYC S23AI security scanning and reviewable fixes for application code and infrastructureFreemium
  • Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Unity ML-Agentsby UnityTrain intelligent agents inside Unity games and simulationsFree
  • Requestyby RequestyRoute model requests through one API with usage controlsFreemium
  • Tensorlake Sandboxesby TensorlakeIsolated cloud sandboxes for running AI agents, code, and workloads.Freemium
  • Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
  • Union.aiby Union.aiOperate durable AI workflows in your own cloudFreemium
  • SuperAnnotateby SuperAnnotateManage training data, annotation and model evaluation in one platformPaid
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm infrastructure” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how