NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm infrastructure”

75 tools in the directory · Updated

“llm infrastructure”Updated: last 7 daysShowing 75 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
  • Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Agentsetby AgentsetDeveloper infrastructure for building AI search and retrieval-augmented generation applications.Freemium
  • Dosuby DosuShared knowledge infrastructure that keeps team documentation current and supplies coding agents with reusable context.Freemium
  • RunSybilby RunSybilAI-powered offensive security platform for continuous application and infrastructure testing.Contact sales
  • Cargoby CargoYC S23Go-to-market infrastructure where coding agents build and run GTM agents and workflows as code.Pay as you go
  • Corgeaby CorgeaYC S23AI security scanning and reviewable fixes for application code and infrastructureFreemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Tensorlake Sandboxesby TensorlakeIsolated cloud sandboxes for running AI agents, code, and workloads.Freemium
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • SpeechBrainby SpeechBrainOpen-source Python toolkit for speech and conversational AI research and development.Free
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
  • Perseusby LettriaA graph-building platform for generating ontologies and knowledge graphs from domain data.Freemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm infrastructure” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how