Results for “llm infrastructure”

102 tools in this category · Updated 2 Nov 2026

“llm infrastructure”CodingUpdated: last 7 daysShowing 102 tools

any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
vLLMby vLLMLLM inference and serving library.Free
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
Data Infrastructure Insights MCP Serverby NetAppInvestigate infrastructure telemetry and collection health with AIUnknown
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
Nutrient DWS AI Gateway APIby NutrientOpenAI-compatible LLM gateway for document workflowsFreemium
Pulumi Neoby PulumiAI infrastructure agent for provisioning, governing, and optimizing cloud resourcesPay as you go
Sentry Agent Tracingby SentryTraces AI agent runs and LLM calls inside Sentry application monitoringFreemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
Agentsetby AgentsetDeveloper infrastructure for building AI search and retrieval-augmented generation applications.Freemium