Results for “model serving”

39 tools in Coding · Updated 2 Nov 2026

“model serving”Coding › DevOps and observabilityShowing 39 tools

Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go
Firebase AI Logicby GoogleCall Gemini models directly from mobile and web apps via FirebasePay as you go
AI Gatewayby VercelOne API key to route requests to 400+ AI models with fallbacks and spend trackingPay as you go
LangChainby LangChainOpen source framework for building agents that work with many models and toolsFree
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
JFrog MLby JFrogBuild, deploy, manage and monitor AI and ML workflows from GenAI and LLMs to classic ML.Contact sales
Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
OpenText AI Operations Managementby OpenTextAIOps platform that correlates monitoring data to find root causes and automate fixesContact sales
New Relic AI Observabilityby New RelicObservability for AI-powered applications and agent stacksFreemium
Sentry Agent Tracingby SentryTraces AI agent runs and LLM calls inside Sentry application monitoringFreemium
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
Lunaryby LunaryMonitor LLM applications, review conversations and improve prompts$20+/user/mo
Monte Carloby Monte CarloAgent observability and data monitoring platform for enterprise AI teamsContact sales
Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
Athina AIby Athina AICollaborative platform for building, testing and monitoring AI featuresFreemium
Agnoby AgnoPlatform for building, running and managing self-hosted AI agentsFreemium
OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium