Results for “product evals”

206 tools in the directory · Updated 2 Nov 2026

“product evals”Ways to use: Command lineUpdated: last 30 daysShowing 206 tools

Braintrustby BraintrustAgent observability and evals for engineering and product teamsFreemium
Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
Pickaxeby PickaxeBuild AI agents, package them as products, and sell them through branded portals.$29+/mo
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Auphonicby AuphonicAI audio processing for podcasts, video, and spoken-word productions.Freemium
Shopify Catalogby ShopifyAgent-facing product search and cart/checkout access across Shopify merchants or a single store.Unknown
LangSmithby LangChainTrace, monitor and evaluate AI agents in productionFreemium
Lingo.devby Lingo.devYC F24Localization engineering and translation-quality platform for product teams.Freemium
Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
Kore.ai Agent Platformby Kore.aiAn AI-native platform for building, running, and optimizing enterprise AI agents.Contact sales
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
SignalWire AI Agent Runtimeby SignalWireVoice AI agent runtime with call state and tool control on telephonyPay as you go
Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
Grafana Assistantby Grafana LabsAI investigations and natural-language analysis for observabilityFreemium
Netlify Agent Runnersby NetlifyPrompt AI agents to build and fix Netlify projectsFreemium
Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
kforgeby Gimlet LabsAutonomous PyTorch kernel generation for CUDA, ROCm, and MetalWaitlist
DigitalOcean Managed Agentsby DigitalOceanRun and govern AI agents on DigitalOcean's managed cloud runtimePay as you go
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium