Results for “crowdsourced evaluation”

46 tools in the directory · Updated 2 Nov 2026

“crowdsourced evaluation”Sign up onlineWays to use: MCP serverShowing 46 tools

Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
Tunerby TunerSimulation, evaluation, and monitoring for voice AI agents.Freemium
Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go
Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
Judgmentby Judgment LabsMonitoring, issue discovery and evaluation for long-horizon AI agents.Contact sales
Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
W&B Weaveby CoreWeaveObservability, evaluation, and guardrails for production AI agentsFreemium
Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Anamby Anam.aiTechstars 2024Build realtime conversational avatars into applicationsFreemium
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Tesslby TesslAgent enablement platform for managing and optimizing agent skillsFreemium
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Kaggleby GoogleCloud notebook environment for running, sharing and reproducing data science codeUnknown
Vectaraby VectaraEnterprise AI agent platform with grounded, auditable answers$100K+/yrFree trial
Voxel51by Voxel51Multimodal data search, curation, and labeling for physical AI teamsFreemium
PromptLayerby PromptLayerPrompt management, evals, and observability for AI teamsFreemium
Future AGIby Future AGIOpen-source platform to evaluate, trace, guard, and optimize AI agents.Freemium
Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
Agnoby AgnoPlatform for building, running and managing self-hosted AI agentsFreemium
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium