Results for “crowdsourced evaluation”

80 tools in this category · Updated 2 Nov 2026

“crowdsourced evaluation”CodingRuns on WebShowing 80 tools

Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
SuperAnnotateby SuperAnnotateManage training data, annotation and model evaluation in one platformPaid
Tunerby TunerSimulation, evaluation, and monitoring for voice AI agents.Freemium
Fiddler AIby FiddlerRuntime monitoring, evaluation, and policy enforcement for enterprise AI agents.Freemium
Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go
Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
Judgmentby Judgment LabsMonitoring, issue discovery and evaluation for long-horizon AI agents.Contact sales
HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
W&B Weaveby CoreWeaveObservability, evaluation, and guardrails for production AI agentsFreemium
Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
Cognizant Neuro Sanby CognizantBuild and coordinate networks of specialized AI agentsFree
OutSystems Agent Workbenchby OutSystemsDevelop and operate enterprise agent systems with visual toolsContact sales
Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Coralogix AI Observabilityby CoralogixAI observability with per-agent evaluators, cost tracking, and session tracingPay as you go
Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium