Results for “crowdsourced evaluation”

16 tools in this category · Updated 2 Nov 2026

“crowdsourced evaluation”CodingBacked by Y CombinatorShowing 16 tools

DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Openlayerby OpenlayerYC S21AI governance platform to test, monitor, and control AI systemsFreemium
UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
Credal.aiby Credal.aiYC W23Build governed MCP servers and agents around enterprise contextContact sales
Laminarby LaminarYC S24Trace AI agents and find recurring failures across their runsFreemium
Thunder Computeby Thunder ComputeYC S24Run GPU development machines and isolated agent workloadsPay as you go
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
Manufact Cloudby ManufactYC S25Deploy, test and monitor MCP servers across AI clientsFreemium
Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
HUDby HUDYC W25A platform for creating, running, and reviewing reinforcement-learning tasks and benchmarks.Unknown