Results for “crowdsourced evaluation”

13 tools in the directory · Updated 2 Nov 2026

“crowdsourced evaluation”Ways to use: MCP serverBacked by Y CombinatorShowing 13 tools

Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
Storylane RepXby StorylaneYC S21Website agent that answers visitor questions, qualifies buyers, and books sales meetings$2,000+/moFree trial
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Openlayerby OpenlayerYC S21AI governance platform to test, monitor, and control AI systemsFreemium
Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
Credal.aiby Credal.aiYC W23Build governed MCP servers and agents around enterprise contextContact sales
telliby telliYC F24Build and operate AI voice agents for customer callsUnknown
Laminarby LaminarYC S24Trace AI agents and find recurring failures across their runsFreemium
Thunder Computeby Thunder ComputeYC S24Run GPU development machines and isolated agent workloadsPay as you go
Voicepanelby VoicepanelYC W24AI feedback and research platform for studying products, campaigns, and ideas with real participants.Paid
Manufact Cloudby ManufactYC S25Deploy, test and monitor MCP servers across AI clientsFreemium
Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium