Results for “crowdsourced evaluation”

20 tools in the directory · Updated 2 Nov 2026

“crowdsourced evaluation”Ways to use: WebBacked by Y CombinatorShowing 20 tools

SuperKalamby SuperKalamYC W23AI mentor for UPSC preparation with handwritten answer evaluationPaid
Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
Design Arenaby Design ArenaYC S25Compare top AI models generating websites, apps, images, video and more.Unknown
Storylane RepXby StorylaneYC S21Website agent that answers visitor questions, qualifies buyers, and books sales meetings$2,000+/moFree trial
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Openlayerby OpenlayerYC S21AI governance platform to test, monitor, and control AI systemsFreemium
Alpasby AlpasYC W21AI-powered supplier search and sourcing software for manufacturing procurement teams.Contact sales
Encordby EncordYC W21Data infrastructure for managing, annotating, and evaluating AI training dataPaid
UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
Credal.aiby Credal.aiYC W23Build governed MCP servers and agents around enterprise contextContact sales
telliby telliYC F24Build and operate AI voice agents for customer callsUnknown
Laminarby LaminarYC S24Trace AI agents and find recurring failures across their runsFreemium
Thunder Computeby Thunder ComputeYC S24Run GPU development machines and isolated agent workloadsPay as you go
Manufact Cloudby ManufactYC S25Deploy, test and monitor MCP servers across AI clientsFreemium
Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
Solidroadby SolidroadYC W25AI practice simulations and feedback for customer-support teams.Contact sales
HUDby HUDYC W25A platform for creating, running, and reviewing reinforcement-learning tasks and benchmarks.Unknown