Results for “crowdsourced evaluation”

15 tools in the directory · Updated 2 Nov 2026

“crowdsourced evaluation”Ways to use: SDK / libraryBacked by Y CombinatorShowing 15 tools

AgentWardenby Dynamo AIYC W22Agent and MCP security evaluation and runtime policy enforcement for enterprise AI.Contact sales
DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
MediSearch APIby MediSearchYC S23Stream medical-search answers into your own applicationPaid
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Openlayerby OpenlayerYC S21AI governance platform to test, monitor, and control AI systemsFreemium
Encordby EncordYC W21Data infrastructure for managing, annotating, and evaluating AI training dataPaid
UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
Credal.aiby Credal.aiYC W23Build governed MCP servers and agents around enterprise contextContact sales
Laminarby LaminarYC S24Trace AI agents and find recurring failures across their runsFreemium
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
HUDby HUDYC W25A platform for creating, running, and reviewing reinforcement-learning tasks and benchmarks.Unknown