Results for “crowdsourced evaluation”

63 tools in the directory · Updated 2 Nov 2026

“crowdsourced evaluation”Ways to use: APIUpdated: last 7 daysShowing 63 tools

Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
Arthur Engineby ArthurAIRun AI evaluations and experiments in your own environmentFree
Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
Synthesizedby SynthesizedEnterprise test-data management for software testing, migrations and AI-agent evaluation.Contact sales
Tunerby TunerSimulation, evaluation, and monitoring for voice AI agents.Freemium
Fiddler AIby FiddlerRuntime monitoring, evaluation, and policy enforcement for enterprise AI agents.Freemium
Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
Design Arenaby Design ArenaYC S25Compare top AI models generating websites, apps, images, video and more.Unknown
FaceMe Platformby CyberLinkServe face-verification APIs from enterprise infrastructureContact sales
MediSearch APIby MediSearchYC S23Stream medical-search answers into your own applicationPaid
Cognizant Neuro Sanby CognizantBuild and coordinate networks of specialized AI agentsFree
Orbit by Postmanby PostmanFind and evaluate public APIs for an AI agent task.Unknown
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Netskope Skylight AI Guardrailsby NetskopeRuntime guardrails for AI prompts, responses and agent trafficContact sales
Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Cortex AI Gatewayby SnowflakeGoverned endpoint for AI client model access, spend and tracingPay as you go
Perseusby LettriaA graph-building platform for generating ontologies and knowledge graphs from domain data.Freemium
Alation Intelligence Operating Systemby AlationGoverned data, context, and AI agents for enterprise accuracy and complianceContact sales
Anamby Anam.aiTechstars 2024Build realtime conversational avatars into applicationsFreemium