ToolsCompaniesAbout

Results for “crowdsourced evaluation”

179 tools in the directory · Updated

“crowdsourced evaluation”Showing 179 tools
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Arthur Engineby ArthurAIRun AI evaluations and experiments in your own environmentFree
  • Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
  • Runway Roboticsby RunwayRobot learning toolkit built on Runway's GWM-1 world model, covering policy inference, evaluation and data augmentation.Contact sales
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Synthesizedby SynthesizedEnterprise test-data management for software testing, migrations and AI-agent evaluation.Contact sales
  • SuperAnnotateby SuperAnnotateManage training data, annotation and model evaluation in one platformPaid
  • Bloomby AnthropicGenerate behavioral evaluation suites to test how AI models act across varied scenarios.Free
  • Tunerby TunerSimulation, evaluation, and monitoring for voice AI agents.Freemium
  • Fiddler AIby FiddlerRuntime monitoring, evaluation, and policy enforcement for enterprise AI agents.Freemium
  • AgentWardenby Dynamo AIYC W22Agent and MCP security evaluation and runtime policy enforcement for enterprise AI.Contact sales
  • Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
  • Judgmentby Judgment LabsMonitoring, issue discovery and evaluation for long-horizon AI agents.Contact sales
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
  • W&B Weaveby CoreWeaveObservability, evaluation, and guardrails for production AI agentsFreemium
  • Horizonby LabelboxRL training environments and evaluation data for AI reasoning and agent workContact sales
  • Crosschq AI Interview Agentby CrosschqAI-led structured interviews and candidate evaluation for recruiting teams.Contact sales
  • Amazon Connect Talentby AmazonAI-led interviews and assessments for scaled candidate evaluationPay as you go
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown