NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “product evals”

131 tools in this category · Updated

“product evals”CodingWays to use: SDK / libraryShowing 131 tools
  • Braintrustby BraintrustAgent observability and evals for engineering and product teamsFreemium
  • PromptLayerby PromptLayerPrompt management, evals, and observability for AI teamsFreemium
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • PlayerZeroby PlayerZeroAI production engineering platform for investigating and validating production software changes.Contact sales
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • W&B Weaveby CoreWeaveObservability, evaluation, and guardrails for production AI agentsFreemium
  • LangSmithby LangChainTrace, monitor and evaluate AI agents in productionFreemium
  • Paragonby ParagonYC W20Integration infrastructure for AI agents and SaaS productsContact sales
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • Fiddler AIby FiddlerRuntime monitoring, evaluation, and policy enforcement for enterprise AI agents.Freemium
  • Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Athina AIby Athina AICollaborative platform for building, testing and monitoring AI featuresFreemium
  • LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
  • Judgmentby Judgment LabsMonitoring, issue discovery and evaluation for long-horizon AI agents.Contact sales
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “product evals” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how