ToolsCompaniesAbout

Results for “llm evaluation”

260 tools in the directory · Updated

“llm evaluation”Runs on WebShowing 260 tools
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • CallMinerby CallMinerConversation intelligence and virtual agents for customer experience teamsContact sales
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • LLMrefsby LLMrefsTrack brand visibility and citations across AI search engines by keyword$79/moFree trial
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • ChatLLMby Abacus.AIAI super assistant with chat, agent and company knowledge modes$10/mo
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Fiddler AIby FiddlerRuntime monitoring, evaluation, and policy enforcement for enterprise AI agents.Freemium
  • Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go
  • LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
  • W&B Weaveby CoreWeaveObservability, evaluation, and guardrails for production AI agentsFreemium
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium