Results for “llm evaluation”

380 tools in the directory · Updated 1 Nov 2026

“llm evaluation”Showing 380 tools

Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
fillmoreby MetaviewRun outbound recruiting from a Slack-based AI coworkerContact sales
LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
CallMinerby CallMinerConversation intelligence and virtual agents for customer experience teamsContact sales
vLLMby vLLMLLM inference and serving library.Free
DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
Kensho LLM-Ready APIby S&P GlobalPython client and MCP server for querying S&P Global financial datasets from LLM applicationsContact sales
LLMrefsby LLMrefsTrack brand visibility and citations across AI search engines by keyword$79/moFree trial
Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
ChatLLMby Abacus.AIAI super assistant with chat, agent and company knowledge modes$10/mo
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium