ToolsCompaniesAbout

Results for “llm evaluation”

137 tools in the directory · Updated

“llm evaluation”Runs on Self-hostedShowing 137 tools
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
  • Arthur Engineby ArthurAIRun AI evaluations and experiments in your own environmentFree
  • Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium