ToolsCompaniesAbout

Results for “llm monitoring”

309 tools in the directory · Updated

“llm monitoring”Runs on APIShowing 309 tools
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • LLMrefsby LLMrefsTrack brand visibility and citations across AI search engines by keyword$79/moFree trial
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Sentry Agent Tracingby SentryTraces AI agent runs and LLM calls inside Sentry application monitoringFreemium
  • AI Gatewayby TrueFoundrySingle gateway for routing, governing, and monitoring LLM and MCP trafficFreemium
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Kensho LLM-Ready APIby S&P GlobalPython client and MCP server for querying S&P Global financial datasets from LLM applicationsContact sales
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
  • JFrog MLby JFrogBuild, deploy, manage and monitor AI and ML workflows from GenAI and LLMs to classic ML.Contact sales
  • Ragasby RagasOpen-source library for evaluating LLM applications with metrics and eval loopsUnknown
  • ScrapeGraphAIby ScrapeGraphAILLM-driven API for extracting structured data from web pagesFreemium
  • Fiddler AIby FiddlerRuntime monitoring, evaluation, and policy enforcement for enterprise AI agents.Freemium
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Athina AIby Athina AICollaborative platform for building, testing and monitoring AI featuresFreemium
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • WRITER Control Centerby WRITERGoverned control plane for building, running and monitoring enterprise AI agentsPaidFree trial
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown