ToolsCompaniesAbout

DevOps and observability

19 tools in Coding · Updated

Coding › DevOps and observabilityRuns on Self-hostedShowing 19 tools
  • LangChainby LangChainOpen source framework for building agents that work with many models and toolsFree
  • OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Agnoby AgnoPlatform for building, running and managing self-hosted AI agentsFreemium
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
  • Lunaryby LunaryMonitor LLM applications, review conversations and improve prompts$20+/user/mo
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • Athina AIby Athina AICollaborative platform for building, testing and monitoring AI featuresFreemium
  • Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
  • Microsoft Foundryby MicrosoftEnterprise platform for building, grounding, and governing AI apps and agentsPay as you go

That’s all 19 tools.