NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

DevOps and observability

38 tools in Coding · Updated

Coding › DevOps and observabilityWays to use: SDK / libraryShowing 38 tools
  • LangChainby LangChainOpen source framework for building agents that work with many models and toolsFree
  • Scale GenAI Platformby Scale AIEnterprise platform for building, deploying, and monitoring AI agents over company data.Contact sales
  • JFrog MLby JFrogBuild, deploy, manage and monitor AI and ML workflows from GenAI and LLMs to classic ML.Contact sales
  • AWS DevOps Agentby AmazonAWS's autonomous agent for incident investigation, release review, and SRE tasksPay as you go
  • Firebase AI Logicby GoogleCall Gemini models directly from mobile and web apps via FirebasePay as you go
  • Augment Codeby HarnessAgent platform for building and running automated software delivery loops$20+/mo
  • Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • New Relic AI Observabilityby New RelicObservability for AI-powered applications and agent stacksFreemium
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • LangWatchby LangWatchAgent observability, simulation and evaluation platform for AI teamsFreemium
  • PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
  • PromptLayerby PromptLayerPrompt management, evals, and observability for AI teamsFreemium
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Agnoby AgnoPlatform for building, running and managing self-hosted AI agentsFreemium
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Braintrustby BraintrustAgent observability and evals for engineering and product teamsFreemium
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Managed MLflowby DatabricksExperiment tracking, tracing, evaluation and model management for ML and GenAI on DatabricksPay as you go