NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm monitoring”

70 tools in the directory · Updated

“llm monitoring”Sign up onlineWays to use: Command lineShowing 70 tools
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
  • PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
  • H Platformby H CompanyA platform for building, running, and monitoring computer-use agents across browser, desktop, and enterprise environments.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Duvoby duvo.aiEnterprise software for mapping, automating and monitoring operational processes across business systems.Freemium
  • Voiceflowby VoiceflowPlatform for building, testing, deploying and monitoring chat and voice AI agents.Contact sales
  • Roboflowby RoboflowYC S20Vision AI platform for building, training, deploying and monitoring computer vision applications.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • DataRobot Agent Workforce Platformby DataRobotBuild, deploy, and govern AI agents on your own infrastructureUnknown
  • ScrapingBeeby ScrapingBeeHosted web scraping API for fetching rendered pages, proxies, and structured data$19+/mo
  • Braintrustby BraintrustAgent observability and evals for engineering and product teamsFreemium
  • Arize AXby Arize AIAgent observability, evaluation and improvement platform for AI engineering teams.Freemium
  • LangSmithby LangChainTrace, monitor and evaluate AI agents in productionFreemium
  • Firecrawlby FirecrawlYC S22Web data API that lets AI agents search, scrape, and crawl live web content, with a developer code and docs index.Freemium
  • Laminarby LaminarYC S24Trace AI agents and find recurring failures across their runsFreemium
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • MongoDB Vector Searchby MongoDBVector and hybrid search on live MongoDB operational dataFreemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm monitoring” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how