ToolsCompaniesAbout

Results for “llm monitoring”

98 tools in the directory · Updated

“llm monitoring”Runs on Command lineShowing 98 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • Kensho LLM-Ready APIby S&P GlobalPython client and MCP server for querying S&P Global financial datasets from LLM applicationsContact sales
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • H Platformby H CompanyA platform for building, running, and monitoring computer-use agents across browser, desktop, and enterprise environments.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • Monte Carloby Monte CarloAgent observability and data monitoring platform for enterprise AI teamsContact sales
  • LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Voiceflowby VoiceflowPlatform for building, testing, deploying and monitoring chat and voice AI agents.Contact sales
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Roboflowby RoboflowYC S20Vision AI platform for building, training, deploying and monitoring computer vision applications.Freemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • ScrapingBeeby ScrapingBeeHosted web scraping API for fetching rendered pages, proxies, and structured data$19+/mo
  • HoneyHiveby HoneyhiveAgent observability and evaluation platform for tracing, scoring, and improving AI agents.Freemium
  • Braintrustby BraintrustAgent observability and evals for engineering and product teamsFreemium