ToolsCompaniesAbout

Results for “llm usage control”

140 tools in this category · Updated

“llm usage control”CodingRuns on Command lineShowing 140 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • Openlayerby OpenlayerYC S21AI governance platform to test, monitor, and control AI systemsFreemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • Blackbox AIby BLACKBOX AIToken-metered model inference and GPU access with end-to-end encryption for enterprises.Contact sales
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LiveKitby LiveKitOpen source framework and cloud platform for building voice, video and robotics AI agentsFreemium
  • Braintrustby BraintrustAgent observability and evals for engineering and product teamsFreemium
  • AI Gatewayby VercelOne API key to route requests to 400+ AI models with fallbacks and spend trackingPay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • cmuxby cmuxYC S24A native macOS terminal for organizing and controlling multiple terminal-based coding agents.Freemium
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales