NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm usage control”

96 tools in Coding · Updated

“llm usage control”Coding › Sandboxes and infrastructureShowing 96 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Requestyby RequestyRoute model requests through one API with usage controlsFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • SiliconFlowby SiliconFlowHosted inference API for open and commercial LLM and multimodal modelsPay as you go
  • MindsHubby MindsDBYC W20Shared AI model access, agents, and spending controls for teamsFreemium
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • CoreWeave Serverless RLby CoreWeaveManaged reinforcement learning training for LLM agents, with trained checkpoints hosted for inference.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • Blackbox AIby BLACKBOX AIToken-metered model inference and GPU access with end-to-end encryption for enterprises.Contact sales
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Cogitoby DecartUltra-fast LLM inference API for open-weight modelsPay as you go
  • LiveKitby LiveKitOpen source framework and cloud platform for building voice, video and robotics AI agentsFreemium
  • AI Gatewayby VercelOne API key to route requests to 400+ AI models with fallbacks and spend trackingPay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • DigitalOcean Serverless Inferenceby DigitalOceanServerless model inference from DigitalOcean, billed per token or per requestPay as you go
  • Union.aiby Union.aiOperate durable AI workflows in your own cloudFreemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm usage control” there, and it checks these same records.