NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-gateway”

64 tools in Coding · Updated

“llm-gateway”Coding › Sandboxes and infrastructureShowing 64 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • AI Gatewayby VercelOne API key to route requests to 400+ AI models with fallbacks and spend trackingPay as you go
  • Netlify AI Gatewayby NetlifyNetlify's built-in gateway for calling commercial and open AI models from Netlify-hosted projects.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • SiliconFlowby SiliconFlowHosted inference API for open and commercial LLM and multimodal modelsPay as you go
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Cogitoby DecartUltra-fast LLM inference API for open-weight modelsPay as you go
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • CoreWeave Serverless RLby CoreWeaveManaged reinforcement learning training for LLM agents, with trained checkpoints hosted for inference.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
  • Blackbox AIby BLACKBOX AIToken-metered model inference and GPU access with end-to-end encryption for enterprises.Contact sales
  • Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
  • LiveKitby LiveKitOpen source framework and cloud platform for building voice, video and robotics AI agentsFreemium
  • MindsHubby MindsDBYC W20Shared AI model access, agents, and spending controls for teamsFreemium
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-gateway” there, and it checks these same records.