NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “model serving”

288 tools in the directory · Updated

“model serving”Sign up onlineWays to use: APIShowing 288 tools
  • Model Vaultby CohereDedicated, fully managed inference for Cohere modelsPay as you go
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Azure OpenAI in Foundry Modelsby MicrosoftAzure-hosted access to OpenAI models for building apps and agentsPay as you go
  • Alibaba Cloud Model Studioby Alibaba GroupAlibaba Cloud's API platform for Qwen and third-party models, with OpenAI-compatible accessPay as you go
  • Reka Cloudby Reka AICloud platform to train, customize, and serve multimodal AI modelsUnknown
  • Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
  • Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
  • Parasailby ParasailHosted inference for open and frontier models via one OpenAI-compatible APIPay as you go
  • FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
  • NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
  • Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
  • Inference Providersby Hugging FaceModel inference through multiple third-party providers, listed alongside pricing and performance metrics.Pay as you go
  • Crusoe Managed Inferenceby CrusoeManaged inference for open models with serverless, self-serve, and tailored deployment optionsPay as you go
  • Amazon Personalizeby AmazonManaged AWS recommendation service that trains custom models on your interaction dataPay as you go
  • Mareyby MoonvalleyYC W21AI video model for filmmakers, trained on licensed footageUnknown
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • io.intelligenceby io.netUse multiple AI models through one inference API and studioPaid
  • Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “model serving” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how