NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “model serving”

494 tools in the directory · Updated

“model serving”Ways to use: APIUpdated: last 30 daysShowing 494 tools
  • Model Vaultby CohereDedicated, fully managed inference for Cohere modelsPay as you go
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
  • Azure OpenAI in Foundry Modelsby MicrosoftAzure-hosted access to OpenAI models for building apps and agentsPay as you go
  • Meta Model APIby MetaInference API for Meta's Muse text, image, speech and segmentation modelsPay as you go
  • Alibaba Cloud Model Studioby Alibaba GroupAlibaba Cloud's API platform for Qwen and third-party models, with OpenAI-compatible accessPay as you go
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Reka Cloudby Reka AICloud platform to train, customize, and serve multimodal AI modelsUnknown
  • Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
  • vLLMby vLLMLLM inference and serving library.Free
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
  • Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
  • Parasailby ParasailHosted inference for open and frontier models via one OpenAI-compatible APIPay as you go
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “model serving” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how