Results for “model serving”

325 tools in this category · Updated 1 Nov 2026

“model serving”CodingRuns on APIShowing 325 tools

Model Vaultby CohereDedicated, fully managed inference for Cohere modelsPay as you go
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
W&B Modelsby CoreWeaveTrack, version, compare, and reproduce model experiments at scaleFreemium
Personal AI MODEL-4by Personal AIDeliver memory-based AI services through a telecommunications networkContact sales
Azure OpenAI in Foundry Modelsby MicrosoftAzure-hosted access to OpenAI models for building apps and agentsPay as you go
Meta Model APIby MetaInference API for Meta's Muse text, image, speech and segmentation modelsPay as you go
Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
Alibaba Cloud Model Studioby Alibaba GroupAlibaba Cloud's API platform for Qwen and third-party models, with OpenAI-compatible accessPay as you go
Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
Reka Cloudby Reka AICloud platform to train, customize, and serve multimodal AI modelsUnknown
TrueFoundry Agent Gatewayby TrueFoundryControl layer for governing and observing AI agents in productionContact sales
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
vLLMby vLLMLLM inference and serving library.Free
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
Parasailby ParasailHosted inference for open and frontier models via one OpenAI-compatible APIPay as you go
FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree