Results for “model serving”

233 tools in this category · Updated 2 Nov 2026

“model serving”CodingWays to use: SDK / libraryShowing 233 tools

Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
W&B Modelsby CoreWeaveTrack, version, compare, and reproduce model experiments at scaleFreemium
Azure OpenAI in Foundry Modelsby MicrosoftAzure-hosted access to OpenAI models for building apps and agentsPay as you go
Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
Alibaba Cloud Model Studioby Alibaba GroupAlibaba Cloud's API platform for Qwen and third-party models, with OpenAI-compatible accessPay as you go
Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
vLLMby vLLMLLM inference and serving library.Free
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
Inference Providersby Hugging FaceModel inference through multiple third-party providers, listed alongside pricing and performance metrics.Pay as you go
Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
Amazon SageMaker AIby AmazonAWS service for customizing, training, deploying, and governing machine learning and generative AI models.Pay as you go
RunAnywhereby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API key and CLIPay as you go