Results for “gpu serving”

60 tools in this category · Updated 2 Nov 2026

“gpu serving”CodingWays to use: SDK / libraryShowing 60 tools

vLLMby vLLMLLM inference and serving library.Free
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Runpodby RunpodGPU cloud for AI training, inference, and deploymentPay as you go
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Lightning AIby Lightning AICloud GPUs, Studios, and training tools for building and deploying your own AI models.Freemium
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Chutesby ChutesServerless hosting for open-source AI models, billed per token or GPU secondPay as you go
Beamby BeamYC W22Persistent cloud VMs, sandboxes and GPUs for AI agentsPay as you go
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
Anyscale Platformby AnyscaleManaged platform for running Ray-based AI workloads at scalePay as you go
Amazon SageMaker AIby AmazonAWS service for customizing, training, deploying, and governing machine learning and generative AI models.Pay as you go