Results for “gpu serving”

47 tools in the directory · Updated 2 Nov 2026

“gpu serving”Runs on Command lineUpdated: last 30 daysShowing 47 tools

NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
vLLMby vLLMLLM inference and serving library.Free
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Cerebriumby CerebriumYC W22Serverless GPU infrastructure for real-time AI workloadsFreemium
NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
VESSL Cloudby VESSL CloudGPU cloud for training, fine-tuning, and inference workloadsPay as you go
Runpodby RunpodGPU cloud for AI training, inference, and deploymentPay as you go
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Lightning AIby Lightning AICloud GPUs, Studios, and training tools for building and deploying your own AI models.Freemium
Blackbox AIby BLACKBOX AIToken-metered model inference and GPU access with end-to-end encryption for enterprises.Contact sales
Novita AIby NovitaAIHosted model APIs, GPU infrastructure and agent sandboxes on one platformPay as you go
Chutesby ChutesServerless hosting for open-source AI models, billed per token or GPU secondPay as you go
falby falUnified API for generative media models, custom deployment and GPU computePay as you go
Nebius AI Cloudby Nebius GroupGPU cloud for training and inference on NVIDIA hardwarePay as you go
NVIDIA AI Enterpriseby NVIDIALicensed NVIDIA software suite for building, running and supporting production AI on GPUs$4,500+/user/yrFree trial
Beamby BeamYC W22Persistent cloud VMs, sandboxes and GPUs for AI agentsPay as you go
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go