Results for “gpu serving”

77 tools in the directory · Updated 2 Nov 2026

“gpu serving”Ways to use: SDK / libraryShowing 77 tools

vLLMby vLLMLLM inference and serving library.Free
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Runpodby RunpodGPU cloud for AI training, inference, and deploymentPay as you go
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Lightning AIby Lightning AICloud GPUs, Studios, and training tools for building and deploying your own AI models.Freemium
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
Chutesby ChutesServerless hosting for open-source AI models, billed per token or GPU secondPay as you go
falby falUnified API for generative media models, custom deployment and GPU computePay as you go
Microsoft Agent 365by MicrosoftControl plane for observing, governing, and securing AI agents across an organization$15/user/mo
Spacesby Hugging FaceHosted ML demos and apps on Hugging Face, with optional GPU hardwareFreemium
Beamby BeamYC W22Persistent cloud VMs, sandboxes and GPUs for AI agentsPay as you go
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go