Results for “gpu serving”

16 tools in the directory · Updated 2 Nov 2026

“gpu serving”Download or installUpdated: last 7 daysShowing 16 tools

vLLMby vLLMLLM inference and serving library.Free
NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
Pinokioby PinokioA hub for installing and running local AI and creative appsUnknown
Upscaylby UpscaylFree, open-source AI image upscaler with a cloud optionFreemium
FastEmbedby QdrantLightweight Python library for generating text, sparse, image and reranking embeddingsFree
NVIDIA Broadcastby NVIDIAAI voice and video effects for webcams and microphones on RTX PCsFree
Lambda Stackby LambdaCurated Ubuntu software stack for machine learning and deep learningUnknown
LeRobotby Hugging FaceOpen-source Python library for training and running robot policies from demonstrationsFree
Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
LanceDBby LanceDBYC W22AI-native multimodal lakehouse for training data, features, and retrievalFreemium
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free