ToolsCompaniesAbout

Results for “gpu serving”

36 tools in this category · Updated

“gpu serving”CodingRuns on Self-hostedShowing 36 tools
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
  • TrueFoundry Agent Gatewayby TrueFoundryControl layer for governing and observing AI agents in productionContact sales
  • NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
  • NVIDIA AI Enterpriseby NVIDIALicensed NVIDIA software suite for building, running and supporting production AI on GPUs$4,500+/user/yrFree trial
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • Morphik Developer Platformby MorphikYC X25Document database for building agents and retrieval appsFreemium
  • Open Finetuningby LyzrFine-tunes open models on your documents and routes tasks to them.$35K/yr
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
  • Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Helixby HelixMLOrchestrates fleets of AI agents in isolated desktop environments, with human review of their work.$199+/yrFree trial