ToolsCompaniesAbout

Results for “gpu serving”

42 tools in the directory · Updated

“gpu serving”Runs on Self-hostedShowing 42 tools
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
  • TrueFoundry Agent Gatewayby TrueFoundryControl layer for governing and observing AI agents in productionContact sales
  • NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
  • NVIDIA AI Enterpriseby NVIDIALicensed NVIDIA software suite for building, running and supporting production AI on GPUs$4,500+/user/yrFree trial
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Morphik Developer Platformby MorphikYC X25Document database for building agents and retrieval appsFreemium
  • Open Finetuningby LyzrFine-tunes open models on your documents and routes tasks to them.$35K/yr
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
  • Quail Voice Focusby ai-cousticsReal-time isolation of a primary speaker from background speech and noise for voice AI.$135+/mo
  • Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go