Results for “gpu inference”

73 tools in the directory · Updated 2 Nov 2026

“gpu inference”Runs on Self-hostedShowing 73 tools

Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
Gimlet Cloudby Gimlet LabsManaged inference API for agentic AI workloads across heterogeneous hardwareUnknown
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
NVIDIA AI Enterpriseby NVIDIALicensed NVIDIA software suite for building, running and supporting production AI on GPUs$4,500+/user/yrFree trial
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Open Finetuningby LyzrFine-tunes open models on your documents and routes tasks to them.$35K/yr
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium