Results for “cloud inference”

110 tools in this category · Updated 2 Nov 2026

“cloud inference”CodingRuns on Self-hostedShowing 110 tools

Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Gimlet Cloudby Gimlet LabsManaged inference API for agentic AI workloads across heterogeneous hardwareUnknown
Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
Google Cloud NetApp Volumes MCP Serverby NetAppManage Google Cloud NetApp Volumes from AI clientsUnknown
Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
LiveKitby LiveKitOpen source framework and cloud platform for building voice, video and robotics AI agentsFreemium
Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
Opencontrollerby LyzrGovernance control plane for AI agents across clouds and frameworks$100K/yr
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
vLLMby vLLMLLM inference and serving library.Free
Steelby SteelCloud browser sessions for AI agents, with an open-source self-hosted option.Pay as you go
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Browserbaseby BrowserbaseCloud browsers, search, and fetch APIs for AI agentsFreemium
Qdrantby QdrantOpen-source vector database and vector search engine, also offered as Qdrant CloudFreemium
Krisp Voice AI SDKby KrispReal-time voice models for voice AI agents and live calls, as SDKs or a cloud API.Unknown