Results for “managed inference”

108 tools in the directory · Updated 2 Nov 2026

“managed inference”Runs on Self-hostedShowing 108 tools

Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Gimlet Cloudby Gimlet LabsManaged inference API for agentic AI workloads across heterogeneous hardwareUnknown
Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
vLLMby vLLMLLM inference and serving library.Free
Couchbase AI Data Planeby CouchbaseManaged AI infrastructure for hosting models, agent memory, and vector data alongside CouchbaseUnknown
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Chromaby ChromaOpen-source search infrastructure for AI apps, with the managed Cloud service being wound downFreemium
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Voxel51by Voxel51Multimodal data search, curation, and labeling for physical AI teamsFreemium
Vespaby Vespa.aiOpen-source search and vector database for building retrieval and ranking applications at scaleUnknown