Results for “inference api”

129 tools in this category · Updated 2 Nov 2026

“inference api”CodingRuns on Self-hostedShowing 129 tools

Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
.txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
Gemini APIby GoogleDeveloper API for Gemini models, agents, and multimodal generationFreemium
ElevenAPIby ElevenLabsDeveloper API for text to speech, transcription, music, sound effects, dubbing and voice agents.Freemium
Hume APIby Hume AIDeveloper voice APIs for emotionally expressive speech, with EVI and TTS being sunset on November 13, 2026.Unknown
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Gimlet Cloudby Gimlet LabsManaged inference API for agentic AI workloads across heterogeneous hardwareUnknown
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Deepgram Speech-to-Text APIby DeepgramSpeech-to-text API for transcription and real-time voice agents.Pay as you go
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
vLLMby vLLMLLM inference and serving library.Free
NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Baidu Qianfanby BaiduBaidu's API platform for accessing ERNIE and open-source foundation models and building Agent applications.Pay as you go
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free