Results for “fast inference”

67 tools in the directory · Updated 2 Nov 2026

“fast inference”Updated: last 7 daysShowing 67 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Fast Simonby Fast Simon Inc.AI product discovery and shopping optimization for eCommerce stores.Contact sales
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Infinitus FastTrackby InfinitusConnect healthcare staff to live payer representatives without waiting on holdContact sales
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
io.intelligenceby io.netUse multiple AI models through one inference API and studioPaid
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
Research Flowby TypeformAI-moderated research platform inside Typeform for fast customer and market studiesContact sales
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
21st AIby 21stYC W26Generate and compare several UI component designs from a promptPaid