Results for “fast inference”

34 tools in the directory · Updated 2 Nov 2026

“fast inference”Ways to use: APIUpdated: last 7 daysShowing 34 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Fast Simonby Fast Simon Inc.AI product discovery and shopping optimization for eCommerce stores.Contact sales
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
io.intelligenceby io.netUse multiple AI models through one inference API and studioPaid
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Nutrient DWS Data Extraction APIby NutrientParses PDFs, scans, images and Office files into Markdown or spatial JSON, with schema-based field extraction.Freemium
Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
Netlify AI Gatewayby NetlifyNetlify's built-in gateway for calling commercial and open AI models from Netlify-hosted projects.Freemium
MiroThinkerby MiroMindMiroThinker is a deep-research agent and open-source model family for research and prediction tasks.Freemium
Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium