Results for “fast inference”

28 tools in the directory · Updated 2 Nov 2026

“fast inference”Ways to use: Command lineUpdated: last 7 daysShowing 28 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
21st AIby 21stYC W26Generate and compare several UI component designs from a promptPaid
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
Netlify AI Gatewayby NetlifyNetlify's built-in gateway for calling commercial and open AI models from Netlify-hosted projects.Freemium
MiroThinkerby MiroMindMiroThinker is a deep-research agent and open-source model family for research and prediction tasks.Freemium
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Union.aiby Union.aiOperate durable AI workflows in your own cloudFreemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
Voxel51by Voxel51Multimodal data search, curation, and labeling for physical AI teamsFreemium