Results for “local inference”

75 tools in the directory · Updated 2 Nov 2026

“local inference”Ways to use: APIUpdated: last 7 daysShowing 75 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
llamafileby Mozilla.aiRun local language models from portable executable filesFree
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
io.intelligenceby io.netUse multiple AI models through one inference API and studioPaid
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
OpenWhisprby OpenWhisprDictation and meeting notes with local or cloud speech modelsFreemium
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
vLLMby vLLMLLM inference and serving library.Free
Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
Lingo.devby Lingo.devYC F24Localization engineering and translation-quality platform for product teams.Freemium
Conductorby ConductorYC S24Run coding agents in parallel in isolated local or cloud workspaces.Freemium
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
Netlify AI Gatewayby NetlifyNetlify's built-in gateway for calling commercial and open AI models from Netlify-hosted projects.Freemium
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales