Results for “local inference”

169 tools in the directory · Updated 2 Nov 2026

“local inference”Updated: last 7 daysShowing 169 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
llamafileby Mozilla.aiRun local language models from portable executable filesFree
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
Whisper Webby Whisper WebBrowser-based speech-to-text transcription with local and optional cloud processing.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Phrase MCP Serverby PhraseUse an AI assistant to inspect and manage Phrase localization workUnknown
Phrase Studioby PhraseTranscribe, subtitle and dub video with localization controlsContact sales
Crowdin MCP Serverby CrowdinLet AI agents operate localization projects through scoped toolsFree
Lokalise MCP Serverby LokaliseManage localization tasks from compatible AI toolsUnknown
io.intelligenceby io.netUse multiple AI models through one inference API and studioPaid
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Quillby QuillA local-first meeting assistant for recording, transcribing, and organizing conversations.Freemium
OpenWhisprby OpenWhisprDictation and meeting notes with local or cloud speech modelsFreemium
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
PyGPTby PyGPTAn open-source desktop assistant for working with cloud and local AI models.Free
CodeCrabby CodeCrabA desktop AI code reviewer that uses local AI command-line tools to review pull requests and local changes.Unknown
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
Archistar AI PreCheckby ArchistarAI plan review software that checks building designs against local codes and zoning rulesUnknown
vLLMby vLLMLLM inference and serving library.Free
Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go