Results for “private inference”

30 tools in the directory · Updated 2 Nov 2026

“private inference”Ways to use: Command lineUpdated: last 7 daysShowing 30 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
llamafileby Mozilla.aiRun local language models from portable executable filesFree
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
cqby Mozilla.aiShare reviewed operational knowledge across AI agentsFree
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
MiroThinkerby MiroMindMiroThinker is a deep-research agent and open-source model family for research and prediction tasks.Freemium
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Union.aiby Union.aiOperate durable AI workflows in your own cloudFreemium
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
CVATby CVATLabel and review multimodal training data with AI assistanceFreemium
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
BigMLby BigMLBuild and deploy predictive machine-learning models from dataFreemium
Nexlaby NexlaEnterprise data integration and governed MCP access for AI agents.Contact sales