Results for “llm inference”

126 tools in this category · Updated 2 Nov 2026

“llm inference”CodingUpdated: last 7 daysShowing 126 tools

Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Crusoe Managed Inferenceby CrusoeManaged inference for open models with serverless, self-serve, and tailored deployment optionsPay as you go
Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
DigitalOcean Serverless Inferenceby DigitalOceanServerless model inference from DigitalOcean, billed per token or per requestPay as you go
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
SiliconFlowby SiliconFlowHosted inference API for open and commercial LLM and multimodal modelsPay as you go
Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
NEAR AI Cloudby NEAR AIPrivate AI inference with hardware-signed proof on every responsePay as you go
Inceptionby InceptionDiffusion-based LLMs that generate tokens in parallel for fast responsesFreemium
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
Parasailby ParasailHosted inference for open and frontier models via one OpenAI-compatible APIPay as you go
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Morphby MorphYC S23Hosted inference API for coding agents, with search, edit-apply, and compaction modelsUnknown
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free