Results for “inference”

65 tools in the directory · Updated 2 Nov 2026

“inference”Ways to use: Command lineUpdated: last 7 daysShowing 65 tools

Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
VESSL Cloudby VESSL CloudGPU cloud for training, fine-tuning, and inference workloadsPay as you go
Runpodby RunpodGPU cloud for AI training, inference, and deploymentPay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Inworld AIby Inworld AIVoice and open-model inference for consumer AI appsFreemium
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Nebius AI Cloudby Nebius GroupGPU cloud for training and inference on NVIDIA hardwarePay as you go
Modalby ModalServerless cloud compute for AI inference, training, and sandboxed code.Freemium
Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
Morphby MorphYC S23Hosted inference API for coding agents, with search, edit-apply, and compaction modelsUnknown
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go