Results for “distributed inference”

84 tools in the directory · Updated 2 Nov 2026

“distributed inference”Ways to use: Command lineUpdated: last 30 daysShowing 84 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Together Inferenceby Together AIPay-per-token API for running open-source models across text, image, video, code and voicePay as you go
Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
Fireworks AI Inference Platformby Fireworks AIRun, ensemble and fine-tune open AI models through one API platform.Pay as you go
Runpodby RunpodGPU cloud for AI training, inference, and deploymentPay as you go
vLLMby vLLMLLM inference and serving library.Free
Modalby ModalServerless cloud compute for AI inference, training, and sandboxed code.Freemium
Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
VESSL Cloudby VESSL CloudGPU cloud for training, fine-tuning, and inference workloadsPay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Inworld AIby Inworld AIVoice and open-model inference for consumer AI appsFreemium
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
Nebius AI Cloudby Nebius GroupGPU cloud for training and inference on NVIDIA hardwarePay as you go
Hedraby HedraHosted inference and model-building service for visual and multimodal AIPay as you go
Morphby MorphYC S23Hosted inference API for coding agents, with search, edit-apply, and compaction modelsUnknown
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free