Results for “model serving”

195 tools in the directory · Updated 2 Nov 2026

“model serving”Runs on Command lineUpdated: last 30 daysShowing 195 tools

Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
llamafileby Mozilla.aiRun local language models from portable executable filesFree
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
vLLMby vLLMLLM inference and serving library.Free
Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
RunAnywhereby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API key and CLIPay as you go
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
Netlify AI Gatewayby NetlifyNetlify's built-in gateway for calling commercial and open AI models from Netlify-hosted projects.Freemium
Runway APIby RunwayDeveloper API for generating video, image and audio with multiple models through one credit balance.Pay as you go
Unity Gatewayby DatabricksGovernance gateway for AI model access, cost controls and agent trafficPay as you go
Junieby JetBrainsJetBrains' coding agent that plans and edits code, with support for multiple AI models.Freemium
Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Rime AIby Rime AIVoice AI models for real-time conversational speechFreemium