Results for “model serving”

163 tools in this category · Updated 2 Nov 2026

“model serving”CodingRuns on Self-hostedShowing 163 tools

Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
W&B Modelsby CoreWeaveTrack, version, compare, and reproduce model experiments at scaleFreemium
llamafileby Mozilla.aiRun local language models from portable executable filesFree
TrueFoundry Agent Gatewayby TrueFoundryControl layer for governing and observing AI agents in productionContact sales
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
vLLMby vLLMLLM inference and serving library.Free
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
MLJAR AutoMLby MLJARTrain and compare predictive models for tabular dataFree
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
Boomi AI Gatewayby BoomiGovernance, observability, and cost control for AI model and MCP trafficContact sales
Open Finetuningby LyzrFine-tunes open models on your documents and routes tasks to them.$35K/yr
Gemini APIby GoogleDeveloper API for Gemini models, agents, and multimodal generationFreemium
Amazon Novaby AmazonAmazon's family of foundation models plus a free web site for trying themUnknown