ToolsCompaniesAbout

Results for “model serving”

225 tools in the directory · Updated

“model serving”Runs on Self-hostedShowing 225 tools
  • Cloudera AI Inferenceby ClouderaModel serving for deploying and scaling private AI applications, agents, and assistants.Pay as you go
  • W&B Modelsby CoreWeaveTrack, version, compare, and reproduce model experiments at scaleFreemium
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • TrueFoundry Agent Gatewayby TrueFoundryControl layer for governing and observing AI agents in productionContact sales
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • NVIDIA NIMby NVIDIAPrebuilt inference containers for running AI models on NVIDIA GPUsFreemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • MLJAR AutoMLby MLJARTrain and compare predictive models for tabular dataFree
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • any-guardrailby Mozilla.aiCompare and integrate AI guardrail models through one interfaceFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • 0DIN Scannerby MozillaTest AI models and chat interfaces for security weaknessesFree
  • Thunderboltby MozillaDeploy an AI client with your own models and agent connectionsFree
  • Nutanix Enterprise AIby NutanixEnterprise AI platform for governing agents, models, and inference across hybrid infrastructureContact sales
  • Boomi AI Gatewayby BoomiGovernance, observability, and cost control for AI model and MCP trafficContact sales