ToolsCompaniesAbout

Results for “model serving”

145 tools in this category · Updated

“model serving”CodingRuns on Command lineShowing 145 tools
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Prime Intellectby Prime IntellectTrain, evaluate, and serve your own AI models on hosted RL infrastructureUnknown
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • RunAnywhereby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API key and CLIPay as you go
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Netlify AI Gatewayby NetlifyNetlify's built-in gateway for calling commercial and open AI models from Netlify-hosted projects.Freemium
  • Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
  • Junieby JetBrainsJetBrains' coding agent that plans and edits code, with support for multiple AI models.Freemium
  • Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Pollinations.aiby Pollinations.aiAn API and platform for generating media and text, using models, and building AI agents and apps.Pay as you go
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • Bloomby AnthropicGenerate behavioral evaluation suites to test how AI models act across varied scenarios.Free
  • Lightning AIby Lightning AICloud GPUs, Studios, and training tools for building and deploying your own AI models.Freemium