Results for “model serving”

58 tools in the directory · Updated 2 Nov 2026

“model serving”Download or installRuns on APIShowing 58 tools

Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
vLLMby vLLMLLM inference and serving library.Free
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
LibreChatby LibreChatOpen-source, self-hosted chat interface for many AI model providers.Free
Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.Freemium
Command Codeby Command CodeCoding agent for open models that learns your coding taste$1+/mo
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
LanceDBby LanceDBYC W22AI-native multimodal lakehouse for training data, features, and retrievalFreemium
Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFree
Dremio CLIby DremioCommand-line access to Dremio's lakehouse for coding agents and automationPay as you go
Grok Buildby xAITerminal coding agent with headless and ACP modesUnknown
Hermes Agentby Nous ResearchOpen-source, self-improving AI agent that keeps memory and skills across sessionsFreemium
Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
scikit-learnby scikit-learnPython machine learning library for classification, regression, clustering, and preprocessing.Free
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Towheeby ZillizOpen-source framework for building embedding pipelines over unstructured dataFree
Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium