Results for “model serving”

53 tools in the directory · Updated 2 Nov 2026

“model serving”Download or installWays to use: SDK / libraryShowing 53 tools

Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
vLLMby vLLMLLM inference and serving library.Free
Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
LanceDBby LanceDBYC W22AI-native multimodal lakehouse for training data, features, and retrievalFreemium
Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFree
Google ADKby GoogleOpen-source framework for building, testing and deploying AI agents in codeFree
scikit-learnby scikit-learnPython machine learning library for classification, regression, clustering, and preprocessing.Free
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Towheeby ZillizOpen-source framework for building embedding pipelines over unstructured dataFree
NSFW JSby NSFW JSAn open-source JavaScript library for classifying images into content-safety categories.Free
Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
Fairlearnby FairlearnAn open-source Python toolkit and learning resources for assessing and mitigating fairness issues in AI systems.Free