Results for “model serving”

63 tools in the directory · Updated 2 Nov 2026

“model serving”Download or installUpdated: last 7 daysShowing 63 tools

PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
vLLMby vLLMLLM inference and serving library.Free
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
OpenWhisprby OpenWhisprDictation and meeting notes with local or cloud speech modelsFreemium
PyGPTby PyGPTAn open-source desktop assistant for working with cloud and local AI models.Free
LibreChatby LibreChatOpen-source, self-hosted chat interface for many AI model providers.Free
Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.Freemium
ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
Command Codeby Command CodeCoding agent for open models that learns your coding taste$1+/mo
Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium
Crushby CharmA terminal coding agent that works with your code, tools and chosen language model.Unknown
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
Metabase MCP Serverby MetabaseQuery and create Metabase content through an AI clientUnknown
BrowserOSby BrowserOSYC S24An open-source browser with built-in AI agentsPay as you go
Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFree
Codacy Guardrailsby CodacyGuardrails that scan AI-generated code against your policies as it is written.Freemium
A. (A Dot)by SK TelecomManage conversations, notes and daily plans with a Korean AI assistantUnknown