ToolsCompaniesAbout

Results for “model serving”

107 tools in the directory · Updated

“model serving”Download or installShowing 107 tools
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Junieby JetBrainsJetBrains' coding agent that plans and edits code, with support for multiple AI models.Freemium
  • OpenWhisprby OpenWhisprDictation and meeting notes with local or cloud speech modelsFreemium
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • PyGPTby PyGPTAn open-source desktop assistant for working with cloud and local AI models.Free
  • LibreChatby LibreChatOpen-source, self-hosted chat interface for many AI model providers.Free
  • Jan Desktopby JanDesktop app for chatting with local and cloud AI modelsUnknown
  • Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.Freemium
  • Command Codeby Command CodeCoding agent for open models that learns your coding taste$1+/mo
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
  • SWE-agentby SWE-agentResearch agent that lets a language model use tools to fix GitHub issues and other tasksFree
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Gemini CLIby GoogleOpen-source terminal agent for querying and editing code with Gemini modelsPay as you go
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree