ToolsCompaniesAbout

Results for “model serving”

59 tools in the directory · Updated

“model serving”Download or installRuns on Command lineShowing 59 tools
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • vLLMby vLLMLLM inference and serving library.Free
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Junieby JetBrainsJetBrains' coding agent that plans and edits code, with support for multiple AI models.Freemium
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.Freemium
  • ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
  • Command Codeby Command CodeCoding agent for open models that learns your coding taste$1+/mo
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • SWE-agentby SWE-agentResearch agent that lets a language model use tools to fix GitHub issues and other tasksFree
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Gemini CLIby GoogleOpen-source terminal agent for querying and editing code with Gemini modelsPay as you go
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Crushby CharmA terminal coding agent that works with your code, tools and chosen language model.Unknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFree
  • Dremio CLIby DremioCommand-line access to Dremio's lakehouse for coding agents and automationPay as you go
  • Grok Buildby xAITerminal coding agent with headless and ACP modesUnknown
  • NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
  • DeepSeek Harnessby DeepSeekOpen-source agent harness with a desktop app and plugin system for work and coding tasksFree