ToolsCompaniesAbout

Results for “model serving”

77 tools in this category · Updated

“model serving”CodingDownload or installShowing 77 tools
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Junieby JetBrainsJetBrains' coding agent that plans and edits code, with support for multiple AI models.Freemium
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • LibreChatby LibreChatOpen-source, self-hosted chat interface for many AI model providers.Free
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
  • Command Codeby Command CodeCoding agent for open models that learns your coding taste$1+/mo
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • SWE-agentby SWE-agentResearch agent that lets a language model use tools to fix GitHub issues and other tasksFree
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Gemini CLIby GoogleOpen-source terminal agent for querying and editing code with Gemini modelsPay as you go
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Crushby CharmA terminal coding agent that works with your code, tools and chosen language model.Unknown
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Metabase MCP Serverby MetabaseQuery and create Metabase content through an AI clientUnknown
  • Codacy Guardrailsby CodacyGuardrails that scan AI-generated code against your policies as it is written.Freemium