ToolsCompaniesAbout

Results for “llm deployment”

331 tools in this category · Updated

“llm deployment”CodingShowing 331 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • JFrog MLby JFrogBuild, deploy, manage and monitor AI and ML workflows from GenAI and LLMs to classic ML.Contact sales
  • Bitoby BitoGovernor: an LLM router that grounds coding-agent requests in your codebase to cut token use and price per tokenContact sales
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Liquid AIby Liquid AIEfficient foundation models for on-device and edge deployment.Freemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Cogitoby DecartUltra-fast LLM inference API for open-weight modelsPay as you go
  • SiliconFlowby SiliconFlowHosted inference API for open and commercial LLM and multimodal modelsPay as you go
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • Crusoe Managed Inferenceby CrusoeManaged inference for open models with serverless, self-serve, and tailored deployment optionsPay as you go
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium