Results for “kv cache”

12 tools in Coding · Updated 2 Nov 2026

“kv cache”Coding › Sandboxes and infrastructureShowing 12 tools

LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
DeepInfraby DeepInfraPay-per-token inference API for open-source and hosted AI modelsPay as you go
CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go