Results for “kv cache”

11 tools in the directory · Updated 2 Nov 2026

“kv cache”Ways to use: SDK / libraryShowing 11 tools

LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
turbopufferby TurbopufferVector and full-text search database built on object storagePaid
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
Anchor Browserby Anchor BrowserCloud browsers that let AI agents operate websites like a human user.Freemium
Murf Dubby MurfAI video and audio dubbing into 40+ languages, with a web studio and API.Unknown
Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
Cleanvoice AIby CleanvoiceRemoves filler words, noise, breaths and dead air from recorded audio and video, via web app or API.Pay as you go