Results for “kv cache”

• LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.FreeWatch
• LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFreeWatch
• Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.FreeWatch
• Shopify Catalogby ShopifyAgent-facing product search and cart/checkout access across Shopify merchants or a single store.UnknownWatch
• Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFreeWatch
• CChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.FreeWatch

That’s all 6 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “kv cache” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how