NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “kv cache”

9 tools in this category · Updated

“kv cache”CodingRuns on Self-hostedShowing 9 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free

That’s all 9 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “kv cache” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how