NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “kv cache”

8 tools in this category · Updated

“kv cache”CodingWays to use: SDK / libraryShowing 8 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
  • SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
  • Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • Anchor Browserby Anchor BrowserCloud browsers that let AI agents operate websites like a human user.Freemium
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree

That’s all 8 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “kv cache” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how