Results for “kv cache”

29 tools in the directory · Updated 2 Nov 2026

“kv cache”Updated: last 30 daysShowing 29 tools

LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Thinkverseby ThinkverseK–12 AI math tutor and teaching assistantContact sales
LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
Jina AI APIsby Jina AISearch foundation APIs for reading URLs, web search, embeddings, and reranking.Freemium
Mosaic AIby DatabricksBuild and deploy AI agent systems grounded in enterprise dataPay as you go
SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
turbopufferby TurbopufferVector and full-text search database built on object storagePaid
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
Featherlessby FeatherlessServerless API access to thousands of open-weight AI models$25+/mo
Atlas Cloudby AtlasCloudPay-per-use API access to hundreds of AI models for image, video, audio and chatPay as you go
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
DeepInfraby DeepInfraPay-per-token inference API for open-source and hosted AI modelsPay as you go
Arcee API Platformby Arcee AIHosted text-model API for AI applicationsContact sales
Anchor Browserby Anchor BrowserCloud browsers that let AI agents operate websites like a human user.Freemium
CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
Shopify Catalogby ShopifyAgent-facing product search and cart/checkout access across Shopify merchants or a single store.Unknown
Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go