Results for “kv cache”

20 tools in this category · Updated 2 Nov 2026

“kv cache”CodingRuns on APIShowing 20 tools

LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
Jina AI APIsby Jina AISearch foundation APIs for reading URLs, web search, embeddings, and reranking.Freemium
SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
Featherlessby FeatherlessServerless API access to thousands of open-weight AI models$25+/mo
AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
DeepInfraby DeepInfraPay-per-token inference API for open-source and hosted AI modelsPay as you go
Arcee API Platformby Arcee AIHosted text-model API for AI applicationsContact sales
Anchor Browserby Anchor BrowserCloud browsers that let AI agents operate websites like a human user.Freemium
CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
Shopify Catalogby ShopifyAgent-facing product search and cart/checkout access across Shopify merchants or a single store.Unknown
Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go