ToolsCompaniesAbout

Results for “kv cache”

29 tools in the directory · Updated

“kv cache”Showing 29 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Thinkverseby ThinkverseK–12 AI math tutor and teaching assistantContact sales
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
  • Jina AI APIsby Jina AISearch foundation APIs for reading URLs, web search, embeddings, and reranking.Freemium
  • Mosaic AIby DatabricksBuild and deploy AI agent systems grounded in enterprise dataPay as you go
  • SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
  • Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
  • AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
  • turbopufferby TurbopufferVector and full-text search database built on object storagePaid
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • Featherlessby FeatherlessServerless API access to thousands of open-weight AI models$25+/mo
  • Atlas Cloudby AtlasCloudPay-per-use API access to hundreds of AI models for image, video, audio and chatPay as you go
  • AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • DeepInfraby DeepInfraPay-per-token inference API for open-source and hosted AI modelsPay as you go
  • Arcee API Platformby Arcee AIHosted text-model API for AI applicationsContact sales
  • Anchor Browserby Anchor BrowserCloud browsers that let AI agents operate websites like a human user.Freemium
  • CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
  • Shopify Catalogby ShopifyAgent-facing product search and cart/checkout access across Shopify merchants or a single store.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go