ToolsCompaniesAbout

Results for “kv cache”

23 tools in this category · Updated

“kv cache”CodingShowing 23 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
  • Jina AI APIsby Jina AISearch foundation APIs for reading URLs, web search, embeddings, and reranking.Freemium
  • SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
  • Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
  • AI/ML APIby AI/ML APIAccess AI models and agent tools through one APIPay as you go
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • Featherlessby FeatherlessServerless API access to thousands of open-weight AI models$25+/mo
  • AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • DeepInfraby DeepInfraPay-per-token inference API for open-source and hosted AI modelsPay as you go
  • Arcee API Platformby Arcee AIHosted text-model API for AI applicationsContact sales
  • Anchor Browserby Anchor BrowserCloud browsers that let AI agents operate websites like a human user.Freemium
  • CoreWeave Serverless Inferenceby CoreWeavePay-per-token API access to open-source models and LoRA-tuned weights, with built-in tracing and evals.Pay as you go
  • Shopify Catalogby ShopifyAgent-facing product search and cart/checkout access across Shopify merchants or a single store.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free

That’s all 23 tools.