Results for “llm proxy”

15 tools in the directory · Updated 2 Nov 2026

“llm proxy”Download or installUpdated: last 7 daysShowing 15 tools

vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
A. (A Dot)by SK TelecomManage conversations, notes and daily plans with a Korean AI assistantUnknown
Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
DataLineby DataLineChat with data to generate tables, charts, and dashboards.Unknown
ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
Kino AIby Kino AIYC S23AI video editor and footage library for teams and agents.Freemium
PandasAIby PandasAIYC W24A Python library for asking questions about data in natural language and generating analyses, charts, and data transformations.€29.99+/mo
Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown