Results for “llm hosting”

36 tools in the directory · Updated 2 Nov 2026

“llm hosting”Ways to use: Command lineUpdated: last 7 daysShowing 36 tools

Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
Reductoby ReductoYC W24Parse complex documents and extract structured data with citationsPay as you go
Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
mcp-useby ManufactYC S25Build MCP servers and interactive apps for AI clientsFree
MiroThinkerby MiroMindMiroThinker is a deep-research agent and open-source model family for research and prediction tasks.Freemium
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Repomixby RepomixPackage repository context for an AI assistantFree
Pollinations.aiby Pollinations.aiAn API and platform for generating media and text, using models, and building AI agents and apps.Pay as you go
LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
EvoLinkby EvoLinkA unified API gateway for language, image, video and audio models.Pay as you go
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
AgentWardenby Dynamo AIYC W22Agent and MCP security evaluation and runtime policy enforcement for enterprise AI.Contact sales
AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales