ToolsCompaniesAbout

Results for “llm”

105 tools in the directory · Updated

“llm”Runs on Self-hostedShowing 105 tools
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • Lunaryby LunaryMonitor LLM applications, review conversations and improve prompts$20+/user/mo
  • LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
  • Bitoby BitoGovernor: an LLM router that grounds coding-agent requests in your codebase to cut token use and price per tokenContact sales
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • Galileoby GalileoObservability, evaluation, and guardrails for LLM and agentic applications.Unknown
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Deepgram Voice Agent APIby DeepgramSpeech-to-text, LLM orchestration and text-to-speech in one WebSocket API.Pay as you go