Results for “llm ops”

24 tools in the directory · Updated 2 Nov 2026

“llm ops”Ways to use: SDK / libraryUpdated: last 7 daysShowing 24 tools

vLLMby vLLMLLM inference and serving library.Free
Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
Viktorby ViktorA team AI agent that carries out work across connected business tools.Freemium
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
Tonic Textualby Tonic.aiTonic Textual detects sensitive information in unstructured data and redacts it or replaces it with synthetic values.Contact sales
PageIndexby VectifyAIDocument retrieval and question-answering tools for long, complex documents.Freemium
TestSavant.AIby TestSavant.AIAI testing and assurance platform for evaluating applications and tracking release risks.Freemium
Aembitby AembitIdentity and access control for AI agents and workloadsFreemium
Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
Veriff Biometric Authenticationby VeriffVeriff Biometric Authentication checks returning users with selfie-based facial matching and liveness detection.Unknown
SpeechBrainby SpeechBrainOpen-source Python toolkit for speech and conversational AI research and development.Free
Epsillaby EpsillaYC S23A no-code and configurable platform for building domain-specific AI agents with private knowledge.Freemium
PandasAIby PandasAIYC W24A Python library for asking questions about data in natural language and generating analyses, charts, and data transformations.€29.99+/mo
Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown