Results for “llm serving”

19 tools in the directory · Updated 2 Nov 2026

“llm serving”Open sourceUpdated: last 7 daysShowing 19 tools

any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
llamafileby Mozilla.aiRun local language models from portable executable filesFree
PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
FalkorDB GraphRAG SDKby FalkorDBOpen-source toolkit for building GraphRAG systems on knowledge graphsFreemium
FalkorDB QueryWeaverby FalkorDBOpen-source, graph-powered text-to-SQL for plain-English database queriesFree
Obot AI Control Planeby ObotGovern AI agents’ access to models, tools and company systemsFree
Repomixby RepomixPackage repository context for an AI assistantFree
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
LangGraphby LangChainOpen-source Python library for orchestrating stateful, long-running AI agentsFree
LangChainby LangChainOpen source framework for building agents that work with many models and toolsFree
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium