Results for “llm evals”

17 tools in the directory · Updated 2 Nov 2026

“llm evals”Open sourceWays to use: SDK / libraryShowing 17 tools

any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
FalkorDB GraphRAG SDKby FalkorDBOpen-source toolkit for building GraphRAG systems on knowledge graphsFreemium
FalkorDB QueryWeaverby FalkorDBOpen-source, graph-powered text-to-SQL for plain-English database queriesFree
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
LangGraphby LangChainOpen-source Python library for orchestrating stateful, long-running AI agentsFree
LangChainby LangChainOpen source framework for building agents that work with many models and toolsFree
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium