Results for “llm inference”

19 tools in the directory · Updated 2 Nov 2026

“llm inference”Open sourceRuns on APIShowing 19 tools

any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
FalkorDB GraphRAG SDKby FalkorDBOpen-source toolkit for building GraphRAG systems on knowledge graphsFreemium
NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
Obot AI Control Planeby ObotGovern AI agents’ access to models, tools and company systemsFree
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium