Results for “llm inference”

20 tools in the directory · Updated 2 Nov 2026

“llm inference”Open sourceUpdated: last 7 daysShowing 20 tools

any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
FalkorDB GraphRAG SDKby FalkorDBOpen-source toolkit for building GraphRAG systems on knowledge graphsFreemium
FalkorDB QueryWeaverby FalkorDBOpen-source, graph-powered text-to-SQL for plain-English database queriesFree
Obot AI Control Planeby ObotGovern AI agents’ access to models, tools and company systemsFree
Repomixby RepomixPackage repository context for an AI assistantFree
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium