Results for “managed inference”

17 tools in the directory · Updated 2 Nov 2026

“managed inference”Open sourceRuns on Self-hostedShowing 17 tools

Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
Chromaby ChromaOpen-source search infrastructure for AI apps, with the managed Cloud service being wound downFreemium
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Arthur Engineby ArthurAIRun AI evaluations and experiments in your own environmentFree
NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFree
Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
Deep Agentsby LangChainOpen-source agent harness for long-running, multi-step tasksFree
LangGraphby LangChainOpen-source Python library for orchestrating stateful, long-running AI agentsFree
Inkeepby InkeepYC W23Build customer-experience agents in a visual editor or TypeScriptContact sales
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium