Results for “distributed inference”

• Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemiumWatch
• NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFreeWatch
• NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFreeWatch
• llamafileby Mozilla.aiRun local language models from portable executable filesFreeWatch
• encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFreeWatch
• Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknownWatch
• Tribuoby OracleJava machine learning library for classification, regression and clusteringFreeWatch
• InterpretMLby MicrosoftOpen-source Python toolkit for training interpretable models and explaining black-box onesFreeWatch
• AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFreeWatch
• AutoGenby MicrosoftArchived open-source Python and .NET framework for multi-agent AI applicationsFreeWatch
• Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFreeWatch
• MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFreeWatch
• Chromaby ChromaOpen-source search infrastructure for AI apps, with the managed Cloud service being wound downFreemiumWatch

That’s all 13 tools.