NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “distributed inference”

9 tools in the directory · Updated

“distributed inference”Open sourceRuns on APIShowing 9 tools
  • Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Tribuoby OracleJava machine learning library for classification, regression and clusteringFree
  • AutoGenby MicrosoftArchived open-source Python and .NET framework for multi-agent AI applicationsFree
  • Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • Chromaby ChromaOpen-source search infrastructure for AI apps, with the managed Cloud service being wound downFreemium

That’s all 9 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “distributed inference” there, and it checks these same records.