ToolsCompaniesAbout

Results for “async inference”

8 tools in the directory · Updated

“async inference”Open sourceShowing 8 tools
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFree
  • AutoGenby MicrosoftArchived open-source Python and .NET framework for multi-agent AI applicationsFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree

That’s all 8 tools.