Results for “inference optimization”

• Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknownWatch
• llamafileby Mozilla.aiRun local language models from portable executable filesFreeWatch
• encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFreeWatch
• NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFreeWatch
• AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFreeWatch
• DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.UnknownWatch
• NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFreeWatch
• NVIDIA NeMoby NVIDIAOpen libraries for specializing, evaluating, governing, and deploying AI agentsUnknownWatch
• MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFreeWatch

That’s all 9 tools.