ToolsCompaniesAbout

Results for “inference optimization”

6 tools in the directory · Updated

“inference optimization”Open sourceRuns on APIShowing 6 tools
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • NVIDIA NeMoby NVIDIAOpen libraries for specializing, evaluating, governing, and deploying AI agentsUnknown
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree

That’s all 6 tools.