ToolsCompaniesAbout

Results for “fast inference”

5 tools in the directory · Updated

“fast inference”Open sourceRuns on APIShowing 5 tools
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium

That’s all 5 tools.