Bagua

Bagua is a deep learning training acceleration framework for PyTorch. It provides a one-stop training acceleration solution, including more scalable distributed training, faster dataloader, kernel fusion, and more.