Distributed Deep Learning

Distributed Deep Learning
Publications
DistDL: Distributed Deep Learning for PyTorch
DistDL is a Python package for model parallel deep learning in PyTorch.
A Linear Algebraic Approach to Model Parallelism in Deep Learning
We present a linear algebraic model for distributed deep learning.