DeepSpeed: Revolutionizing Distributed Deep Learning Training

DeepSpeed is part of Microsoft AI at Scale and is a deep-learning optimization library. It makes distributed training simple, efficient, effective.

Source:

DeepSpeed