Final report Final documentation of our project Acceleration of Neural Network Training with Microsoft DeepSpeed at TUM Data Innovation Lab 2022.