fix MegatronLayerPolicy to be compatible with the newest ParallelTransformerLayer#4236

Merged

tjruwase merged 2 commits intodeepspeedai:masterfrom dc3671:fix-megatron-gpt

Aug 31, 2023

+11-4

Commits on Aug 30, 2023

fix MegatronLayerPolicy to be compatible with the newest ParallelTransformerLayer
Chen, Zhenhuan
committed
Merge branch 'master' into fix-megatron-gpt
RezaYazdaniAminabadi
authored