NVIDIA Neural Modules 1.7.1
Known Issues
- find_unused_parameters should be False when training GPT: #3837
Bugfixes
- revert changes by @yzhang123 :: PR: #3785
- Fixed soft prompt eval loading bug by @vadam5 :: PR: #3805
- mT5 whole word masking and T5 finetuning config fixes by @MaximumEntropy :: PR: #3776
- Raise error if FP16 training is tried with O2 recipe. by @ericharper :: PR: #3806