New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]Replace dropout with attn_drop and proj_drop in MultiheadAttention #1

Merged

jshilong merged 2 commits into jshilong:refactor_tramsformer_base from HIT-cwh:refactor_transformer

Apr 26, 2021

HIT-cwh commented Apr 23, 2021

Hi Shilong,
This minor pr replace dropout with attn_drop and proj_drop in MultiheadAttention.
Pls kindly take a look.
Thank you.

HIT-cwh added 2 commits

April 23, 2021 15:25


          change to Sequential

806fed0


          replace dropout with attn_drop and proj_drop in MultiheadAttention

12140f8

Owner

jshilong commented Apr 26, 2021

LGTM

jshilong merged commit 6bc3254 into jshilong:refactor_tramsformer_base

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet