Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the learning rates of butd, ban in gqa dataset. #65

Closed
lukem209 opened this issue Jun 30, 2020 · 2 comments
Closed

Question about the learning rates of butd, ban in gqa dataset. #65

lukem209 opened this issue Jun 30, 2020 · 2 comments

Comments

@lukem209
Copy link

Hello, from the information in the model zoo for GQA, the learning rates of butd and ban-4 are 2e-4. However, in the file of configs/gqa/butd and configs/gqa/ban-4. the setting of learning rates is 2e-3. I want to know which learning rate is right for the models (butd, ban-4, ban-8) in the model zoo.
Thank you!

@ParadoxZW
Copy link
Member

The learning rates in config files are correct. I will fix this bugs in modelzoo file later.

@lukem209
Copy link
Author

lukem209 commented Jul 9, 2020

Thank you!

@MIL-VLG MIL-VLG closed this as completed Jul 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants