Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] how to sold Jasper ASR Loss: inf or Gradient overflow issue? #1513

Closed
caohongnga opened this issue Dec 3, 2020 · 1 comment
Closed

Comments

@caohongnga
Copy link

Hello,
I train Jasper ASR but the loss is inf and Gradient overflow. How should I solve it.
I already refer to the issue #637 and see that it is already fixed as suggested for the current version but my model still has the same issue.
Thank you

@okuchaiev
Copy link
Member

try very small learning rate first. And / or learning rate policy with a longer warmup period. Then see if you can increase them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants