Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implement missing get_last_lr #595

Merged
merged 9 commits into from
Dec 14, 2020
Merged

implement missing get_last_lr #595

merged 9 commits into from
Dec 14, 2020

Conversation

stas00
Copy link
Collaborator

@stas00 stas00 commented Dec 11, 2020

This PR fixes:

AttributeError: 'WarmupLR' object has no attribute 'get_last_lr'

by adding get_last_lr as it is implemented in pytorch
I think it was added around pytorch-1.4.

I added get_last_lr to the rest of lr classes in that file, not sure if there are others.

@stas00
Copy link
Collaborator Author

stas00 commented Dec 11, 2020

It looks like your CI is stuck - not doing the build since 12 hours...

@jeffra
Copy link
Collaborator

jeffra commented Dec 11, 2020

It looks like your CI is stuck - not doing the build since 12 hours...

Super strange, not sure what the issue was. Our CI nodes were idle but the job didn't submit to our queue for some reason. After updating your branch with master it seems to have forced it to kick off though.

deepspeed/runtime/lr_schedules.py Show resolved Hide resolved
deepspeed/runtime/lr_schedules.py Outdated Show resolved Hide resolved
@jeffra jeffra merged commit 9f8e8f3 into microsoft:master Dec 14, 2020
@stas00 stas00 deleted the last_lr branch December 14, 2020 22:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants