Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NeMo-UX: Add sgd optim #11157

Merged
merged 12 commits into from
Nov 5, 2024
Merged

NeMo-UX: Add sgd optim #11157

merged 12 commits into from
Nov 5, 2024

Conversation

akoumpa
Copy link
Member

@akoumpa akoumpa commented Nov 5, 2024

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Collection: [Note which collection this PR will affect]

Changelog

  • Add specific line by line info of high level changes in this PR.

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this 

GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR.
To re-run CI remove and add the label again.
To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you add or update any necessary documentation?
  • Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • New Feature
  • Bugfix
  • Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: Alexandros Koumparoulis <[email protected]>
@akoumpa akoumpa changed the title Akoumparouli/nemo ux sgd optim NeMo-UX: Add sgd optim Nov 5, 2024
@akoumpa akoumpa requested a review from marcromeyn November 5, 2024 08:08
Signed-off-by: Alexandros Koumparoulis <[email protected]>
@akoumpa akoumpa force-pushed the akoumparouli/nemo_ux_sgd_optim branch from e831f1d to 7f8a87c Compare November 5, 2024 08:51
Signed-off-by: Alexandros Koumparoulis <[email protected]>
@akoumpa akoumpa force-pushed the akoumparouli/nemo_ux_sgd_optim branch from 7633d2e to 8732e2a Compare November 5, 2024 09:04
Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: Alexandros Koumparoulis <[email protected]>
@akoumpa akoumpa force-pushed the akoumparouli/nemo_ux_sgd_optim branch from cdc5bec to 9752704 Compare November 5, 2024 09:09
Signed-off-by: Alexandros Koumparoulis <[email protected]>
@akoumpa akoumpa force-pushed the akoumparouli/nemo_ux_sgd_optim branch from 102e3d1 to a132ea7 Compare November 5, 2024 09:19
Signed-off-by: Alexandros Koumparoulis <[email protected]>
@akoumpa akoumpa added Run CICD and removed Run CICD labels Nov 5, 2024
@akoumpa akoumpa marked this pull request as ready for review November 5, 2024 09:20
@akoumpa akoumpa added Run CICD and removed Run CICD labels Nov 5, 2024
@akoumpa akoumpa enabled auto-merge (squash) November 5, 2024 12:35
Copy link
Contributor

github-actions bot commented Nov 5, 2024

[🤖]: Hi @akoumpa 👋,

We wanted to let you know that a CICD pipeline for this PR just finished successfully

So it might be time to merge this PR or get some approvals

I'm just a bot so I'll leave it you what to do next.

//cc @pablo-garay @ko3n1g

@akoumpa akoumpa merged commit a294601 into main Nov 5, 2024
161 of 162 checks passed
@akoumpa akoumpa deleted the akoumparouli/nemo_ux_sgd_optim branch November 5, 2024 13:41
hainan-xv pushed a commit to hainan-xv/NeMo that referenced this pull request Nov 5, 2024
* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* add sgd

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove stale args

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove clip grad arg

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Pass optimizer as a run.Partial instead

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* move param extraction out of PytorchOptimizerModule

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Add ParamsT import

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Apply isort and black reformatting

Signed-off-by: akoumpa <[email protected]>

---------

Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: akoumpa <[email protected]>
Co-authored-by: akoumpa <[email protected]>
Signed-off-by: Hainan Xu <[email protected]>
lilyw97 pushed a commit to lilyw97/NeMo that referenced this pull request Nov 13, 2024
* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* add sgd

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove stale args

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove clip grad arg

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Pass optimizer as a run.Partial instead

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* move param extraction out of PytorchOptimizerModule

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Add ParamsT import

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Apply isort and black reformatting

Signed-off-by: akoumpa <[email protected]>

---------

Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: akoumpa <[email protected]>
Co-authored-by: akoumpa <[email protected]>
HuiyingLi pushed a commit to HuiyingLi/NeMo that referenced this pull request Nov 15, 2024
* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* add sgd

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove stale args

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove clip grad arg

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Pass optimizer as a run.Partial instead

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* move param extraction out of PytorchOptimizerModule

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Add ParamsT import

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Apply isort and black reformatting

Signed-off-by: akoumpa <[email protected]>

---------

Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: akoumpa <[email protected]>
Co-authored-by: akoumpa <[email protected]>
yashaswikarnati pushed a commit that referenced this pull request Nov 21, 2024
* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* add sgd

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove stale args

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove clip grad arg

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Pass optimizer as a run.Partial instead

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* move param extraction out of PytorchOptimizerModule

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Add ParamsT import

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Apply isort and black reformatting

Signed-off-by: akoumpa <[email protected]>

---------

Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: akoumpa <[email protected]>
Co-authored-by: akoumpa <[email protected]>
XuesongYang pushed a commit to paarthneekhara/NeMo that referenced this pull request Jan 18, 2025
* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* add sgd

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove stale args

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* remove clip grad arg

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Pass optimizer as a run.Partial instead

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* move param extraction out of PytorchOptimizerModule

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Add ParamsT import

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* fix

Signed-off-by: Alexandros Koumparoulis <[email protected]>

* Apply isort and black reformatting

Signed-off-by: akoumpa <[email protected]>

---------

Signed-off-by: Alexandros Koumparoulis <[email protected]>
Signed-off-by: akoumpa <[email protected]>
Co-authored-by: akoumpa <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants