Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Yuya/add checkpoints section #9329

Merged
merged 15 commits into from
Jul 17, 2024
Merged

Yuya/add checkpoints section #9329

merged 15 commits into from
Jul 17, 2024

Conversation

yaoyu-33
Copy link
Collaborator

@yaoyu-33 yaoyu-33 commented May 28, 2024 •
edited
Loading

What does this PR do ?

Add NeMo Dev docs to explain NeMo checkpoints, .nemo .ckpt, regular and distributed.

GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR.
To re-run CI remove and add the label again.
To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you add or update any necessary documentation?
  • Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • New Feature
  • Bugfix
  • Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

yaoyu-33 added 3 commits May 28, 2024 10:32
@yaoyu-33
Add checkpoints section
1f4780a 
Signed-off-by: yaoyu-33 <[email protected]>
@yaoyu-33
Fix title
a01c76f 
Signed-off-by: yaoyu-33 <[email protected]>
@yaoyu-33
update
8e7426b 
Signed-off-by: yaoyu-33 <[email protected]>
@github-actions GitHub Actions
Copy link
Contributor

This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or update or this will be closed in 7 days.

@github-actions github-actions bot added the stale label Jun 13, 2024
@yaoyu-33 yaoyu-33 removed the stale label Jun 13, 2024
@janekl janekl mentioned this pull request Jun 19, 2024
Merged
8 tasks
janekl and others added 4 commits June 27, 2024 09:32
@janekl
Add section on ".qnemo" checkpoints (#9503)
ae1c806 
* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>
@mikolajblaz
Distributed checkpointing user guide (#9494)
3003ec0 
* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>
@yaoyu-33
Merge branch 'main' into yuya/add_checkpoints_section
49bd6eb
@yaoyu-33
add subsection
bc366f2 
Signed-off-by: yaoyu-33 <[email protected]>
cuichenx
cuichenx reviewed Jul 12, 2024
View reviewed changes
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
yaoyu-33 and others added 2 commits July 15, 2024 18:16
@yaoyu-33 @cuichenx
Update docs/source/checkpoints/intro.rst
dbf10fb 
Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
@yaoyu-33
address comments
6303902 
Signed-off-by: yaoyu-33 <[email protected]>
@yaoyu-33 yaoyu-33 requested a review from erastorgueva-nv July 16, 2024 18:02
yaoyu-33 added 2 commits July 16, 2024 12:25
@yaoyu-33
fix
9c7ae09 
Signed-off-by: yaoyu-33 <[email protected]>
@yaoyu-33
fix code block
0cedd4c 
Signed-off-by: yaoyu-33 <[email protected]>
erastorgueva-nv
erastorgueva-nv previously approved these changes Jul 16, 2024
View reviewed changes
Copy link
Collaborator

@erastorgueva-nv erastorgueva-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, have suggested some small changes.

Extra note:

In user_guide.rst, maybe prepend all script paths with NeMo/scripts/checkpoint_converters ?

docs/source/index.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/intro.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Outdated Show resolved Hide resolved
docs/source/checkpoints/dist_ckpt.rst Show resolved Hide resolved
@yaoyu-33
address comments
673a7ea 
Signed-off-by: yaoyu-33 <[email protected]>
yaoyu-33 added 3 commits July 16, 2024 18:14
@yaoyu-33
formatting
ef7ae28 
Signed-off-by: yaoyu-33 <[email protected]>
@yaoyu-33
fix
06a2174 
Signed-off-by: yaoyu-33 <[email protected]>
@yaoyu-33
fix
5f811e3 
Signed-off-by: yaoyu-33 <[email protected]>
erastorgueva-nv
erastorgueva-nv approved these changes Jul 17, 2024
View reviewed changes
Copy link
Collaborator

@erastorgueva-nv erastorgueva-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM now, thank you

@ericharper ericharper merged commit 9c138a4 into main Jul 17, 2024
11 of 12 checks passed
@ericharper ericharper deleted the yuya/add_checkpoints_section branch July 17, 2024 23:54
ertkonuk pushed a commit that referenced this pull request Jul 19, 2024
@yaoyu-33 @janekl
@mikolajblaz @cuichenx @ertkonuk
Yuya/add checkpoints section (#9329)
65550c4 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Tugrul Konuk <[email protected]>
tonyjie pushed a commit to tonyjie/NeMo that referenced this pull request Jul 24, 2024
@yaoyu-33 @janekl
@mikolajblaz @cuichenx @tonyjie
Yuya/add checkpoints section (NVIDIA#9329)
8014d35 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (NVIDIA#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (NVIDIA#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
akoumpa pushed a commit that referenced this pull request Jul 25, 2024
@yaoyu-33 @janekl
@mikolajblaz @cuichenx @akoumpa
Yuya/add checkpoints section (#9329)
da45206 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Alexandros Koumparoulis <[email protected]>
malay-nagda pushed a commit to malay-nagda/NeMo that referenced this pull request Jul 26, 2024
@yaoyu-33 @janekl
@mikolajblaz @cuichenx
Yuya/add checkpoints section (NVIDIA#9329)
c06e0ae 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (NVIDIA#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (NVIDIA#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Malay Nagda <[email protected]>
monica-sekoyan pushed a commit that referenced this pull request Oct 14, 2024
@yaoyu-33 @janekl
@mikolajblaz @cuichenx @monica-sekoyan
Yuya/add checkpoints section (#9329)
51090bb 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
hainan-xv pushed a commit to hainan-xv/NeMo that referenced this pull request Nov 5, 2024
@yaoyu-33 @janekl
@mikolajblaz @cuichenx
Yuya/add checkpoints section (NVIDIA#9329)
60b62f6 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (NVIDIA#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (NVIDIA#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Hainan Xu <[email protected]>
XuesongYang pushed a commit to paarthneekhara/NeMo that referenced this pull request Jan 18, 2025
@yaoyu-33 @janekl
@mikolajblaz @cuichenx @XuesongYang
Yuya/add checkpoints section (NVIDIA#9329)
09dc07b 
* Add checkpoints section

Signed-off-by: yaoyu-33 <[email protected]>

* Fix title

Signed-off-by: yaoyu-33 <[email protected]>

* update

Signed-off-by: yaoyu-33 <[email protected]>

* Add section on ".qnemo" checkpoints (NVIDIA#9503)

* Add 'Quantized Checkpoints' section

Signed-off-by: Jan Lasek <[email protected]>

* Address review comments

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>

* Distributed checkpointing user guide (NVIDIA#9494)

* Describe shardings and entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Strategies, optimizers, finalize entrypoints

Signed-off-by: Mikołaj Błaż <[email protected]>

* Transformations

Signed-off-by: Mikołaj Błaż <[email protected]>

* Integration

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add link from intro

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply grammar suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Explain the example

Signed-off-by: Mikołaj Błaż <[email protected]>

* Apply review suggestions

Signed-off-by: Mikołaj Błaż <[email protected]>

* Add zarr and torch_dist explanation

---------

Signed-off-by: Mikołaj Błaż <[email protected]>

* add subsection

Signed-off-by: yaoyu-33 <[email protected]>

* Update docs/source/checkpoints/intro.rst

Co-authored-by: Chen Cui <[email protected]>
Signed-off-by: Yu Yao <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix code block

Signed-off-by: yaoyu-33 <[email protected]>

* address comments

Signed-off-by: yaoyu-33 <[email protected]>

* formatting

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

* fix

Signed-off-by: yaoyu-33 <[email protected]>

---------

Signed-off-by: yaoyu-33 <[email protected]>
Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Mikołaj Błaż <[email protected]>
Signed-off-by: Yu Yao <[email protected]>
Co-authored-by: Jan Lasek <[email protected]>
Co-authored-by: mikolajblaz <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cuichenx cuichenx cuichenx left review comments

@erastorgueva-nv erastorgueva-nv erastorgueva-nv approved these changes

Assignees
No one assigned
Labels
Run CICD
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@yaoyu-33 @cuichenx @erastorgueva-nv @ericharper @janekl @mikolajblaz