Code

[ckpt-rewr] Save state dict API#3372

Code

Merged

eracah merged 48 commits intomosaicml:devmosaicml/composer:devfrom eracah:sv-sderacah/evan-composer:sv-sdCopy head branch name to clipboardJun 17, 2024

+377-101

Commits

Commits on Jun 4, 2024

• add stubs

  eracah

  committed
  b7915b9

Commits on Jun 5, 2024

• save progress

  eracah

  committed
  5700fd4

Commits on Jun 6, 2024

• Merge branch 'dev' of https://github.com/mosaicml/composer into sv-sd

  eracah

  committed
  cfa11d4

• add full state dict saving and testing

  eracah

  committed
  eabb9a3

• Merge branch 'dev' into sv-sd

  eracah

  authored
  37cfed3

• Merge branch 'dev' of https://github.com/mosaicml/composer into sv-sd

  eracah

  committed
  0c503dc

• Merge branch 'sv-sd' of https://github.com/eracah/evan-composer into sv-sd

  eracah

  committed
  13d7e0c

• add stubs

  eracah

  committed
  316504e

• implement sharded save and get tests to pass

  eracah

  committed
  00a7ce2

• Merge branch 'dev' into sv-sd

  eracah

  authored
  0fd0d53

• add cpu sharded test

  eracah

  committed
  3a6c185

• Merge branch 'sv-sd' of https://github.com/eracah/evan-composer into sv-sd

  eracah

  committed
  9b79b30

Commits on Jun 7, 2024

• pre-commit

  eracah

  committed
  56f9339

• remove comment

  eracah

  committed
  03dbb6a

• Merge branch 'dev' into sv-sd

  eracah

  authored
  7efdc74

• remove __init__

  eracah

  committed
  e437fa7

• rm init

  eracah

  committed
  b518cde

• Merge branch 'sv-sd' of https://github.com/eracah/evan-composer into sv-sd

  eracah

  committed
  e9bb7ef

• fix

  eracah

  committed
  5156572

• remove torchmetrics

  eracah

  committed
  4f516dc

• Merge branch 'sv-sd' of https://github.com/eracah/evan-composer into sv-sd

  eracah

  committed
  66c84b8

Commits on Jun 10, 2024

• Update composer/checkpoint/save.py

  Show description for 8c076b9
  

  eracah

  and

  mvpatel2000

  authored
  8c076b9

• Update composer/checkpoint/save.py

  Show description for dba8cdc
  

  eracah

  and

  mvpatel2000

  authored
  dba8cdc

• Update composer/checkpoint/save.py

  Show description for dc35df0
  

  eracah

  and

  mvpatel2000

  authored
  dc35df0

• Update composer/checkpoint/save.py

  Show description for dc5cf9f
  

  eracah

  and

  mvpatel2000

  authored
  dc5cf9f

• Merge branch 'dev' into sv-sd

  eracah

  authored
  6c67f93

• fix docstring

  eracah

  committed
  892536d

• remove time.sleep

  eracah

  committed
  fcd1789

Commits on Jun 11, 2024

• fix cpu tests

  eracah

  committed
  1b47500

• pre-commit

  eracah

  committed
  46e4bec

• fix cpu test

  eracah

  committed
  c4a97ce

• remove cpu tests :(

  eracah

  committed
  05b9903

• Merge branch 'dev' into sv-sd

  eracah

  authored
  44b123f

• pre-commit

  eracah

  committed
  3874e58

• pc

  eracah

  committed
  037548a

Commits on Jun 12, 2024

• add all check

  eracah

  committed
  8324589

• pre-commit

  eracah

  committed
  ae3911d

• add world_size = 1 test

  eracah

  committed
  3e6e60b

• Merge branch 'sv-sd' of https://github.com/eracah/evan-composer into sv-sd

  eracah

  committed
  c865023

• pre-commit

  eracah

  committed
  bd885a6

• pc

  eracah

  committed
  064d0ba

• Merge branch 'dev' into sv-sd

  eracah

  authored
  aa05ce5

Commits on Jun 17, 2024

• Merge branch 'dev' into sv-sd

  eracah

  authored
  c4ef047

• Merge branch 'dev' into sv-sd

  eracah

  authored
  fbb80e5

• Update composer/checkpoint/save.py

  Show description for 8ae5a52
  

  eracah

  and

  mvpatel2000

  authored
  8ae5a52

• Update composer/checkpoint/save.py

  Show description for 2efeb9a
  

  eracah

  and

  mvpatel2000

  authored
  2efeb9a

• fix is_sharded

  eracah

  committed
  92ffa59

• Merge branch 'sv-sd' of https://github.com/eracah/evan-composer into sv-sd

  eracah

  committed
  42f56b9