Code

Draft+ for SDXL [draft]#222

Code

Merged

terrykong merged 37 commits intoNVIDIA:mainNVIDIA/NeMo-Aligner:mainfrom rohitrango:sdxl_draftrohitrango/NeMo-Aligner:sdxl_draftCopy head branch name to clipboardJul 12, 2024

+1,047-7

Commits

Commits on Jul 8, 2024

• leftover commit

  Show description for bf062de
  

  Rohit Jena

  authored and

  rohitrango

  committed
  bf062de

  Copy full SHA for bf062de

• leftover commit

  Show description for 996f0d1
  

  Rohit Jena

  authored and

  rohitrango

  committed
  996f0d1

  Copy full SHA for 996f0d1

• commits

  Show description for a278ff5
  

  Rohit Jena

  authored and

  rohitrango

  committed
  a278ff5

  Copy full SHA for a278ff5

• update gitignore

  Show description for f7ebd21
  

  Rohit Jena

  authored and

  rohitrango

  committed
  f7ebd21

  Copy full SHA for f7ebd21

• init model for SDXL

  Show description for 6203ea7
  

  Rohit Jena

  authored and

  rohitrango

  committed
  6203ea7

  Copy full SHA for 6203ea7

• correct path in eos script

  Show description for 1a232d7
  

  Rohit Jena

  authored and

  rohitrango

  committed
  1a232d7

  Copy full SHA for 1a232d7

• modified generate and log_generate scripts to use diffusion engine

  Show description for 9d6bc85
  

  Rohit Jena

  authored and

  rohitrango

  committed
  9d6bc85

  Copy full SHA for 9d6bc85

• fixed most runtime bugs -- check for logical bugs

  Show description for d0af4f8
  

  Rohit Jena

  authored and

  rohitrango

  committed
  d0af4f8

  Copy full SHA for d0af4f8

• examining mapping between hf and nemo

  Show description for ecc30f0
  

  Rohit Jena

  authored and

  rohitrango

  committed
  ecc30f0

  Copy full SHA for ecc30f0

• writing converter script for unet

  Show description for 125e61b
  

  Rohit Jena

  authored and

  rohitrango

  committed
  125e61b

  Copy full SHA for 125e61b

• tmp commit (moving to eos)

  Show description for bc1617c
  

  Rohit Jena

  authored and

  rohitrango

  committed
  bc1617c

  Copy full SHA for bc1617c

• more changes to draftp xl

  Show description for 2b46f92
  

  Rohit Jena

  authored and

  rohitrango

  committed
  2b46f92

  Copy full SHA for 2b46f92

• changed batch scripts

  Show description for 047df83
  

  Rohit Jena

  authored and

  rohitrango

  committed
  047df83

  Copy full SHA for 047df83

• changed launch scripts

  Show description for 8376132
  

  Rohit Jena

  authored and

  rohitrango

  committed
  8376132

  Copy full SHA for 8376132

• check adapter control

  Show description for d69566c
  

  Rohit Jena

  authored and

  rohitrango

  committed
  d69566c

  Copy full SHA for d69566c

• clean up lora hotswap debugging

  Show description for 149e58e
  

  Rohit Jena

  authored and

  rohitrango

  committed
  149e58e

  Copy full SHA for 149e58e

• adding fsdp to draftp training

  Show description for 8c7cf40
  

  Rohit Jena

  authored and

  rohitrango

  committed
  8c7cf40

  Copy full SHA for 8c7cf40

• FSDP now works for SDXL?!

  Show description for e56c20f
  

  Rohit Jena

  authored and

  rohitrango

  committed
  e56c20f

  Copy full SHA for e56c20f

• added custom rule to enable sharding of decoder

  Show description for d5407a7
  

  Rohit Jena

  authored and

  rohitrango

  committed
  d5407a7

  Copy full SHA for d5407a7

• also shard the clip embeddings

  Show description for bbb36ea
  

  Rohit Jena

  authored and

  rohitrango

  committed
  bbb36ea

  Copy full SHA for bbb36ea

• multinode script created + testing 2048 config

  Show description for 9cb21a7
  

  Rohit Jena

  authored and

  rohitrango

  committed
  9cb21a7

  Copy full SHA for 9cb21a7

• add activation checkpointing

  Show description for 1efb73b
  

  Rohit Jena

  authored and

  rohitrango

  committed
  1efb73b

  Copy full SHA for 1efb73b

• added activation checkpointing

  Show description for 69faaf3
  

  Rohit Jena

  authored and

  rohitrango

  committed
  69faaf3

  Copy full SHA for 69faaf3

• added SFT and PEFT support with Draft+

  Show description for fa018e3
  

  Rohit Jena

  authored and

  rohitrango

  committed
  fa018e3

  Copy full SHA for fa018e3

• corrected init denoise bug

  Show description for 7ca876f
  

  Rohit Jena

  authored and

  rohitrango

  committed
  7ca876f

  Copy full SHA for 7ca876f

• added multinode setup script - test it

  Show description for 3b7ff3d
  

  Rohit Jena

  authored and

  rohitrango

  committed
  3b7ff3d

  Copy full SHA for 3b7ff3d

• enable sharding for sdlora

  Show description for 5ae5cca
  

  Rohit Jena

  authored and

  rohitrango

  committed
  5ae5cca

  Copy full SHA for 5ae5cca

• added multinode script for OCI

  Show description for b226823
  

  Rohit Jena

  authored and

  rohitrango

  committed
  b226823

  Copy full SHA for b226823

• some more refactoring

  Show description for 58cbbfb
  

  Rohit Jena

  authored and

  rohitrango

  committed
  58cbbfb

  Copy full SHA for 58cbbfb

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 61118c2
  

  pre-commit-ci[bot]

  authored and

  rohitrango

  committed
  61118c2

  Copy full SHA for 61118c2

• address Terry's comments

  Show description for d67bb14
  

  Rohit Jena

  authored and

  rohitrango

  committed
  d67bb14

  Copy full SHA for d67bb14

• remove + 0 to clone

  Show description for 47d7e21
  

  Rohit Jena

  authored and

  rohitrango

  committed
  47d7e21

  Copy full SHA for 47d7e21

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 3d626d7
  

  pre-commit-ci[bot]

  authored and

  rohitrango

  committed
  3d626d7

  Copy full SHA for 3d626d7

• add version guard

  Show description for c9692ca
  

  Rohit Jena

  authored and

  rohitrango

  committed
  c9692ca

  Copy full SHA for c9692ca

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 6945884
  

  pre-commit-ci[bot]

  authored and

  rohitrango

  committed
  6945884

  Copy full SHA for 6945884

• added todo to merge these APIs later

  Show description for e87c824
  

  Rohit Jena

  authored and

  rohitrango

  committed
  e87c824

  Copy full SHA for e87c824

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 866df67
  

  pre-commit-ci[bot]

  authored and

  rohitrango

  committed
  866df67

  Copy full SHA for 866df67