Code

[NeMo-UX] Add PEFT#9490

Code

Merged

sararb merged 48 commits intomainNVIDIA/NeMo:mainfrom nemo-ux/peftNVIDIA/NeMo:nemo-ux/peftCopy head branch name to clipboardJul 5, 2024

+1,434-186

Commits

Commits on Jul 4, 2024

• initial commit for PEFT in nemo2

  

  cuichenx

  authored and

  marcromeyn

  committed
  a140dcf

  Copy full SHA for a140dcf

• Apply isort and black reformatting

  Show description for a62fd06
  

  cuichenx

  authored and

  marcromeyn

  committed
  a62fd06

  Copy full SHA for a62fd06

• address comments

  Show description for 76b23be
  

  cuichenx

  authored and

  marcromeyn

  committed
  76b23be

  Copy full SHA for 76b23be

• make import easier

  Show description for c87896b
  

  cuichenx

  authored and

  marcromeyn

  committed
  c87896b

  Copy full SHA for c87896b

• Apply isort and black reformatting

  Show description for e356a1f
  

  cuichenx

  authored and

  marcromeyn

  committed
  e356a1f

  Copy full SHA for e356a1f

• address comments

  Show description for 0d649de
  

  cuichenx

  authored and

  marcromeyn

  committed
  0d649de

  Copy full SHA for 0d649de

• Update nemo/collections/llm/peft/lora.py

  Show description for 6b98061
  marcromeyn

  committed
  6b98061

  Copy full SHA for 6b98061

• Some small fixes + adding more doc-strings

  marcromeyn

  committed
  76f3a48

  Copy full SHA for 76f3a48

• Apply isort and black reformatting

  Show description for 1b92d15
  marcromeyn

  committed
  1b92d15

  Copy full SHA for 1b92d15

• Adding ModelTransform callback

  marcromeyn

  committed
  21dc1c5

  Copy full SHA for 21dc1c5

• Apply isort and black reformatting

  Show description for 6666535
  marcromeyn

  committed
  6666535

  Copy full SHA for 6666535

• Fixing type-hint for model_transform

  marcromeyn

  committed
  38cb190

  Copy full SHA for 38cb190

• Apply isort and black reformatting

  Show description for 3d8351f
  marcromeyn

  committed
  3d8351f

  Copy full SHA for 3d8351f

• fix import

  Show description for 741c998
  

  cuichenx

  authored and

  marcromeyn

  committed
  741c998

  Copy full SHA for 741c998

• model transform for gemma llama

  Show description for ac4eec1
  

  cuichenx

  authored and

  marcromeyn

  committed
  ac4eec1

  Copy full SHA for ac4eec1

• Apply isort and black reformatting

  Show description for eadf9fe
  

  cuichenx

  authored and

  marcromeyn

  committed
  eadf9fe

  Copy full SHA for eadf9fe

• fix model transform

  Show description for 3228035
  

  cuichenx

  authored and

  marcromeyn

  committed
  3228035

  Copy full SHA for 3228035

• Apply isort and black reformatting

  Show description for 21a2b10
  

  cuichenx

  authored and

  marcromeyn

  committed
  21a2b10

  Copy full SHA for 21a2b10

• change lora target default to all linear modules

  Show description for 85bfad6
  

  cuichenx

  authored and

  marcromeyn

  committed
  85bfad6

  Copy full SHA for 85bfad6

• Apply isort and black reformatting

  Show description for b64789b
  

  cuichenx

  authored and

  marcromeyn

  committed
  b64789b

  Copy full SHA for b64789b

• Small fix in mixtral

  marcromeyn

  committed
  077469e

  Copy full SHA for 077469e

• Apply isort and black reformatting

  Show description for 7cd790a
  marcromeyn

  committed
  7cd790a

  Copy full SHA for 7cd790a

• Integrating PEFT to the public-API + some fixes

  marcromeyn

  committed
  e083e3c

  Copy full SHA for e083e3c

• Big refactor to allow to load adapter-states

  marcromeyn

  committed
  3df37df

  Copy full SHA for 3df37df

• Some fixes to support adapter_path

  marcromeyn

  committed
  ef76686

  Copy full SHA for ef76686

• Apply isort and black reformatting

  Show description for 908feed
  marcromeyn

  committed
  908feed

  Copy full SHA for 908feed

• Disabling ckpt reloading when adapter_path is passed

  marcromeyn

  committed
  6c7be3d

  Copy full SHA for 6c7be3d

• Fix CLI

  marcromeyn

  committed
  f14a3c5

  Copy full SHA for f14a3c5

• Apply isort and black reformatting

  Show description for cdabd75
  marcromeyn

  committed
  cdabd75

  Copy full SHA for cdabd75

• Remove commented-out code

  marcromeyn

  committed
  08fb761

  Copy full SHA for 08fb761

• Remove commented-out code

  marcromeyn

  committed
  7d96473

  Copy full SHA for 7d96473

• Remove un-used import

  marcromeyn

  committed
  454c23f

  Copy full SHA for 454c23f

• Fix callback imports

  marcromeyn

  committed
  0e43371

  Copy full SHA for 0e43371

• Apply isort and black reformatting

  Show description for aa711bd
  marcromeyn

  committed
  aa711bd

  Copy full SHA for aa711bd

• Fixing llm.pretrain

  marcromeyn

  committed
  baca872

  Copy full SHA for baca872

• Some small fixes

  marcromeyn

  committed
  2d12a84

  Copy full SHA for 2d12a84

• Apply isort and black reformatting

  Show description for 553b3f3
  marcromeyn

  committed
  553b3f3

  Copy full SHA for 553b3f3

• Fix missing import + type-hint in finetune

  marcromeyn

  committed
  45690f3

  Copy full SHA for 45690f3

• Adding PreemptionCallback + some more tests

  marcromeyn

  committed
  835cdd3

  Copy full SHA for 835cdd3

• Apply isort and black reformatting

  Show description for e4d809e
  marcromeyn

  committed
  e4d809e

  Copy full SHA for e4d809e

• Clean up imports & clean up llm.api

  marcromeyn

  committed
  30b967b

  Copy full SHA for 30b967b

• Apply isort and black reformatting

  Show description for 2617a15
  marcromeyn

  committed
  2617a15

  Copy full SHA for 2617a15

• Trying to fix failing tests

  marcromeyn

  committed
  2e9857e

  Copy full SHA for 2e9857e

• Merge branch 'main' into nemo-ux/peft

  marcromeyn

  authored
  c80e7b7

  Copy full SHA for c80e7b7

• Remove __init__.py 2

  marcromeyn

  committed
  d541a47

  Copy full SHA for d541a47

• Apply isort and black reformatting

  Show description for 7a153d3
  marcromeyn

  committed
  7a153d3

  Copy full SHA for 7a153d3

• Fix failing test

  marcromeyn

  committed
  37b5b73

  Copy full SHA for 37b5b73

• Trying to fix last failing test

  marcromeyn

  committed
  eb72dad

  Copy full SHA for eb72dad