Code

tied weights for adapters#6928

Code

Merged

aklife97 merged 40 commits intomainNVIDIA/NeMo:mainfrom adithyare/tied_loraNVIDIA/NeMo:adithyare/tied_loraCopy head branch name to clipboardAug 18, 2023

+369-15

Commits

Commits on Jun 24, 2023

• wip

  Show description for 78366ff
  arendu

  committed
  78366ff

  Copy full SHA for 78366ff

Commits on Jun 27, 2023

• wip

  Show description for 02e824a
  arendu

  committed
  02e824a

  Copy full SHA for 02e824a

• tied lora weights

  Show description for 67f35ce
  arendu

  committed
  67f35ce

  Copy full SHA for 67f35ce

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for eebe3da
  pre-commit-ci[bot]

  committed
  eebe3da

  Copy full SHA for eebe3da

Commits on Jun 30, 2023

• lora and adapter tying

  Show description for fef1763
  arendu

  committed
  fef1763

  Copy full SHA for fef1763

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 7676dc9
  pre-commit-ci[bot]

  committed
  7676dc9

  Copy full SHA for 7676dc9

• Merge branch 'main' into adithyare/tied_lora

  arendu

  committed
  b38de10

  Copy full SHA for b38de10

• Merge branch 'adithyare/tied_lora' of https://github.com/NVIDIA/NeMo into adithyare/tied_lora

  arendu

  committed
  5adebba

  Copy full SHA for 5adebba

• layer selection wip

  Show description for db949f3
  arendu

  committed
  db949f3

  Copy full SHA for db949f3

• Merge branch 'adithyare/tied_lora' of https://github.com/NVIDIA/NeMo into adithyare/tied_lora

  arendu

  committed
  e4cd1dc

  Copy full SHA for e4cd1dc

• added layer selection

  Show description for 356ec63
  arendu

  committed
  356ec63

  Copy full SHA for 356ec63

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 96c936b
  pre-commit-ci[bot]

  committed
  96c936b

  Copy full SHA for 96c936b

• make ln optional

  Show description for f2c0017
  arendu

  committed
  f2c0017

  Copy full SHA for f2c0017

• Merge branch 'adithyare/tied_lora' of https://github.com/NVIDIA/NeMo into adithyare/tied_lora

  arendu

  committed
  81d081f

  Copy full SHA for 81d081f

Commits on Jul 1, 2023

• layer section

  Show description for 1188a16
  arendu

  committed
  1188a16

  Copy full SHA for 1188a16

• small dim pos emb

  Show description for f5dcf33
  arendu

  committed
  f5dcf33

  Copy full SHA for f5dcf33

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for ab1e295
  pre-commit-ci[bot]

  committed
  ab1e295

  Copy full SHA for ab1e295

Commits on Jul 7, 2023

• adapter w/o layer norm and weight tying

  Show description for 7430d3e
  arendu

  committed
  7430d3e

  Copy full SHA for 7430d3e

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for fc8278c
  pre-commit-ci[bot]

  committed
  fc8278c

  Copy full SHA for fc8278c

Commits on Jul 10, 2023

• eval works with all pos embeddings strategy

  Show description for 620aabd
  arendu

  committed
  620aabd

  Copy full SHA for 620aabd

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 889d475
  pre-commit-ci[bot]

  committed
  889d475

  Copy full SHA for 889d475

• update

  Show description for 18e2f37
  arendu

  committed
  18e2f37

  Copy full SHA for 18e2f37

• Merge branch 'adithyare/tied_lora' of https://github.com/NVIDIA/NeMo into adithyare/tied_lora

  arendu

  committed
  123f89c

  Copy full SHA for 123f89c

Commits on Jul 27, 2023

• mlp transform of pos embeddings

  Show description for 8c18bc4
  arendu

  committed
  8c18bc4

  Copy full SHA for 8c18bc4

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for be78026
  pre-commit-ci[bot]

  committed
  be78026

  Copy full SHA for be78026

Commits on Jul 28, 2023

• zero init position bias

  Show description for 368312a
  arendu

  committed
  368312a

  Copy full SHA for 368312a

• merged

  Show description for 2d95ff1
  arendu

  committed
  2d95ff1

  Copy full SHA for 2d95ff1

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 202ca1d
  pre-commit-ci[bot]

  committed
  202ca1d

  Copy full SHA for 202ca1d

Commits on Aug 1, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  committed
  dd0c9ee

  Copy full SHA for dd0c9ee

Commits on Aug 2, 2023

• Merge branch 'adithyare/tied_lora' of https://github.com/NVIDIA/NeMo into adithyare/tied_lora

  arendu

  committed
  82e3a1d

  Copy full SHA for 82e3a1d

• merge

  Show description for bea09bb
  arendu

  committed
  bea09bb

  Copy full SHA for bea09bb

Commits on Aug 3, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  committed
  e0977c9

  Copy full SHA for e0977c9

Commits on Aug 6, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  committed
  0d60d72

  Copy full SHA for 0d60d72

Commits on Aug 7, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  committed
  86812b5

  Copy full SHA for 86812b5

Commits on Aug 15, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  authored
  df26ad7

  Copy full SHA for df26ad7

Commits on Aug 16, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  authored
  dcc5817

  Copy full SHA for dcc5817

• Merge branch 'main' into adithyare/tied_lora

  arendu

  authored
  6fc7722

  Copy full SHA for 6fc7722

• minor fix

  Show description for 90aa911
  arendu

  committed
  90aa911

  Copy full SHA for 90aa911

Commits on Aug 17, 2023

• Merge branch 'main' into adithyare/tied_lora

  arendu

  authored
  631d520

  Copy full SHA for 631d520

• Merge branch 'main' into adithyare/tied_lora

  arendu

  authored
  87bd338

  Copy full SHA for 87bd338