Code

feat: add cut_cross_entropy#2091

Code

Merged

winglian merged 33 commits intomainaxolotl-ai-cloud/axolotl:mainfrom feat/cceaxolotl-ai-cloud/axolotl:feat/cceCopy head branch name to clipboardDec 3, 2024

+705-15

Commits

Commits on Dec 3, 2024

• feat: add cut_cross_entropy

  

  NanoCode012

  authored and

  winglian

  committed
  f0b6d08

  Copy full SHA for f0b6d08

• fix: add to input

  

  NanoCode012

  authored and

  winglian

  committed
  b83ef26

  Copy full SHA for b83ef26

• fix: remove from setup.py

  

  NanoCode012

  authored and

  winglian

  committed
  d264ff0

  Copy full SHA for d264ff0

• feat: refactor into an integration

  

  NanoCode012

  authored and

  winglian

  committed
  e5ff3d4

  Copy full SHA for e5ff3d4

• chore: ignore lint

  

  NanoCode012

  authored and

  winglian

  committed
  757ec2f

  Copy full SHA for 757ec2f

• feat: add test for cce

  

  NanoCode012

  authored and

  winglian

  committed
  36cfb4d

  Copy full SHA for 36cfb4d

• fix: set max_steps for liger test

  

  NanoCode012

  authored and

  winglian

  committed
  b02d036

  Copy full SHA for b02d036

• chore: Update base model following suggestion

  Show description for a060782
  

  NanoCode012

  and

  winglian

  committed
  a060782

  Copy full SHA for a060782

• chore: update special_tokens following suggestion

  Show description for 7fa0542
  

  NanoCode012

  and

  winglian

  committed
  7fa0542

  Copy full SHA for 7fa0542

• chore: remove with_temp_dir following comments

  

  NanoCode012

  authored and

  winglian

  committed
  642adfd

  Copy full SHA for 642adfd

• fix: plugins aren't loaded

  

  NanoCode012

  authored and

  winglian

  committed
  838cb0d

  Copy full SHA for 838cb0d

• chore: update quotes in error message

  

  NanoCode012

  authored and

  winglian

  committed
  adb5209

  Copy full SHA for adb5209

• chore: lint

  

  NanoCode012

  authored and

  winglian

  committed
  646414c

  Copy full SHA for 646414c

• chore: lint

  

  NanoCode012

  authored and

  winglian

  committed
  73e2927

  Copy full SHA for 73e2927

• feat: enable FA on test

  

  NanoCode012

  authored and

  winglian

  committed
  2772384

  Copy full SHA for 2772384

• chore: refactor get_pytorch_version

  

  NanoCode012

  authored and

  winglian

  committed
  ef4854d

  Copy full SHA for ef4854d

• fix: lock cce commit version

  

  NanoCode012

  authored and

  winglian

  committed
  a6b62f7

  Copy full SHA for a6b62f7

• fix: remove subclassing UT

  

  NanoCode012

  authored and

  winglian

  committed
  f8a770f

  Copy full SHA for f8a770f

• fix: downcast even if not using FA and config check

  

  NanoCode012

  authored and

  winglian

  committed
  9bee8db

  Copy full SHA for 9bee8db

• feat: add test to check different attentions

  

  NanoCode012

  authored and

  winglian

  committed
  b7d93ce

  Copy full SHA for b7d93ce

• feat: add install to CI

  

  NanoCode012

  authored and

  winglian

  committed
  93a0f1a

  Copy full SHA for 93a0f1a

• chore: refactor to use parametrize for attention

  

  NanoCode012

  authored and

  winglian

  committed
  9c11d1e

  Copy full SHA for 9c11d1e

• fix: pytest not detecting test

  

  NanoCode012

  authored and

  winglian

  committed
  a593d34

  Copy full SHA for a593d34

• feat: handle torch lower than 2.4

  

  NanoCode012

  authored and

  winglian

  committed
  73905a2

  Copy full SHA for 73905a2

• fix args/kwargs to match docs

  winglian

  committed
  feb8cea

  Copy full SHA for feb8cea

• use release version cut-cross-entropy==24.11.4

  winglian

  committed
  7a3cbf8

  Copy full SHA for 7a3cbf8

• fix quotes

  winglian

  committed
  9da9702

  Copy full SHA for 9da9702

• fix: use named params for clarity for modal builder

  

  NanoCode012

  authored and

  winglian

  committed
  1b819e3

  Copy full SHA for 1b819e3

• fix: handle install from pip

  

  NanoCode012

  authored and

  winglian

  committed
  d6521d6

  Copy full SHA for d6521d6

• fix: test check only top level module install

  

  NanoCode012

  authored and

  winglian

  committed
  364c774

  Copy full SHA for 364c774

• fix: re-add import check

  

  NanoCode012

  authored and

  winglian

  committed
  4c468d8

  Copy full SHA for 4c468d8

• uninstall existing version if no transformers submodule in cce

  winglian

  committed
  a3aad7a

  Copy full SHA for a3aad7a

• more dataset fixtures into the cache

  winglian

  committed
  af5dc73

  Copy full SHA for af5dc73