Code

SPLIT PR: eos bos tokens#31316

Code

Open

itazap wants to merge 31 commits intomainhuggingface/transformers:mainfrom bos_eos_token_fixhuggingface/transformers:bos_eos_token_fixCopy head branch name to clipboard

+96

Commits

Commits on Sep 1, 2024

• add missing import

  itazap

  committed
  200c1cc

  Copy full SHA for 200c1cc

• add condition for update

  itazap

  committed
  d77e5ea

  Copy full SHA for d77e5ea

• skip if post_processor is not type Sequence (do not support TemplateProcessor)

  itazap

  committed
  a76d2b7

  Copy full SHA for a76d2b7

• rebased missed

  itazap

  committed
  154979c

  Copy full SHA for 154979c

• clean after rebase

  itazap

  committed
  cca19dd

  Copy full SHA for cca19dd

• CI make copies issue fix?

  itazap

  committed
  2dbb00c

  Copy full SHA for 2dbb00c

• Adding bos eos test

  itazap

  committed
  c490db2

  Copy full SHA for c490db2

• undo pegasus change

  itazap

  committed
  0a15060

  Copy full SHA for 0a15060

• undo pegasus change

  itazap

  committed
  46d1153

  Copy full SHA for 46d1153

• clean up spaces for pr

  itazap

  committed
  39d92e7

  Copy full SHA for 39d92e7

• clean up for PR

  itazap

  committed
  ef0bd27

  Copy full SHA for ef0bd27

• rebase

  itazap

  committed
  e8bfe90

  Copy full SHA for e8bfe90

• cleaning after rebase

  itazap

  committed
  f80a9fd

  Copy full SHA for f80a9fd

• add conidition for updating post processor

  itazap

  committed
  dbacd66

  Copy full SHA for dbacd66

• revert comment

  itazap

  committed
  c7a84ff

  Copy full SHA for c7a84ff

• make test asserts consistent

  itazap

  committed
  92b52ce

  Copy full SHA for 92b52ce

• update with warning

  itazap

  committed
  832ecb5

  Copy full SHA for 832ecb5

• update test

  itazap

  committed
  0d8e00e

  Copy full SHA for 0d8e00e

• logger.warn

  itazap

  committed
  040e2fe

  Copy full SHA for 040e2fe

• autodoc for bos/eos token

  itazap

  committed
  04608b0

  Copy full SHA for 04608b0

• update docstring as per feedback

  itazap

  committed
  2df45da

  Copy full SHA for 2df45da

• Trigger CI attempt

  itazap

  committed
  89fde69

  Copy full SHA for 89fde69

Commits on Sep 2, 2024

• missed rebase commit

  itazap

  committed
  6102d5d

  Copy full SHA for 6102d5d

Commits on Sep 8, 2024

• use internal repo for tesT

  itazap

  committed
  40a05d0

  Copy full SHA for 40a05d0

• use internal repo for test

  itazap

  committed
  b957658

  Copy full SHA for b957658

Commits on Sep 9, 2024

• use internal repo for test

  itazap

  committed
  6312dd3

  Copy full SHA for 6312dd3

• Merge branch 'main' into bos_eos_token_fix

  itazap

  authored
  aad810d

  Copy full SHA for aad810d

• ruff

  itazap

  committed
  0d3085d

  Copy full SHA for 0d3085d

Commits on Sep 13, 2024

• test reload saved

  itazap

  committed
  1fb5b16

  Copy full SHA for 1fb5b16

Commits on Sep 14, 2024

• test reload saved

  itazap

  committed
  a1e024e

  Copy full SHA for a1e024e

Commits on Sep 30, 2024

• Merge branch 'main' into bos_eos_token_fix

  itazap

  authored
  02e75eb

  Copy full SHA for 02e75eb