Code

Add Zamba#30950

Code

Merged

ArthurZucker merged 115 commits intohuggingface:mainhuggingface/transformers:mainfrom Zyphra:mainZyphra/transformers_zamba:mainCopy head branch name to clipboardOct 4, 2024

+2,939-2

Commits

Commits on Aug 24, 2024

• Update index.md

  pglorio

  committed
  7eff1cc

  Copy full SHA for 7eff1cc

• Rebase

  pglorio

  committed
  14961a2

  Copy full SHA for 14961a2

• Rebase

  pglorio

  committed
  b67ff24

  Copy full SHA for b67ff24

• Updates from make fixup

  pglorio

  committed
  0aa1003

  Copy full SHA for 0aa1003

• Update zamba.md

  pglorio

  committed
  5e88653

  Copy full SHA for 5e88653

• Batched inference

  pglorio

  committed
  123d959

  Copy full SHA for 123d959

• Update

  pglorio

  committed
  f35bdf9

  Copy full SHA for f35bdf9

• Fix tests

  

  root

  authored and

  pglorio

  committed
  1ec90d1

  Copy full SHA for 1ec90d1

• Fix tests

  pglorio

  committed
  4d3f8c0

  Copy full SHA for 4d3f8c0

• Fix tests

  pglorio

  committed
  e51113d

  Copy full SHA for e51113d

• Fix tests

  pglorio

  committed
  cf6ee16

  Copy full SHA for cf6ee16

Commits on Sep 6, 2024

• Update docs/source/en/model_doc/zamba.md

  Show description for f80b813
  

  pglorio

  and

  ArthurZucker

  authored
  f80b813

  Copy full SHA for f80b813

• Update docs/source/en/model_doc/zamba.md

  Show description for c010a68
  

  pglorio

  and

  ArthurZucker

  authored
  c010a68

  Copy full SHA for c010a68

• Update configuration_zamba.py

  pglorio

  authored
  9c3abc8

  Copy full SHA for 9c3abc8

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for 5d3d615
  

  pglorio

  and

  ArthurZucker

  authored
  5d3d615

  Copy full SHA for 5d3d615

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for d245749
  

  pglorio

  and

  ArthurZucker

  authored
  d245749

  Copy full SHA for d245749

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for 663343d
  

  pglorio

  and

  ArthurZucker

  authored
  663343d

  Copy full SHA for 663343d

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for b3540ea
  

  pglorio

  and

  ArthurZucker

  authored
  b3540ea

  Copy full SHA for b3540ea

• Update modeling_zamba.py

  pglorio

  authored
  554c14c

  Copy full SHA for 554c14c

• Update modeling_zamba.py

  pglorio

  authored
  c9c97fd

  Copy full SHA for c9c97fd

• Update modeling_zamba.py

  pglorio

  authored
  ec9edd7

  Copy full SHA for ec9edd7

• Update configuration_zamba.py

  pglorio

  authored
  939d6a9

  Copy full SHA for 939d6a9

Commits on Sep 7, 2024

• Update modeling_zamba.py

  pglorio

  authored
  c26addd

  Copy full SHA for c26addd

• Update modeling_zamba.py

  pglorio

  authored
  e3c93f0

  Copy full SHA for e3c93f0

Commits on Sep 9, 2024

• Merge branch 'main' of https://github.com/Zyphra/transformers_zamba

  pglorio

  committed
  58d8c2d

  Copy full SHA for 58d8c2d

• Update ZambaForCausalLM

  pglorio

  committed
  396ebff

  Copy full SHA for 396ebff

• Update ZambaForCausalLM

  pglorio

  authored
  df8dfd3

  Copy full SHA for df8dfd3

• Describe diffs with original mamba layer

  pglorio

  authored
  4ab88a2

  Copy full SHA for 4ab88a2

• Moved mamba init into _init_weights

  pglorio

  committed
  1a521de

  Copy full SHA for 1a521de

• Moved mamba weight init into _init_weights

  pglorio

  committed
  767a591

  Copy full SHA for 767a591

Commits on Sep 10, 2024

• Update index.md

  pglorio

  committed
  d5b2beb

  Copy full SHA for d5b2beb

• Rebase

  pglorio

  committed
  029813b

  Copy full SHA for 029813b

• Rebase

  pglorio

  committed
  bec7dce

  Copy full SHA for bec7dce

• Updates from make fixup

  pglorio

  committed
  db15348

  Copy full SHA for db15348

• Update zamba.md

  pglorio

  committed
  6c7f812

  Copy full SHA for 6c7f812

• Batched inference

  pglorio

  committed
  c3766ba

  Copy full SHA for c3766ba

• Update

  pglorio

  committed
  dff24b8

  Copy full SHA for dff24b8

• Fix tests

  

  root

  authored and

  pglorio

  committed
  0e9f3c9

  Copy full SHA for 0e9f3c9

• Fix tests

  pglorio

  committed
  245d9d9

  Copy full SHA for 245d9d9

• Fix tests

  pglorio

  committed
  8aedd30

  Copy full SHA for 8aedd30

• Fix tests

  pglorio

  committed
  f8ed17a

  Copy full SHA for f8ed17a

• Update docs/source/en/model_doc/zamba.md

  Show description for a5d5873
  

  pglorio

  and

  ArthurZucker

  committed
  a5d5873

  Copy full SHA for a5d5873

• Update docs/source/en/model_doc/zamba.md

  Show description for 17cef25
  

  pglorio

  and

  ArthurZucker

  committed
  17cef25

  Copy full SHA for 17cef25

• Update configuration_zamba.py

  pglorio

  committed
  f773f12

  Copy full SHA for f773f12

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for c5852aa
  

  pglorio

  and

  ArthurZucker

  committed
  c5852aa

  Copy full SHA for c5852aa

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for da64b36
  

  pglorio

  and

  ArthurZucker

  committed
  da64b36

  Copy full SHA for da64b36

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for 7679578
  

  pglorio

  and

  ArthurZucker

  committed
  7679578

  Copy full SHA for 7679578

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for 85fe7cb
  

  pglorio

  and

  ArthurZucker

  committed
  85fe7cb

  Copy full SHA for 85fe7cb

• Update modeling_zamba.py

  pglorio

  committed
  6c949c6

  Copy full SHA for 6c949c6

• Update modeling_zamba.py

  pglorio

  committed
  f78b627

  Copy full SHA for f78b627

• Update modeling_zamba.py

  pglorio

  committed
  3b3605a

  Copy full SHA for 3b3605a

• Update configuration_zamba.py

  pglorio

  committed
  f6fc1e8

  Copy full SHA for f6fc1e8

• Update modeling_zamba.py

  pglorio

  committed
  d5b8d6e

  Copy full SHA for d5b8d6e

• Update modeling_zamba.py

  pglorio

  committed
  c2428a4

  Copy full SHA for c2428a4

• Merge branch 'main' of https://github.com/Zyphra/transformers_zamba

  pglorio

  committed
  bbc9a8e

  Copy full SHA for bbc9a8e

• Update ZambaForCausalLM

  pglorio

  committed
  b13fdde

  Copy full SHA for b13fdde

• Moved mamba init into _init_weights

  pglorio

  committed
  037b938

  Copy full SHA for 037b938

• Update ZambaForCausalLM

  pglorio

  committed
  9a1ef16

  Copy full SHA for 9a1ef16

• Describe diffs with original mamba layer

  pglorio

  committed
  d9d436c

  Copy full SHA for d9d436c

• Merge branch 'main' of https://github.com/Zyphra/transformers_zamba

  pglorio

  committed
  0bbb6c9

  Copy full SHA for 0bbb6c9

• make fixup fixes

  

  root

  committed
  91bc076

  Copy full SHA for 91bc076

• quality test fixes

  pglorio

  committed
  8f0100f

  Copy full SHA for 8f0100f

• Fix Zamba model path

  pglorio

  committed
  7478e25

  Copy full SHA for 7478e25

• circleci fixes

  pglorio

  committed
  a7c9d17

  Copy full SHA for a7c9d17

• circleci fixes

  pglorio

  committed
  c2d097f

  Copy full SHA for c2d097f

• circleci fixes

  pglorio

  committed
  3788196

  Copy full SHA for 3788196

• circleci fixes

  pglorio

  committed
  1c6cca8

  Copy full SHA for 1c6cca8

• circleci fixes

  pglorio

  committed
  911a78a

  Copy full SHA for 911a78a

• circleci fixes

  pglorio

  committed
  c6f2b3f

  Copy full SHA for c6f2b3f

• circleci fixes

  pglorio

  committed
  df93132

  Copy full SHA for df93132

Commits on Sep 11, 2024

• circleci fixes

  pglorio

  committed
  211a5b5

  Copy full SHA for 211a5b5

• circleci fixes

  pglorio

  committed
  e0cb9fe

  Copy full SHA for e0cb9fe

• Update

  pglorio

  committed
  1df30bb

  Copy full SHA for 1df30bb

• circleci fixes

  pglorio

  committed
  3d2800b

  Copy full SHA for 3d2800b

Commits on Sep 22, 2024

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  1e6f38b

  Copy full SHA for 1e6f38b

• fix zamba test from merge

  Quentin-Anthony

  committed
  d93377d

  Copy full SHA for d93377d

• fix ValueError for disabling mamba kernels

  Quentin-Anthony

  committed
  d01d80d

  Copy full SHA for d01d80d

Commits on Sep 23, 2024

• add HF copyright

  Show description for b9e86b0
  

  Quentin-Anthony

  and

  ArthurZucker

  authored
  b9e86b0

  Copy full SHA for b9e86b0

• shared_transf --> shared_transformer

  Quentin-Anthony

  committed
  4b0fb52

  Copy full SHA for 4b0fb52

Commits on Sep 24, 2024

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for 66b72c8
  

  pglorio

  and

  ArthurZucker

  authored
  66b72c8

  Copy full SHA for 66b72c8

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for d527a14
  

  pglorio

  and

  ArthurZucker

  authored
  d527a14

  Copy full SHA for d527a14

• Fixes

  pglorio

  committed
  97c646c

  Copy full SHA for 97c646c

• Move attention head dim to config

  pglorio

  committed
  1e4ffe6

  Copy full SHA for 1e4ffe6

• Fix circle/ci tests

  pglorio

  committed
  2c53db2

  Copy full SHA for 2c53db2

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  9a1ad32

  Copy full SHA for 9a1ad32

• Update modeling_zamba.py

  pglorio

  authored
  a7717f2

  Copy full SHA for a7717f2

• apply GenerationMixin inheritance change from upstream

  Quentin-Anthony

  committed
  0fae398

  Copy full SHA for 0fae398

• apply import ordering

  Quentin-Anthony

  committed
  0304440

  Copy full SHA for 0304440

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  3d9ec8e

  Copy full SHA for 3d9ec8e

Commits on Sep 25, 2024

• Merge branch 'main' into main

  Quentin-Anthony

  authored
  cb1d1d9

  Copy full SHA for cb1d1d9

Commits on Sep 26, 2024

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  efcf16a

  Copy full SHA for efcf16a

• update needed transformers version for zamba

  Show description for 339d4cc
  

  Quentin-Anthony

  and

  ArthurZucker

  authored
  339d4cc

  Copy full SHA for 339d4cc

• add contribution author

  Quentin-Anthony

  committed
  a46a26b

  Copy full SHA for a46a26b

• add @slow to avoid CI

  Quentin-Anthony

  committed
  d0c1bc1

  Copy full SHA for d0c1bc1

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  4fcd130

  Copy full SHA for 4fcd130

Commits on Sep 27, 2024

• Update src/transformers/models/zamba/modeling_zamba.py

  Show description for 8d29964
  

  pglorio

  and

  ArthurZucker

  authored
  8d29964

  Copy full SHA for 8d29964

• Define attention_hidden_size

  pglorio

  committed
  0381c33

  Copy full SHA for 0381c33

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  75554d8

  Copy full SHA for 75554d8

• Added doc for attention_head_size

  pglorio

  authored
  a109b3f

  Copy full SHA for a109b3f

• trigger CI

  Quentin-Anthony

  committed
  9c10afe

  Copy full SHA for 9c10afe

• Fix doc of attention_hidden_size

  pglorio

  authored
  1880455

  Copy full SHA for 1880455

Commits on Sep 30, 2024

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  daef5b0

  Copy full SHA for daef5b0

• [run-slow] zamba

  pglorio

  committed
  347f761

  Copy full SHA for 347f761

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  634837f

  Copy full SHA for 634837f

Commits on Oct 1, 2024

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  4e8db07

  Copy full SHA for 4e8db07

Commits on Oct 3, 2024

• Fixed shared layer logic, swapped up<->gate in mlp

  pglorio

  committed
  1504774

  Copy full SHA for 1504774

• fix shared layer logic, swap up<->gate in mlp

  pglorio

  committed
  06e3a7a

  Copy full SHA for 06e3a7a

Commits on Oct 4, 2024

• shared_transformer -> shared_transf

  pglorio

  committed
  267530d

  Copy full SHA for 267530d

• reformat HybridLayer __init__

  pglorio

  committed
  0a90fc7

  Copy full SHA for 0a90fc7

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  fabaaec

  Copy full SHA for fabaaec

• fix docstrings in zamba config

  pglorio

  authored
  75f0d89

  Copy full SHA for 75f0d89

• added definition of _get_input_ids_and_config

  pglorio

  committed
  b9545eb

  Copy full SHA for b9545eb

• fixed formatting of _get_input_ids_and_config

  pglorio

  committed
  cdbd690

  Copy full SHA for cdbd690

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  6fabb6a

  Copy full SHA for 6fabb6a

• Merge branch 'huggingface:main' into main

  Quentin-Anthony

  authored
  b9f6cce

  Copy full SHA for b9f6cce