Code

debug don't merge#30455

Code

Closed

ydshieh wants to merge 20 commits intomainhuggingface/transformers:mainfrom mymainhuggingface/transformers:mymainCopy head branch name to clipboard

+2,515-2

Commits

Commits on Apr 23, 2024

• chore(root): Initial commit of Phi-3 files.

  gugarosa

  committed
  c1e38b0

• fix(root): Fixes Phi-3 missing on readme.

  gugarosa

  committed
  416eaa4

• fix(root): Ensures files are consistent.

  gugarosa

  committed
  e0b6815

• fix(phi3): Fixes unit tests.

  gugarosa

  committed
  912edf1

• fix(tests): Fixes style of phi-3 test file.

  gugarosa

  committed
  b62e6f3

• chore(tests): Adds integration tests for Phi-3.

  gugarosa

  committed
  508ec8e

• fix(phi3): Removes additional flash-attention usage, .e.g, swiglu and rmsnorm.

  gugarosa

  committed
  56e6464

• fix(phi3): Fixes incorrect docstrings.

  gugarosa

  committed
  9bc1f1f

• fix(phi3): Fixes docstring typos.

  gugarosa

  committed
  92d8379

• fix(phi3): Adds support for Su and Yarn embeddings.

  gugarosa

  committed
  c442d06

• fix(phi3): Improves according first batch of reviews.

  gugarosa

  committed
  d5aed89

• fix(phi3): Uses up_states instead of y in Phi3MLP.

  gugarosa

  committed
  3a24a1d

• fix(phi3): Uses gemma rotary embedding to support torch.compile.

  gugarosa

  committed
  4cfa767

• fix(phi3): Improves how rotary embedding classes are defined.

  gugarosa

  committed
  817fec7

Commits on Apr 24, 2024

• fix(phi3): Fixes inv_freq not being re-computed for extended RoPE.

  gugarosa

  committed
  9427419

• Merge remote-tracking branch 'upstream/main' into main

  gugarosa

  committed
  06cd06d

• fix(phi3): Adds last suggestions to modeling file.

  gugarosa

  committed
  2abcd4d

• fix(phi3): Splits inv_freq calculation in two lines.

  gugarosa

  committed
  aeb6ae7

• run

  ydshieh

  committed
  d4a3ec2

• fix

  ydshieh

  committed
  6f25ef4