Code

Enable Vanilla Bwd and Refactor#86

Code

Merged

micmelesse merged 67 commits intomain_perfROCm/flash-attention:main_perffrom micmelesse/enable_bwdROCm/flash-attention:micmelesse/enable_bwdCopy head branch name to clipboardOct 28, 2024

+6,374-2,395

Commits

Commits on Oct 14, 2024

• Vanilla BWD

  Show description for 1745690
  micmelesse

  committed
  1745690

• refactor

  micmelesse

  committed
  5e76b58

• refactor 2

  micmelesse

  committed
  a9e4851

• refactor 3

  micmelesse

  committed
  2f95807

• fix bug

  micmelesse

  committed
  6182013

• try ci

  micmelesse

  committed
  0140baf

• add flag

  micmelesse

  committed
  5e54821

• rename to utils

  micmelesse

  committed
  d005ab9

• skip test_op_fwd_decode_int4_kv

  micmelesse

  committed
  22342a7

Commits on Oct 15, 2024

• reduce head size

  micmelesse

  committed
  51b2e8e

• try again

  micmelesse

  committed
  5071356

• go back to old head sizes

  micmelesse

  committed
  ce80a7e

Commits on Oct 16, 2024

• Use Strides

  Show description for a168999
  micmelesse

  committed
  a168999

• use gen scripts

  micmelesse

  committed
  a1c7674

• varlen fwd passing

  micmelesse

  committed
  1a761a0

• core fwd ref impl

  micmelesse

  committed
  e5ee0f8

• fix minor bugs

  micmelesse

  committed
  b9b1f24

• wrap varlen- launcher attention_forward_pytorch_ref_impl

  micmelesse

  committed
  52f6bdc

• varlen backward ref added

  micmelesse

  committed
  ed1e4fe

Commits on Oct 17, 2024

• add offsets for varlen

  micmelesse

  committed
  a86af8a

• fix delta bug

  micmelesse

  committed
  72cec14

• varlen bwd working

  micmelesse

  committed
  bc25ca2

• save

  micmelesse

  committed
  e5e5307

• runs on Mi200

  micmelesse

  committed
  94fbe0e

Commits on Oct 18, 2024

• just test basics

  micmelesse

  committed
  79871d7

• save

  micmelesse

  committed
  0de209c

• fix bug

  micmelesse

  committed
  2db6502

Commits on Oct 19, 2024

• fix varlen in64 bug

  micmelesse

  committed
  d192946

Commits on Oct 21, 2024

• add ref

  micmelesse

  committed
  c8274bb

• test_impl working with causal

  micmelesse

  committed
  cdc916f

• fix qkvpacked issue

  micmelesse

  committed
  550b2ba

• qkvpacked run tests

  micmelesse

  committed
  f0c782d

• remove test_backward

  micmelesse

  committed
  2169bc3

• save

  micmelesse

  committed
  da22a8d

• just test output

  micmelesse

  committed
  1fa1124

• dump into tensors

  micmelesse

  committed
  290a922

Commits on Oct 22, 2024

• softmaxlse layout for varlen

  micmelesse

  committed
  4e05a5f

• small cases working

  micmelesse

  committed
  695dbc3

• bwd thd green. although maybe some oom

  micmelesse

  committed
  b5d663c

• forward out and lse are good. Something wrong with backward ref

  micmelesse

  committed
  bab936b

• make varlen ref work

  micmelesse

  committed
  ca2670c

Commits on Oct 23, 2024

• save work, ref is working mostly

  micmelesse

  committed
  628fbfd

• 91 failed, 6542 passed, 6336 skipped, 1 warning

  micmelesse

  committed
  6e2ed2c

• ref is all green

  micmelesse

  committed
  e1395fb

• debug flag in utils

  micmelesse

  committed
  b762787

• found bad softmax_lse in varlen fwd

  micmelesse

  committed
  0421893

• fix bug in softmax lse. strides in varlen werenot right

  micmelesse

  committed
  1e70ab9

• add causal tests and 32*32 bwd doesnot have segfault

  micmelesse

  committed
  a676a4b

• save

  micmelesse

  committed
  997db5c

• fix oom by reducing block size for small heads

  micmelesse

  committed
  18707e0

Commits on Oct 24, 2024

• bwd ref with causal working

  micmelesse

  committed
  e3d8fb1

• test impl

  micmelesse

  committed
  953bddc

Commits on Oct 25, 2024

• causal test passes

  micmelesse

  committed
  6ea8bdc

• causal working

  micmelesse

  committed
  32adf22

• fix tests

  micmelesse

  committed
  822f5ad

• nicer bench

  micmelesse

  committed
  e1f9a34

• fix qvpacked error

  micmelesse

  committed
  04bb36c

• fix varlen qvpacked bug

  micmelesse

  committed
  111db23

• fix minor bug

  micmelesse

  committed
  7fd98b9

• bench prefill and prefill_old using the same script

  micmelesse

  committed
  deb2058

• autotune configs for fwd

  micmelesse

  committed
  19d603b

Commits on Oct 26, 2024

• autotune flag

  micmelesse

  committed
  4a5baba

• clean up decode impl

  micmelesse

  committed
  71cb8ea

• clean up

  micmelesse

  committed
  9411609

• clean up more

  micmelesse

  committed
  a9c2ab7

• bench everything by default and return time

  micmelesse

  committed
  6dd5102

Commits on Oct 28, 2024

• clean up readmes

  micmelesse

  committed
  9e3578a