bugfix: Fix the batch size/seq len args for the decode kernel with te…

…nsor cores (#640) A prior PR switched up the two arguments via a typo, without tests catching the problem.
flashinfer-ai · Nov 26, 2024 · 42b9874 · 42b9874
1 parent 86ca89a
commit 42b9874
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/python/flashinfer/decode.py b/python/flashinfer/decode.py
@@ -777,8 +777,8 @@ def plan(
                     qo_indptr_host,
                     indptr_host,
                     batch_size,  # total_num_rows
-                    batch_size,
                     1,  # max_seq_len
+                    batch_size,
                     num_qo_heads,
                     num_kv_heads,
                     page_size,