24.09-alpha.rc0
alpha0422
tagged this
16 Sep 09:16
* [SD] Add te-dpa support Signed-off-by: Wil Kong <[email protected]> * [SD] Add te-dpa support, resolve compatibility with TE-master Signed-off-by: Wil Kong <[email protected]> * [SD] Add te-dpa support, add check for attention configs. Signed-off-by: Wil Kong <[email protected]> * Fix bugs of flash-attn and dpa in SD. Signed-off-by: Wil Kong <[email protected]> * Fix the issue of DPA API change. Signed-off-by: Wil Kong <[email protected]> * Apply isort and black reformatting Signed-off-by: alpha0422 <[email protected]> Signed-off-by: Wil Kong <[email protected]> * [SD] TE-DPA: disbale use te-dpa in inference flow. --------- Signed-off-by: Wil Kong <[email protected]> Signed-off-by: alpha0422 <[email protected]> Co-authored-by: Mengdi Wang <[email protected]>