New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add how to import FA3 to documentation. #1112

Open

AdamLouly wants to merge 1 commit into Dao-AILab:main from AdamLouly:patch-1

AdamLouly commented Jul 31, 2024

I've had this issue and also seen many people questioning how to use FA3.

usually people try to
import as flash_attn.hopper
or as
import flashattn_hopper
but it should be
import flash_attn_interface


          Add how to import FA3 to documentation

d46ddcd

saurabh-kataria commented Sep 6, 2024

from flash_attn_interface import * would be better, since there you find flash_attn_func

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet