Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regarding SSM block #332

Open
sydat2701 opened this issue Nov 27, 2024 · 1 comment
Open

Regarding SSM block #332

sydat2701 opened this issue Nov 27, 2024 · 1 comment

Comments

@sydat2701
Copy link

Hi! Thank you for your great work!
I have a question that hope you can explain. As your paper shows that the SS2D includes 3 phases: cross-scan, S6 blocks, and cross-merge. However, I can not find the S6 block explicitly in SS2Dv2 code. So is the SSM implemented inside the selective_scan function? (which I cannot access to).

@MzeroMiko
Copy link
Owner

Yes. The S6 block is mainly adopted from tridao's mamba, so does the cuda implementation. And we have only some slight modifications on it. You can find the detailed implementation in kernels/selective_scan.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants