Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] [Triage] Several potential Cutlass illegal memory access violations related to SM90 EVT #1276

Closed
kadeng opened this issue Dec 20, 2023 · 2 comments
Labels
? - Needs Triage bug Something isn't working

Comments

@kadeng
Copy link

kadeng commented Dec 20, 2023

While working on the Pytorch Inductor CUDA/Cutlass backend, I have encountered several cases where I'm seeing Illegal Memory Accesses, which I could not trace down to an error in the user code, so these might be Cutlass bugs.

I have created a public gist here on Github where you will find the source code to 4 (generated) standalone Cutlass based
executables, each failing with some kind of error:
https://gist.github.com/kadeng/8fa35f5e42ed111f8de8d8623f16ec88

Simple build/run scripts are included in the gist above, you only need to modify them to point to the right Cutlass and CUDA Toolkit directory.

Environment: CUDA 12.1, H100 80 GB, Linux x64, Cutlass 3.3.0

You might want to try to reproduce these errors via the provided code and scripts and triage whether they are Cutlass bugs.

@kadeng kadeng added ? - Needs Triage bug Something isn't working labels Dec 20, 2023
@kadeng kadeng changed the title [BUG] Several potential Cutlass illegal memory access violations related to SM90 EVT [BUG] [Triage] Several potential Cutlass illegal memory access violations related to SM90 EVT Dec 20, 2023
@hwu36
Copy link
Collaborator

hwu36 commented Dec 20, 2023

@jackkosaian

@kadeng
Copy link
Author

kadeng commented Dec 20, 2023

Nevermind, I found the problem. Not a Cutlass bug.

@kadeng kadeng closed this as completed Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
? - Needs Triage bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants