Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

radii > 0 - CUDA error illegal access memory #20

Open
gaetan-landreau opened this issue Feb 16, 2024 · 4 comments
Open

radii > 0 - CUDA error illegal access memory #20

gaetan-landreau opened this issue Feb 16, 2024 · 4 comments

Comments

@gaetan-landreau
Copy link

Hi !

Currently trying to give a try to your method on a custom scene I have but I'm facing quite a disturbing and strange issue. Training starts well, but at some points, I got some CUDA-kernel error I cannot get.

I highly suspect an issue related to the gaussians.compute_3D_filter method (https://github.com/autonomousvision/mip-splatting/blob/746a17c9a906be256ed85b8fe18632f5d53e832d/train.py#L164C1-L165C1) but I don't manage to investigate in a deeper way the error.

I've found some similar issue in the original GS repo (here: graphdeco-inria/gaussian-splatting#41 (comment)), made the corresponding changes by rebuilding the diff-gaussian-rasterizer submodule, but I still get the error.

Here is the log stack I get.

Screenshot 2024-02-16 at 16 38 20

Do you have any clues / insights on what's happening and why ?

Thanks a lot for your time, your work,

Best,

Gaétan.

@niujinshuchong
Copy link
Member

Hi, not sure what’s wrong. Do you find a solution in the end?

@zhouilu
Copy link

zhouilu commented Apr 7, 2024

I meet the similar problem. Have you fixed it up?

@wrencanfly
Copy link

Have you fixed it up?

@wrencanfly
Copy link

I meet the similar problem. Have you fixed it up?

I fixed the problem by using a new WSL machine with cuda 118

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants