New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

First GPU use more memory，and lead to OOM #79

Open

Lzhang-hub opened this issue Jul 7, 2023 · 0 comments

Lzhang-hub commented Jul 7, 2023 •

edited

Loading

Condition:

GPU: A100 40G *8
batch size=2

error

CUDA out of memory.

some confusion

We find the gpu 0 use more memory than other gpus

And there are 7 additional processes on GPU 0.

What are these 7 processes used for? Or Is there any way to reduce the memory usage of GPU 0?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment