Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory allocation issue #16

Open
depedraza opened this issue Dec 22, 2022 · 0 comments
Open

memory allocation issue #16

depedraza opened this issue Dec 22, 2022 · 0 comments

Comments

@depedraza
Copy link

depedraza commented Dec 22, 2022

Hi, I was trying to get working the ReadPhilips node and I'm getting memory allocation issues, in particular, I get the following error:

File "ReadPhilips_GPI.py", line 574, in compute File "readPhilipsExports.py", line 1506, in readRaw numpy.core._exceptions._ArrayMemoryError: Unable to allocate 97.3 GiB for an array with shape (28, 1, 450, 1, 9, 1, 1, 1, 1, 1, 1, 450, 256) and data type complex64

So the library is trying to pre-allocate almost a 100GB for the array shown with those dimensions. Clearly, trying to pre-allocate memory for all the dimensions of the array seems kinda unnecessary (dimensions with size 1), they may provide useful information in the reading process but considering all of them in the pre-allocation step seems overkill. Is there anyway to circumvent this issue? It may not even be related directly with the code, maybe it has to do with the .sin file, I don't know, it would be really helpful to get some guidance so I can perform the functionality that I'm looking for.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant