Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Using GPU-Direct with pnetcdf? #96

Open
jedwards4b opened this issue Dec 3, 2022 · 3 comments
Open

Using GPU-Direct with pnetcdf? #96

jedwards4b opened this issue Dec 3, 2022 · 3 comments

Comments

@jedwards4b
Copy link

Has anyone tried this?
@wkliao
Copy link
Member

wkliao commented Dec 4, 2022

Hi, Jim
I think it would be a great feature in PnetCDF.
Could you point me to some use cases that can benefit from this feature?

@jedwards4b
Copy link
Author

I am working on an asyncronous implementation of the parallelio library in cesm. I would like to prototype parallelio moving data from cpu memory to gpu memory, doing some data compression and/or data postprocessing on the gpu and then writing directly from the gpu to disk.

@wkliao
Copy link
Member

wkliao commented Dec 6, 2022

Can I assume the parallel write part of your use case is the typical concurrent writes from multiple processes to a single shared file? e.g. using collective I/O mode.

Just a reminder, PnetCDF (and the classic NetCDF file formats) does not support data compression.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wkliao @jedwards4b