Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extension proposal for zarr accumulation #31

Conversation

hailiangzhang
Copy link
Contributor

@hailiangzhang hailiangzhang commented Feb 14, 2023

This PR contains the Zarr extension proposal for a method that we developed at NASA GESDISC -- Zarr-based Chunk-level Accumulation, which provides fast and cost-efficient data analysis services based on chunk level statistics. The proposal mainly includes the Zarr group structure and attribute schema for the chunk level statistics.

This related PR against zarr-specs repo is here.

@MSanKeys963
Copy link
Member

Hi @hailiangzhang. Thanks for sending the ZEP.

Apart from one minor suggestion above, it looks good in completeness.
Let me know when you want me to merge it. We can continue further discussions for this ZEP over at zarr-developers/zarr-specs#205.

Co-authored-by: Sanket Verma <[email protected]>
@hailiangzhang
Copy link
Contributor Author

zarr-developers/zarr-specs#205

Hi @hailiangzhang. Thanks for sending the ZEP.

Apart from one minor suggestion above, it looks good in completeness. Let me know when you want me to merge it. We can continue further discussions for this ZEP over at zarr-developers/zarr-specs#205.

Hi @MSanKeys963 , thanks a lot for your comments, and I have committed it. And yes, let's continue discussions from the zarr-spec PR, and please feel free to merge it if it's okay.

@MSanKeys963 MSanKeys963 merged commit e6916c0 into zarr-developers:main Mar 8, 2023
@MSanKeys963
Copy link
Member

Thanks for your work here, @hailiangzhang!

ZEP0005 can be read here: https://zarr.dev/zeps/draft/ZEP0005.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants