Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet Preview: Add support for Delta Encoding #7506

Open
3 tasks done
mkfrey opened this issue Nov 13, 2023 · 1 comment
Open
3 tasks done

Parquet Preview: Add support for Delta Encoding #7506

mkfrey opened this issue Nov 13, 2023 · 1 comment
Assignees
Labels
💡 feature request New feature or request ❔ investigate We need to look into this further
Milestone

Comments

@mkfrey
Copy link

mkfrey commented Nov 13, 2023

Preflight Checklist

Problem

I'm unable to preview Parquet files created with delta encoded numbers. When trying to preview such a file, I get the error message "invalid encoding: DELTA_BINARY_PACKED".

Desired Solution

Preview of Parquet files with delta encoded numbers should be possible.

Alternatives and Workarounds

No response

Additional Context

No response

@MRayermannMSFT MRayermannMSFT added the 💡 feature request New feature or request label Nov 13, 2023
@MRayermannMSFT
Copy link
Member

@JasonYeMSFT please determine if the parquet-js library needs modification to support delta encoding. If so, then open an issue and we can triage this into near future. If instead supporting delta encoding only requires work on our side, please provide a cost estimation for that work so we can triage into a milestone.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💡 feature request New feature or request ❔ investigate We need to look into this further
Projects
None yet
Development

No branches or pull requests

3 participants