Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update default behaviour of compression algorithms (support multistreams) #5629

Merged
merged 1 commit into from
Mar 18, 2023
Merged

Update default behaviour of compression algorithms (support multistreams) #5629

merged 1 commit into from
Mar 18, 2023

Conversation

metesynnada
Copy link
Contributor

Which issue does this PR close?

Closes #5628.

Rationale for this change

Support larger compressed files with multi-members.

What changes are included in this PR?

Changing convert_read

Are these changes tested?

Yes

Are there any user-facing changes?

No

@github-actions github-actions bot added the core Core DataFusion crate label Mar 17, 2023
@alamb alamb changed the title Update default behaviour of compression algorithms Update default behaviour of compression algorithms (support multistreams) Mar 17, 2023
@@ -30,10 +30,10 @@ use async_compression::tokio::bufread::{
};
use bytes::Bytes;
#[cfg(feature = "compression")]
use bzip2::read::BzDecoder;
use bzip2::read::MultiBzDecoder;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@alamb alamb merged commit d3280d7 into apache:main Mar 18, 2023
@andygrove andygrove added the enhancement New feature or request label Apr 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support for decompressing multi-member gz/bz/xz files
3 participants