Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet Storage Interface (#1473) #1509

Closed
wants to merge 7 commits into from

Conversation

tustvold
Copy link
Contributor

Highly experimental, exploring the async parquet API design space

Which issue does this PR close?

Closes #1473.

Rationale for this change

See ticket

What changes are included in this PR?

TBC

Are there any user-facing changes?

@github-actions github-actions bot added the parquet Changes to the parquet crate label Mar 30, 2022
@codecov-commenter
Copy link

Codecov Report

Merging #1509 (1282c11) into master (e778c10) will decrease coverage by 0.04%.
The diff coverage is 69.58%.

❗ Current head 1282c11 differs from pull request most recent head e1825cd. Consider uploading reports for the commit e1825cd to get more accurate results

@@            Coverage Diff             @@
##           master    #1509      +/-   ##
==========================================
- Coverage   82.72%   82.67%   -0.05%     
==========================================
  Files         187      190       +3     
  Lines       54186    54769     +583     
==========================================
+ Hits        44824    45283     +459     
- Misses       9362     9486     +124     
Impacted Files Coverage Δ
arrow/src/compute/kernels/filter.rs 88.00% <ø> (ø)
...ion-testing/src/bin/arrow-json-integration-test.rs 0.00% <0.00%> (ø)
integration-testing/src/lib.rs 0.00% <0.00%> (ø)
parquet/src/arrow/async_reader.rs 0.00% <0.00%> (ø)
parquet/src/arrow/levels.rs 84.80% <25.00%> (+0.12%) ⬆️
arrow/src/array/builder.rs 86.68% <50.00%> (-0.05%) ⬇️
arrow/src/array/equal/list.rs 79.38% <59.57%> (-9.85%) ⬇️
parquet/src/arrow/array_reader/builder.rs 66.30% <66.30%> (ø)
arrow/src/array/equal/utils.rs 74.45% <76.31%> (+0.45%) ⬆️
arrow/src/ffi_stream.rs 79.03% <79.03%> (ø)
... and 24 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e778c10...e1825cd. Read the comment docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Requirements for Async Parquet API
2 participants