Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Java bindings for Avro reader #10373

Merged
merged 10 commits into from
Mar 8, 2022

Conversation

HaoYang670
Copy link
Contributor

In this PR, we add Avro reader JNI and some reader options in cudf java.
Re NVIDIA/spark-rapids#4831

@HaoYang670 HaoYang670 requested a review from a team as a code owner March 1, 2022 03:12
@GPUtester
Copy link
Collaborator

Can one of the admins verify this patch?

@github-actions github-actions bot added the Java Affects Java cuDF API. label Mar 1, 2022
@sperlingxx sperlingxx added non-breaking Non-breaking change feature request New feature or request 3 - Ready for Review Ready for review by team labels Mar 1, 2022
@wbo4958 wbo4958 self-requested a review March 1, 2022 06:52
@@ -1020,6 +1031,85 @@ public static Table readParquet(ParquetOptions opts, HostMemoryBuffer buffer,
null, buffer.getAddress() + offset, len, opts.timeUnit().typeId.getNativeId()));
}


Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please delete redundant blank line

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

null, buffer.getAddress() + offset, len));
}


Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please delete redundant blank line

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@wbo4958
Copy link
Contributor

wbo4958 commented Mar 1, 2022

LGTM

java/src/main/java/ai/rapids/cudf/Table.java Outdated Show resolved Hide resolved
java/src/main/java/ai/rapids/cudf/Table.java Outdated Show resolved Hide resolved
java/src/main/java/ai/rapids/cudf/Table.java Outdated Show resolved Hide resolved
java/src/test/java/ai/rapids/cudf/TableTest.java Outdated Show resolved Hide resolved
java/src/test/java/ai/rapids/cudf/TableTest.java Outdated Show resolved Hide resolved
@firestarman
Copy link
Contributor

rerun tests

Signed-off-by: remzi <[email protected]>
Signed-off-by: remzi <[email protected]>
@firestarman
Copy link
Contributor

LGTM

@firestarman
Copy link
Contributor

rerun tests

@firestarman firestarman added 3 - Ready for Review Ready for review by team and removed 3 - Ready for Review Ready for review by team labels Mar 2, 2022
@jjacobelli
Copy link
Contributor

ok to test

@HaoYang670
Copy link
Contributor Author

ok to test

Thank you very much !

@codecov
Copy link

codecov bot commented Mar 2, 2022

Codecov Report

Merging #10373 (00d100e) into branch-22.04 (7a17f28) will decrease coverage by 1.64%.
The diff coverage is n/a.

Impacted file tree graph

@@               Coverage Diff                @@
##           branch-22.04   #10373      +/-   ##
================================================
- Coverage         10.63%    8.98%   -1.65%     
================================================
  Files               122      126       +4     
  Lines             20953    24786    +3833     
================================================
  Hits               2228     2228              
- Misses            18725    22558    +3833     
Impacted Files Coverage Δ
python/cudf/cudf/core/ops.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/frame.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/index.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/scalar.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/series.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/utils.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/_compat.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/reshape.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/dataframe.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/multiindex.py 0.00% <0.00%> (ø)
... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7a17f28...00d100e. Read the comment docs.

@firestarman
Copy link
Contributor

rerun tests

@firestarman firestarman added 5 - Ready to Merge Testing and reviews complete, ready to merge and removed 3 - Ready for Review Ready for review by team labels Mar 7, 2022
@firestarman
Copy link
Contributor

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 5207eff into rapidsai:branch-22.04 Mar 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
5 - Ready to Merge Testing and reviews complete, ready to merge feature request New feature or request Java Affects Java cuDF API. non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants