Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Add GPU specific metrics to GpuFileSourceScanExec #524

Closed
jlowe opened this issue Aug 7, 2020 · 0 comments · Fixed by #547
Closed

[FEA] Add GPU specific metrics to GpuFileSourceScanExec #524

jlowe opened this issue Aug 7, 2020 · 0 comments · Fixed by #547
Assignees
@jlowe
Labels
feature request New feature or request P0 Must have for release
Milestone
Aug 3 - Aug 14

Comments

@jlowe
Copy link
Member

jlowe commented Aug 7, 2020

GpuFileSourceScanExec should expose metrics for how much time was spent buffering the data from the distributed filesystem vs. parsing the data on the GPU. This can be useful for determining if scan slowness is due to I/O issues or slow GPU parsing.
@jlowe jlowe added feature request New feature or request P0 Must have for release labels Aug 7, 2020
@jlowe jlowe added this to the Aug 3 - Aug 14 milestone Aug 7, 2020
@jlowe jlowe self-assigned this Aug 7, 2020
This was referenced Aug 7, 2020
Closed
Merged
@sameerz sameerz mentioned this issue Aug 18, 2020
Closed
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@nvauto
Update submodule cudf to a444c17 (NVIDIA#524)
e563b69 
Signed-off-by: spark-rapids automation <[email protected]>

Signed-off-by: spark-rapids automation <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jlowe jlowe

Labels
feature request New feature or request P0 Must have for release
Projects
None yet
Milestone
Aug 3 - Aug 14
Development

Successfully merging a pull request may close this issue.

Add GPU metrics to GpuFileSourceScanExec jlowe/spark-rapids
1 participant
@jlowe