Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Use KvikIO by default #10415

Closed
2 tasks
vuule opened this issue Mar 11, 2022 · 2 comments · Fixed by #12574
Closed
2 tasks

[FEA] Use KvikIO by default #10415

vuule opened this issue Mar 11, 2022 · 2 comments · Fixed by #12574
Assignees
@vuule
Labels
cuIO cuIO issue feature request New feature or request improvement Improvement / enhancement to an existing function Performance Performance related issue

Comments

@vuule
Copy link
Contributor

vuule commented Mar 11, 2022 •
edited
Loading

Future GDS optimizations will be implemented in KvikIO, we should use it by default as soon as it matches the internal implementation in perf
Tasks:

  • Compare the performance with benchmarks that are not affected by caching;
  • If this pans out, change the default.
    Internal GDS integration can then be removed in future release, once we are sure KvikIO is the better option in terms of performance and reliability.
@vuule vuule added feature request New feature or request cuIO cuIO issue Performance Performance related issue improvement Improvement / enhancement to an existing function labels Mar 11, 2022
@vuule vuule mentioned this issue Mar 11, 2022
Merged
@github-actions
Copy link

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.

@github-actions
Copy link

github-actions bot commented Jul 9, 2022

This issue has been labeled inactive-90d due to no recent activity in the past 90 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed.

@vuule vuule changed the title [FEA] Enable GDS compatibility mode by default [FEA] Use KvikIO by default Aug 2, 2022
@vuule vuule mentioned this issue Jan 18, 2023
Merged
3 tasks
rapids-bot bot pushed a commit that referenced this issue Jan 23, 2023
@vuule
Use kvikIO as the default IO backend (#12574)
7f6ae05 
Closes #10415
Switching the default backend to kvikIO. 
Benchmarks show the same or better throughput.

Removing the redundant libcudf tests that ran with kvikIO.

Authors:
  - Vukasin Milovanovic (https://github.com/vuule)

Approvers:
  - Nghia Truong (https://github.com/ttnghia)
  - Karthikeyan (https://github.com/karthikeyann)
  - AJ Schmidt (https://github.com/ajschmidt8)

URL: #12574
@GregoryKimball GregoryKimball removed this from libcudf Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vuule vuule

Labels
cuIO cuIO issue feature request New feature or request improvement Improvement / enhancement to an existing function Performance Performance related issue
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Use kvikIO as the default IO backend vuule/cudf
1 participant
@vuule