Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prepare the arg to disable kvikIO remote IO #2583

Merged
merged 1 commit into from
Nov 11, 2024

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented Nov 11, 2024

part of #2581

prepare the arg to help the submodule sync pipeline work correctly after rapidsai/cudf#17291

@pxLi pxLi added the build label Nov 11, 2024
@pxLi pxLi self-assigned this Nov 11, 2024
@pxLi
Copy link
Collaborator Author

pxLi commented Nov 11, 2024

build

@@ -463,6 +463,7 @@
<arg value="-DCUDF_USE_PER_THREAD_DEFAULT_STREAM=${CUDF_USE_PER_THREAD_DEFAULT_STREAM}" />
<arg value="-DCUDF_LARGE_STRINGS_DISABLED=ON"/>
<arg value="-DKvikIO_REMOTE_SUPPORT=OFF"/>
<arg value="-DCUDF_KVIKIO_REMOTE_IO=OFF"/>
Copy link
Collaborator

@ttnghia ttnghia Nov 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe remove KvikIO_REMOTE_SUPPORT? Since CUDF_KVIKIO_REMOTE_IO disables it in rapidsai/cudf#17291.

Copy link
Collaborator Author

@pxLi pxLi Nov 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is for preemptive change for submodule sync update later, current cudf ref in JNI repo (for CI like premerge) still requires this flag until rapidsai/cudf#17291 is merged

merge this to re-enable submodule-sync pipeline, so it could work well whenever the cudf merge is fixed, we can do a post-cleanup for KvikIO_REMOTE_SUPPORT

@pxLi
Copy link
Collaborator Author

pxLi commented Nov 11, 2024

Going to merge this one to re-enable auto submodule sync up, lets remove the KvikIO_REMOTE_SUPPORT workaround after submodule sync CI updates cudf ref to the fix commit later

@pxLi pxLi merged commit 42a29cc into NVIDIA:branch-24.12 Nov 11, 2024
4 checks passed
@ttnghia
Copy link
Collaborator

ttnghia commented Nov 11, 2024

Going to merge this one to re-enable auto submodule sync up, lets remove the KvikIO_REMOTE_SUPPORT workaround after submodule sync CI updates cudf ref to the fix commit later

We won't be able to run submodule sync until rapidsai/cudf#17291 merged in. That is why I suggested to remove KvikIO_REMOTE_SUPPORT altogether (which means this PR needs to wait for it first).

@pxLi
Copy link
Collaborator Author

pxLi commented Nov 11, 2024

We won't be able to run submodule sync until rapidsai/cudf#17291 merged in. That is why I suggested to remove KvikIO_REMOTE_SUPPORT altogether (which means this PR needs to wait for it first).

I mean I want to re-enable the submodule sync up pipeline (not to pass the build), to make it automatically catch the change later. so we do not need to keep our eyes on it. Otherwise, there must be a human to monitor the status of the cudf fix and then merge required commits manually

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants