Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid auto-merging thirdparty/cudf-pins #1928

Merged
merged 3 commits into from
Apr 10, 2024

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Apr 5, 2024

Fixes #1927. This avoids automatically merging thirdparty/cudf-pins files when automatically merging changes between branches.

@jlowe jlowe added the build label Apr 5, 2024
@jlowe jlowe self-assigned this Apr 5, 2024
@jlowe
Copy link
Member Author

jlowe commented Apr 5, 2024

@NvTimLiu do you have a way to test this change? I'm unclear on how the workflows get tested.

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Apr 8, 2024

@NvTimLiu do you have a way to test this change? I'm unclear on how the workflows get tested.

This change have not yet be merged, and can not be triggered in the NVIDIA repo, so this auto-merge workflow change have to be verified in the forked repo instead


Verified on my own forked repo:

Auto merge code change : NvTimLiu#73

Not merge submodule change: NvTimLiu#75 (nothing changed on branch-24.06)

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Apr 8, 2024

@jlowe Oh I intended to suggest change on your PR, but did not know how to add suggestions, so changed auto-merge.yml file on your branched, please feel free to discard/revert it if you've better fix. Thanks!

gerashegalov added a commit that referenced this pull request Apr 8, 2024
- Removes tests for the default `cudf::hash`
- Updates cudf deps pins to workaround the issue being fixed by #1928 

Testing:

```bash
$ cd thirdparty/cudf
$ git checkout branch-24.06
$ cd -
$ ./build/build-in-docker clean install -DGPU_ARCHS='NATIVE' -DBUILD_TESTS=0N -DskipTests -Dlibcudf.clean.skip=false -Dlibcudf.dependency.mode=latest -Dsubmodule.check.skip 
$ ./target/cmake-build/gtests/HASH
```

Fixes #1926 
    
Signed-off-by: Gera Shegalov <[email protected]>
@YanxuanLiu
Copy link
Collaborator

build

@YanxuanLiu
Copy link
Collaborator

build

@NvTimLiu Please help to trigger pre-merge pipeline. I still got not-authorized error. Thanks!

@jlowe
Copy link
Member Author

jlowe commented Apr 9, 2024

build

@NvTimLiu NvTimLiu self-requested a review April 10, 2024 09:58
We want to merge all spark-rapids-jni HEAD(24.04) commit to BASE(24.06), 

But we do not want to merge submodules(24.04 cudf cudf-pin) to BASE(24.06)

As we need pin cudf/cudf-pin submodules to 24.06 instead of 24.04
@NvTimLiu
Copy link
Collaborator

build

Copy link
Collaborator

@gerashegalov gerashegalov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, non-blocking nit

OUT=$(git --no-pager diff --name-only origin/${BASE} | grep "${FILE_USE_BASE}" || true)
[[ ! -z "${OUT}" ]] && git checkout origin/${BASE} -- ${FILE_USE_BASE} && \
git commit -s -am "Auto-merge use submodule in BASE ref"
# Use commits from HEAD, but keek submodule files(FILE_USE_BASE) from BASE
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: HEAD is confusing given that it also used for the tip of the branch

Suggested change
# Use commits from HEAD, but keek submodule files(FILE_USE_BASE) from BASE
# Sync the $BASE branch using commits from the $HEAD branch except for the paths
# defined as $FILE_USE_BASE (under ./thirdparty)

Copy link
Collaborator

@NvTimLiu NvTimLiu Apr 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let me follow it up and the typo in the comments here : #1954

@gerashegalov gerashegalov merged commit 98f3432 into NVIDIA:branch-24.04 Apr 10, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] auto-merge between branches should not merge pinned cudf dependency versions
4 participants