Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Properly handle dask change #3361

Conversation

jnke2016
Copy link
Contributor

A dask breaking change updates the way a worker is passed into the distributed function causing all the MG tests to fail.
This PR properly handles the change and also removes the temporary raft PR pinned in the ci shell script.

@jnke2016 jnke2016 requested review from a team as code owners March 24, 2023 12:41
@alexbarghi-nv alexbarghi-nv added bug Something isn't working non-breaking Non-breaking change labels Mar 24, 2023
@alexbarghi-nv alexbarghi-nv added this to the 23.04 milestone Mar 24, 2023
Copy link
Member

@alexbarghi-nv alexbarghi-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine to me, will also need ops approval.

Copy link
Member

@ajschmidt8 ajschmidt8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approved.

thanks for removing the raft changes.

they shouldn't have been merged.

i left a comment about it here: https://github.com/rapidsai/cugraph/pull/3348/files#r1147661079

@alexbarghi-nv
Copy link
Member

/merge

@rapids-bot rapids-bot bot merged commit 54d997b into rapidsai:branch-23.04 Mar 24, 2023
rapids-bot bot pushed a commit that referenced this pull request Mar 28, 2023
A Dask PR which was merged last week changed the way workers are retrieved from client calls. This [PR](#3361) assumed that the worker could be retrieve through `get_client()` and since the Dask version was pinned in RAFT to no break CI, it temporarily worked. But after the `dask `version was unpinned, this resulted in the issue this PR is closing. 

This PR leverages the `dask_worker` input argument which is populated with the worker when calling `client.run`.

closes #3378

Authors:
  - Joseph Nke (https://github.com/jnke2016)

Approvers:
  - Rick Ratzel (https://github.com/rlratzel)
  - Brad Rees (https://github.com/BradReesWork)

URL: #3379
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants