Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dask-cuda v23.4.0 #21

Merged
merged 3 commits into from
Apr 18, 2023

Conversation

regro-cf-autotick-bot
Copy link
Contributor

It is very likely that the current package version for this feedstock is out of date.

Checklist before merging this PR:

  • Dependencies have been updated if changed: see upstream
  • Tests have passed
  • Updated license if changed and license_file is packaged

Information about this PR:

  1. Feel free to push to the bot's branch to update this PR if needed.
  2. The bot will almost always only open one PR per version.
  3. The bot will stop issuing PRs if more than 3 version bump PRs generated by the bot are open. If you don't want to package a particular version please close the PR.
  4. If you want these PRs to be merged automatically, make an issue with @conda-forge-admin,please add bot automerge in the title and merge the resulting PR. This command will add our bot automerge feature to your feedstock.
  5. If this PR was opened in error or needs to be updated please add the bot-rerun label to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase @conda-forge-admin, please rerun bot in a PR comment to have the conda-forge-admin add it for you.

Dependency Analysis

Please note that this analysis is highly experimental. The aim here is to make maintenance easier by inspecting the package's dependencies. Importantly this analysis does not support optional dependencies, please double check those before making changes. If you do not want hinting of this kind ever please add bot: inspection: false to your conda-forge.yml. If you encounter issues with this feature please ping the bot team conda-forge/bot.

Analysis by grayskull shows a discrepancy between it and the the package's stated requirements in the meta.yaml.

Packages found by grayskull but not in the meta.yaml:

  • distributed ==2023.3.2.1
  • pandas >=1.3,<1.6.0dev0
  • dask-core ==2023.3.2
  • numpy >=1.21

Packages found in the meta.yaml but not found by grayskull:

  • dask ==2023.1.1
  • distributed ==2023.1.1
  • __linux
  • dask-core ==2023.1.1
  • pandas >=1.0
  • numpy >=1.18.0

This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/4683270585, please use this URL for debugging.

@conda-forge-webservices
Copy link
Contributor

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

- pandas >=1.0
- pandas >=1.3,<1.6.0dev0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We may need a repodata hot-fix to add this to old versions

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a relevant issue to link to on why we're doing this? I see rapidsai/dask-cuda#1139 is where the max version constraint got introduced, but isn't clear to me if newer pandas versions were causing problems for older dask-cuda versions

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like the upper bound on Pandas in RAPIDS has been around for a while. When upgrading to Pandas 1.5, the pinning was bumped to this upper bound ( rapidsai/integration#534 )

That said, I don't why Dask-CUDA needs the Pandas pin necessarily

Maybe one explanation is RAPIDS isn't compatible with Pandas 2.0 and needs an upper bound in multiple libraries?

cc @galipremsagar (in case you have more insight 🙂)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have been maintaining the same upper bounds across RAPIDS to make it easier to maintain and debug any conda issues. However I don't think we have tested dask-cuda with pandas-2.0 yet because we are still adding pandas-2.0 support in cudf, so only once we change the upper bound at cudf we should be able to test it in dask-cuda. I say we keep the pinnings consistent across RAPIDS for now and about applying the repodata hot-fix to older versions, we might not need it because cudf bring in that tight pinning. However, if you both feel it's trivial to fix it I'm okay with it aswell.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the context 🙂 I'm interested in if there are specific use cases for dask-cuda that don't involve cuDF where we might be able to get away with leaving this dependency unpinned (maybe @pentschev has some thoughts?), but if those cases don't exist / we aren't testing against them agree that pinning away from pandas 2.0 is best for now.

I can open a PR applying the repodata hot-fix and we can continue discussion there - not sure if we would get some pushback since my understanding is that the repodata patches are mostly to prevent explicit failures, but I know in the past we've done stuff like this for the dask-cuda package.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arguably, for RAPIDS we should keep the pin that works with the rest of RAPIDS. However, this is the conda-forge package that gets used by the non-RAPIDS users from the community, for example, CuPy-based workflows. In here, I believe it makes sense that we follow the pins that the rest of Dask/Distributed use. Can we unpin pandas only here, while keeping the packages in rapidsai/rapidsai-nightly consistent with the remaining of RAPIDS?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Think that would cause issues at least for this release, as my understanding is that this pinning is getting pulled from the pyproject.toml:

https://github.com/rapidsai/dask-cuda/blob/590d26ab4d61b785789ee6bacae29c37337e6703/pyproject.toml#L27

So my understanding is that even if we did pull pandas 2 with this package, it would throw an error due to the mismatch in expected/actual versions.

If we wanted to have separate pinnings for pandas between the conda-forge and RAPIDS package, I think we would need the pyproject pinning to ideally be the looser of the two pinnings?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We discussed offline, and since we don't currently test against pandas 2.0 it's probably best for now to keep the pin. If some user requests this change then we can review this decision. In any case, the plan is to have support for pandas 2.0 around August, for RAPIDS 23.08.

@jakirkham jakirkham added the automerge Merge the PR when CI passes label Apr 12, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Apr 12, 2023

Hi! This is the friendly conda-forge automerge bot!

I considered the following status checks when analyzing this PR:

  • linter: passed
  • azure: passed

Thus the PR was passing and merged! Have a great day!

@jakirkham
Copy link
Member

@charlesbluca, could you please take a look at this one?

Guessing this is related to distributed version 2023.3.2.1 ( conda-forge/distributed-feedstock#248 )

recipe/meta.yaml Outdated Show resolved Hide resolved
@jakirkham
Copy link
Member

IIUC the discussion above, it sounds like we are ok to merge this. Is that correct?

@charlesbluca
Copy link
Member

Yup, and conda-forge/conda-forge-repodata-patches-feedstock#437 should address the follow up repodata hotfix

Co-authored-by: Charles Blackmon-Luca <[email protected]>
@github-actions github-actions bot removed the automerge Merge the PR when CI passes label Apr 18, 2023
@github-actions
Copy link
Contributor

Hi! This is the friendly conda-forge automerge bot!

Commits were made to this PR after the automerge label was added. For security reasons, I have disabled automerge by removing the automerge label. Please add the automerge label again (or ask a maintainer to do so) if you'd like to enable automerge again!

@jakirkham jakirkham added the automerge Merge the PR when CI passes label Apr 18, 2023
@github-actions github-actions bot merged commit 85a610f into conda-forge:main Apr 18, 2023
@regro-cf-autotick-bot regro-cf-autotick-bot deleted the 23.4.0_h009f74 branch April 18, 2023 00:34
@jakirkham
Copy link
Member

Thanks all! 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automerge Merge the PR when CI passes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants