Upload nightly wheels to scientific-python-nightly-wheels

[martinfleis]

Closes #7863

Xarray is considered one of the core projects of the Scientific Python. As such, it would be ideal if it followed upcoming SPEC5 by building the nightly wheels. We're aware that xarray is easy to build from source but other core packages like scipy or numpy are not and we would like to ensure that all of those nightly builds can be installed in the same way to make the test against dev versions easier for downstream packages.

This PR adds a GHA job that builds the wheel and uses scientific-python/upload-nightly-action to upload them to a new location where eventually all the other projects will upload wheels as well.

You will need an upload token stored as a repository secret ANACONDA_NIGHTLY. I will need someone with the proper rights to reply here and I can either give you access to the scientific-python-nightly-wheels anaconda.org group where you can generate the token for yourself (see the readme at https://github.com/scientific-python/upload-nightly-action) or I can generate one for you but it would be better if you had a control of the token yourself as it will expire at some point.

[welcome]

Thank you for opening this pull request! It may take us a few days to respond here, so thank you for being patient.
If you have questions, some answers may be found in our contributing guidelines.

[keewis]

There's a few changes necessary, but otherwise looks good to me.

I will need someone with the proper rights to reply here

I'll help setting that up, but I wonder if it is possible to sign up multiple people? Like with PyPI project owners, I imagine having multiple people with those permissions would make the setup a bit more resilient.

Edit: important for us: retire the TestPyPI workflow once this has been verified to work properly. That will reduce the frequency of nightly releases from one for every commit to once per day, but I don't think that makes too much of a difference (and we fill up our TestPyPI disk space too much – for reference, we're currently at 1.7GB out of 10GB total within about a year of the workflow's existence).

[martinfleis]

I'll help setting that up, but I wonder if it is possible to sign up multiple people?

We can add as many people as you'd like. They just need an account on anaconda.org. Do you have an account there so I can add you? You can then add other as you'll need.

[martinfleis]

Do we need to build the wheel in the same way you currently do in https://github.com/pydata/xarray/blob/main/.github/workflows/testpypi-release.yaml? I used the building workflow from the PyPI release but I just noticed that you do it a bit differently when pushing to TestPyPI.

[keewis]

Do we need to build the wheel in the same way you currently do in [the TestPyPI workflow]

depends on whether we can put local versions on anaconda. PyPI and TestPyPI don't allow that, so we had to modify pyproject.toml to make setuptools-scm generate versions without the local part.

Do you have an account there so I can add you?

now I do, the username is the same as on github.

obsolete

[martinfleis]

depends on whether we can put local versions on anaconda

Seems okay -> https://anaconda.org/scientific-python-nightly-wheels/xarray/files

now I do, the username is the same as on github.

I've added you. You should be able to generate a token at https://anaconda.org/scientific-python-nightly-wheels/settings/access with Allow write access to the API site and Allow uploads to Standard Python repositories permissions and add the token as a ANACONDA_NIGHTLY secret.

[keewis]

add the token as a ANACONDA_NIGHTLY secret.

done. Let's try it!

[welcome]

Congratulations on completing your first pull request! Welcome to Xarray! We are proud of you, and hope to see you again!

[keewis]

this appears to have worked. Thanks, @martinfleis!

[dcherian]

Thanks @martinfleis this is a very valuable contribution to the ecosystem!