[Feature] Core: Python 3.11 wheel

[austinnichols101]

Description

Add support for Ray with python 3.11.

Python 3.11.0rc1 release 2022-08-02
Official release planned for Monday 2022-10-03

Use case

ref: https://www.python.org/downloads/release/python-3110rc1/

We strongly encourage maintainers of third-party Python projects to prepare their projects for 3.11 compatibilities during this phase.

This is the first release candidate of Python 3.11
This release, 3.11.0rc1, is the penultimate release preview. Entering the release candidate phase, only reviewed code changes which are clear bug fixes are allowed between this release candidate and the final release. The second candidate and the last planned release preview is currently planned for Monday, 2022-09-05 while the official release is planned for Monday, 2022-10-03.

There will be no ABI changes from this point forward in the 3.11 series and the goal is that there will be as few code changes as possible.

[acxz]

I was planning on working on this right after #21221 is merged.

[austinnichols101]

Python 3.11.0rc2 released on 2022-09-12.

Official release planned for Monday 2022-10-24

[austinnichols101]

Python 3.11.0 released!

[zhiruiluo]

Look forward to this support.

[dss010101]

same here...

[jmakov]

Any ETA on this?

[dss010101]

#27881 (comment)

[RockStone]

hoping

[garrettwrong]

Also need this for my project to continue depending on Ray. Is there any eta? Thanks!

[cool-RR]

I'm eagerly looking forward to binaries for Python 3.11 because of this: "Python 3.11 is between 10-60% faster than Python 3.10."

This will make my research so much more productive.

[dss010101]

i hate doing this...but are there instructions for building this for 3.11 support locally on a windows 11 workstation?
seems waiting is...indeterministic

[rickyyx]

Yes, we are currently working on wheels for python3.11 (all platforms) - ETA should be by end of this year.

[csko]

I started looking at this in #31170. Looks like there are a few Cython changes and some package dependencies are not compatible with 3.11 yet.

[cool-RR]

@csko Can you please list the third-party dependencies that aren't compatible with Python 3.11?

[csko]

@csko Can you please list the third-party dependencies that aren't compatible with Python 3.11?

The most up-to-date list will be in #31170.

Currently it's llvmlite, numba, pyarrow, scikit-learn, tensorflow, torch, miniconda though not all of them are strict dependencies. There are also other packages that have 3.11 versions but they are incompatible with current ray code (such as pydantic).

[csko]

There is now an experimental Python3.11 Linux ray3.0.0 wheel file at https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp311-cp311-manylinux2014_x86_64.whl

[cool-RR]

@scv119 Why is this issue closed? I'm not seeing a Python 3.11 wheel on PyPI.

[hauntsaninja]

svc119 mentioned that the current plan is to have 3.11 experimental wheels for 2.3 release / you can get nightly release wheels from here: https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp311-cp311-manylinux2014_x86_64.whl

(btw, nice to see you csko, long time no see!)

[pcmoritz]

The links are also in the master docs https://docs.ray.io/en/master/ray-overview/installation.html#daily-releases-nightlies, which will become the "latest" docs when 2.3 is released :)

[cool-RR]

Any timeframe on the 2.3 release? Ideally I would want to have the upgrade to Python 3.11 separate from the upgrade to Ray 2.3.

[pcmoritz]

We are roughly targeting mid Feb :)

[hauntsaninja]

2.3 is out!

[HansvanHespen]

Still no version of ray available for Windows 11 Python3.11? I see a lot of comments around january that one is working on it, but in the end I can't find it. I read somewhere that the windows 11 version is still experimental, but I couldn't find that experimental version either. Somebody a clue?

I'm blocked now, since I want to use gpt-2 of Huggingface, which needs runhouse, which needs ray. I cannot go back to python3.10 because then other things are not compatible, and the same goes for Windows 11.

Windows 11 was released in Oct 2011, that's about two years ago, Python3.11 in oct 2022, that's also 9 months ago.

Any chance for a solution here?

High regards,

Hans

[fehrin1]

Hi, why is this issue closed when there are still no Python 3.11 wheels for Windows? Any idea when this is going to happen?

[dss010101]

Hi, why is this issue closed when there are still no Python 3.11 wheels for Windows? Any idea when this is going to happen?

because of general lack of support for Windows (windows in general seems to be treated as 2nd class citizen in open source projects)..i've converted my projects to run in a linux environment using docker desktop..and created a dev-container to develop in using vscode. It may be a solution to deal w/ this frustration you are encountering...

[austinnichols101]

"windows + python = pain"

[rickyyx]

We will be shipping windows 3.11 wheels in the coming release of 2.6

It was blocked by some CI dependency we had which recently supported 3.11. Down the road, we are optimizing the set of dependencies we rely on so we could get support for new python versions ASAP.

[nrudakov]

Windows wheel can't be installed in Python 3.11

[rickyyx]

Windows wheel can't be installed in Python 3.11

Hi @nrudakov - could you provide a bit more in your env setup and ray version? And what's the error message?

[nrudakov]

Windows wheel can't be installed in Python 3.11

Hi @nrudakov - could you provide a bit more in your env setup and ray version? And what's the error message?

@rickyyx I have opened an issue here #38300