Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Python 3.12 support #30828

Merged
merged 9 commits into from
May 23, 2024
Merged

Add Python 3.12 support #30828

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
0e075b6
Define Python 3.12 test environments in tox.
tvalentyn May 8, 2024
a0e950b
Add a tox suite for Py312.
tvalentyn May 9, 2024
7e10270
Gradle definitions for Python 3.12
tvalentyn May 16, 2024
ddb4e7f
Switch Py3.11 Gradle suites to use Python 3.12.
tvalentyn May 16, 2024
dac22e3
Switch remaining GHA workflows to test Python 3.12.
tvalentyn May 16, 2024
d12c628
Explicitly install now-optional setuptools package as some tests depe…
tvalentyn May 22, 2024
6486591
Build Python 3.12 wheels.
tvalentyn May 16, 2024
42c8482
Support Python 3.12 in Dataflow.
tvalentyn May 16, 2024
ab460c1
Support Python 3.12 in Beam.
tvalentyn May 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ jobs:
matrix:
job_name: [beam_PostCommit_Python]
job_phrase: [Run Python PostCommit]
python_version: ['3.8', '3.9', '3.10', '3.11']
python_version: ['3.8', '3.9', '3.10', '3.11', '3.12']
if: |
github.event_name == 'workflow_dispatch' ||
github.event_name == 'pull_request_target' ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Arm.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: [beam_PostCommit_Python_Arm]
job_phrase: [Run Python PostCommit Arm]
python_version: ['3.8', '3.9', '3.10', '3.11']
python_version: ['3.8', '3.9', '3.10', '3.11', '3.12']
if: |
github.event_name == 'workflow_dispatch' ||
github.event_name == 'pull_request_target' ||
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_Python_Examples_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,14 +74,14 @@ jobs:
uses: ./.github/actions/setup-environment-action
with:
java-version: default
python-version: 3.11
python-version: 3.12
- name: Run examplesPostCommit script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
gradle-command: :sdks:python:test-suites:dataflow:examplesPostCommit
arguments: |
-PuseWheelDistribution \
-PpythonVersion=3.11 \
-PpythonVersion=3.12 \
- name: Archive Python Test Results
uses: actions/upload-artifact@v4
if: failure()
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Examples_Direct.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_Examples_Direct"]
job_phrase: ["Run Python Examples_Direct"]
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Examples_Flink.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_Examples_Flink"]
job_phrase: ["Run Python Examples_Flink"]
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Examples_Spark.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_Examples_Spark"]
job_phrase: ["Run Python Examples_Spark"]
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/beam_PostCommit_Python_MongoDBIO_IT.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,13 +74,13 @@ jobs:
uses: ./.github/actions/setup-environment-action
with:
java-version: default
python-version: 3.11
python-version: 3.12
- name: Run mongodbioIT script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
gradle-command: :sdks:python:test-suites:direct:py311:mongodbioIT
gradle-command: :sdks:python:test-suites:direct:py312:mongodbioIT
arguments: |
-PpythonVersion=3.11 \
-PpythonVersion=3.12 \
- name: Archive Python Test Results
uses: actions/upload-artifact@v4
if: failure()
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_ValidatesContainer_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_ValidatesContainer_Dataflow"]
job_phrase: ["Run Python Dataflow ValidatesContainer"]
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_ValidatesContainer_Dataflow_With_RC.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_ValidatesContainer_Dataflow_With_RC"]
job_phrase: ["Run Python RC Dataflow ValidatesContainer"]
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_ValidatesRunner_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_ValidatesRunner_Dataflow"]
job_phrase: ["Run Python Dataflow ValidatesRunner"]
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_ValidatesRunner_Flink.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_ValidatesRunner_Flink"]
job_phrase: ["Run Python Flink ValidatesRunner"]
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_ValidatesRunner_Samza.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_ValidatesRunner_Samza"]
job_phrase: ["Run Python Samza ValidatesRunner"]
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_ValidatesRunner_Spark.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_Python_ValidatesRunner_Spark"]
job_phrase: ["Run Python Spark ValidatesRunner"]
python_version: ['3.8', '3.9', '3.11']
python_version: ['3.8', '3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ jobs:
with:
python-version: |
3.8
3.11
3.12
- name: run PostCommit Python Xlang Gcp Dataflow script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Xlang_Gcp_Direct.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ jobs:
with:
python-version: |
3.8
3.11
3.12
- name: run PostCommit Python Xlang Gcp Direct script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Python_Xlang_IO_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ jobs:
with:
python-version: |
3.8
3.11
3.12
- name: run PostCommit Python Xlang IO Dataflow script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PostCommit_Sickbay_Python.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ jobs:
job_name: [beam_PostCommit_Sickbay_Python]
job_phrase_1: [Run Python]
job_phrase_2: [PostCommit Sickbay]
python_version: ['3.8', '3.9', '3.10', '3.11']
python_version: ['3.8', '3.9', '3.10', '3.11', '3.12']
if: |
github.event_name == 'workflow_dispatch' ||
github.event_name == 'pull_request_target' ||
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_TransformService_Direct.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_TransformService_Direct"]
job_phrase: ["Run TransformService_Direct PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -77,7 +77,7 @@ jobs:
java-version: 11
python-version: |
3.8
3.11
${{ matrix.python_version }}
damccorm marked this conversation as resolved.
Show resolved Hide resolved
- name: run TransformService Direct script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_Direct.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_XVR_Direct"]
job_phrase: ["Run XVR_Direct PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -76,7 +76,7 @@ jobs:
with:
python-version: |
3.8
3.11
${{ matrix.python_version }}
- name: run PostCommit XVR Direct script
env:
CLOUDSDK_CONFIG: ${{ env.KUBELET_GCLOUD_CONFIG_PATH}}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_Flink.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_XVR_Flink"]
job_phrase: ["Run XVR_Flink PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -77,7 +77,7 @@ jobs:
with:
python-version: |
3.8
3.11
${{ matrix.python_version }}
- name: run PostCommit XVR Flink script
env:
CLOUDSDK_CONFIG: ${{ env.KUBELET_GCLOUD_CONFIG_PATH}}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_JavaUsingPython_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_XVR_JavaUsingPython_Dataflow"]
job_phrase: ["Run XVR_JavaUsingPython_Dataflow PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -76,7 +76,7 @@ jobs:
with:
python-version: |
3.8
3.11
${{ matrix.python_version }}
- name: run PostCommit XVR JavaUsingPython Dataflow script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,13 +73,13 @@ jobs:
- name: Setup environment
uses: ./.github/actions/setup-environment-action
with:
python-version: 3.11
python-version: 3.12
- name: run PostCommit XVR PythonUsingJavaSQL Dataflow script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
gradle-command: :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
arguments: |
-PpythonVersion=3.11 \
-PpythonVersion=3.12 \
- name: Archive Python Test Results
uses: actions/upload-artifact@v4
if: failure()
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_PythonUsingJava_Dataflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_XVR_PythonUsingJava_Dataflow"]
job_phrase: ["Run XVR_PythonUsingJava_Dataflow PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -76,7 +76,7 @@ jobs:
with:
python-version: |
3.8
3.11
${{ matrix.python_version }}
- name: run PostCommit XVR PythonUsingJava Dataflow script
uses: ./.github/actions/gradle-command-self-hosted-action
with:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_Samza.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_XVR_Samza"]
job_phrase: ["Run XVR_Samza PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -76,7 +76,7 @@ jobs:
with:
python-version: |
3.8
3.11
${{ matrix.python_version }}
- name: run PostCommit XVR Samza script
env:
CLOUDSDK_CONFIG: ${{ env.KUBELET_GCLOUD_CONFIG_PATH}}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PostCommit_XVR_Spark3.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ jobs:
matrix:
job_name: ["beam_PostCommit_XVR_Spark3"]
job_phrase: ["Run XVR_Spark3 PostCommit"]
python_version: ['3.8','3.11']
python_version: ['3.8','3.12']
steps:
- uses: actions/checkout@v4
- name: Setup repository
Expand All @@ -76,7 +76,7 @@ jobs:
with:
python-version: |
3.8
3.11
${{ matrix.python_version }}
- name: run PostCommit XVR Spark3 script
env:
CLOUDSDK_CONFIG: ${{ env.KUBELET_GCLOUD_CONFIG_PATH}}
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PreCommit_Portable_Python.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ jobs:
matrix:
job_name: ['beam_PreCommit_Portable_Python']
job_phrase: ['Run Portable_Python PreCommit']
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PreCommit_Python.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ jobs:
matrix:
job_name: ['beam_PreCommit_Python']
job_phrase: ['Run Python PreCommit']
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/beam_PreCommit_PythonDocker.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,9 +64,9 @@ jobs:
matrix:
job_name: ["beam_PreCommit_PythonDocker"]
job_phrase: ["Run PythonDocker PreCommit"]
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
github.event_name == 'workflow_dispatch' ||
(github.event_name == 'schedule' && github.repository == 'apache/beam') ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PreCommit_Python_Dataframes.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ jobs:
matrix:
job_name: ['beam_PreCommit_Python_Dataframes']
job_phrase: ['Run Python_Dataframes PreCommit']
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PreCommit_Python_Examples.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ jobs:
matrix:
job_name: ['beam_PreCommit_Python_Examples']
job_phrase: ['Run Python_Examples PreCommit']
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PreCommit_Python_Integration.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ jobs:
matrix:
job_name: ['beam_PreCommit_Python_Integration']
job_phrase: ['Run Python_Integration PreCommit']
python_version: ['3.8', '3.11']
python_version: ['3.8', '3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/beam_PreCommit_Python_ML.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ jobs:
matrix:
job_name: ['beam_PreCommit_Python_ML']
job_phrase: ['Run Python_ML PreCommit']
python_version: ['3.8','3.9','3.10','3.11']
python_version: ['3.8','3.9','3.10','3.11','3.12']
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
Expand Down
Loading
Loading