Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The "upgrade-on-failure" feature enabled by default in local environment #37116

Merged

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Jan 31, 2024

We have the --upgrade-on-failure flag that was used to automatically upgrade image when constraint build failed. This happens when there is a conflicting change merged, but the CI build has not managed yet to refresh the constraints (which sometime might take some time due to stability of our CI infrastructure - any intermittent failures in tests might delay constraint refreshing).

What happens in this case, locally when you build image you would get dependency conflict.

This PR flips the flag in local environmment in two cases:

  • when you run breeze ci-image build manually
  • when you run CI image build automatically while running other command

On CI we want to keep control over constraint use, so the flag default is set to False in CI environment


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

We have the `--upgrade-on-failure` flag that was used to automatically
upgrade image when constraint build failed. This happens when there is
a conflicting change merged, but the CI build has not managed yet to
refresh the constraints (which sometime might take some time due
to stability of our CI infrastructure - any intermittent failures in
tests might delay constraint refreshing).

What happens in this case, locally when you build image you would
get dependency conflict.

This PR flips the flag in local environmment in two cases:

* when you run `breeze ci-image build` manually
* when you run CI image build automatically while running other command

On CI we want to keep control over constraint use, so the flag default
is set to False in CI environment
@potiuk potiuk force-pushed the upgrade-depenendencies-on-failure-enabled-by-default branch from 1f44ced to 925f923 Compare January 31, 2024 09:08
@potiuk potiuk merged commit a0f8a00 into apache:main Jan 31, 2024
80 of 82 checks passed
@potiuk potiuk deleted the upgrade-depenendencies-on-failure-enabled-by-default branch January 31, 2024 11:26
potiuk added a commit that referenced this pull request Feb 7, 2024
…ent (#37116)

* The "upgrade-on-failure" feature enabled by default in local environment

We have the `--upgrade-on-failure` flag that was used to automatically
upgrade image when constraint build failed. This happens when there is
a conflicting change merged, but the CI build has not managed yet to
refresh the constraints (which sometime might take some time due
to stability of our CI infrastructure - any intermittent failures in
tests might delay constraint refreshing).

What happens in this case, locally when you build image you would
get dependency conflict.

This PR flips the flag in local environmment in two cases:

* when you run `breeze ci-image build` manually
* when you run CI image build automatically while running other command

On CI we want to keep control over constraint use, so the flag default
is set to False in CI environment

* Update dev/breeze/src/airflow_breeze/commands/ci_image_commands.py

Co-authored-by: Andrey Anshin <[email protected]>

---------

Co-authored-by: Andrey Anshin <[email protected]>
(cherry picked from commit a0f8a00)
@potiuk potiuk added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Feb 8, 2024
@potiuk potiuk added this to the Airflow 2.8.2 milestone Feb 8, 2024
ephraimbuddy pushed a commit that referenced this pull request Feb 22, 2024
…ent (#37116)

* The "upgrade-on-failure" feature enabled by default in local environment

We have the `--upgrade-on-failure` flag that was used to automatically
upgrade image when constraint build failed. This happens when there is
a conflicting change merged, but the CI build has not managed yet to
refresh the constraints (which sometime might take some time due
to stability of our CI infrastructure - any intermittent failures in
tests might delay constraint refreshing).

What happens in this case, locally when you build image you would
get dependency conflict.

This PR flips the flag in local environmment in two cases:

* when you run `breeze ci-image build` manually
* when you run CI image build automatically while running other command

On CI we want to keep control over constraint use, so the flag default
is set to False in CI environment

* Update dev/breeze/src/airflow_breeze/commands/ci_image_commands.py

Co-authored-by: Andrey Anshin <[email protected]>

---------

Co-authored-by: Andrey Anshin <[email protected]>
(cherry picked from commit a0f8a00)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:dev-tools changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants