Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up IO PreCommit build configs #29097

Merged
merged 1 commit into from
Oct 20, 2023
Merged

Conversation

Abacn
Copy link
Contributor

@Abacn Abacn commented Oct 20, 2023

  • Fix ResearchResponse precommit build target
  • Add rrio build target to generic IO precommit
  • Disable google-ads io precommit in Jenkins as GHA is added
    * Simplify trigger path for Java PreCommit to exclude sdks/io folder, which covered by either specific IO PreCommit for generic IO PreCommit (:javaioPreCommit)

Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@Abacn
Copy link
Contributor Author

Abacn commented Oct 20, 2023

R: @damondouglas for rrio
R: @volatilemolotov for GHA

@Abacn Abacn marked this pull request as ready for review October 20, 2023 18:36
@github-actions
Copy link
Contributor

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

@Abacn Abacn force-pushed the cleanupiobuildconfig branch from 01c4148 to 71fbeeb Compare October 20, 2023 18:40
@Abacn Abacn marked this pull request as draft October 20, 2023 18:41
@Abacn Abacn force-pushed the cleanupiobuildconfig branch from 71fbeeb to 78fb0bb Compare October 20, 2023 18:54
@@ -294,7 +294,6 @@ tasks.register("javaPreCommit") {
dependsOn(":sdks:java:fn-execution:build")
dependsOn(":sdks:java:harness:build")
dependsOn(":sdks:java:harness:jmh:build")
dependsOn(":sdks:java:io:azure:build")
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is already covered by beam_PreCommit_Java_Azure_IO_Direct that triggers for common trigger paths (e.g. java/core) so remove it from here.

@@ -294,7 +294,6 @@ tasks.register("javaPreCommit") {
dependsOn(":sdks:java:fn-execution:build")
dependsOn(":sdks:java:harness:build")
dependsOn(":sdks:java:harness:jmh:build")
dependsOn(":sdks:java:io:azure:build")
dependsOn(":sdks:java:io:bigquery-io-perf-tests:build")
dependsOn(":sdks:java:io:common:build")
dependsOn(":sdks:java:io:contextualtextio:build")
Copy link
Contributor Author

@Abacn Abacn Oct 20, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there are still a couple of IO tests triggered in the large java precommit. Checked that these are not belong to specific IO PreCommit. We should move them / create new precommits as a follow up.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this kind of bookkeeping is desirable because for now, if adding an IO connector, there is too much places to configure the test tasks and its possible to miss some of them (already happened)

@Abacn Abacn marked this pull request as ready for review October 20, 2023 18:57
@Abacn
Copy link
Contributor Author

Abacn commented Oct 20, 2023

Reduced scope. Ready for review now. R: @damondouglas this should make RRIO PreCommit working/

Copy link
Contributor

@damondouglas damondouglas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thank you.

@Abacn Abacn merged commit b85c40b into apache:master Oct 20, 2023
5 checks passed
@Abacn Abacn deleted the cleanupiobuildconfig branch October 20, 2023 19:06
kkdoon pushed a commit to twitter-forks/beam that referenced this pull request Oct 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants