Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorganize GitHub workflows. #118

Merged
merged 10 commits into from
Sep 16, 2022

Conversation

Yury-Fridlyand
Copy link

@Yury-Fridlyand Yury-Fridlyand commented Sep 14, 2022

Signed-off-by: Yury-Fridlyand [email protected]

Description

  • Remove obsolete workflows, mostly related to releasing ODFE artifacts.
  • Activate forgotten workflow (codeql).
  • Update actions in rest workflows.
  • Limit workflow scopes:
    • Reduce file scope, for example, JDBC workflow will be triggered on JDBC changes only.
    • Reduce action scope, so workflows shouldn't be triggered twice on PR.
  • Workbench and SQL plugin workflows updated to always upload test reports
  • Strictly define environment versions to avoid unexpected failures when they upgraded

Issues Resolved

  • JDBC/ODBC workflow won't be triggered on SQL plugin fixes and updates.
  • Workflows shouldn't be triggered twice in PRs anymore.
  • Cleanup.

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

* Remove obsoleve workflows, mostly related to releaseing ODFE artifacts.
* Update actions in rest workflows.
* Limit workflow scopes:
  * Reduce file scope, for example, JDBC workflow will be triggered on JDBC changes only.
  * Reduce action scope, so workflows shouldn't be triggered twice on PR.

Signed-off-by: Yury-Fridlyand <[email protected]>
@codecov

This comment was marked as spam.

.github/workflows/codeql-analysis.yml Outdated Show resolved Hide resolved
.github/workflows/draft-release-notes-workflow.yml Outdated Show resolved Hide resolved
.github/workflows/link-checker.yml Outdated Show resolved Hide resolved
.github/workflows/sql-cli-test-and-build-workflow.yml Outdated Show resolved Hide resolved
.github/workflows/sql-odbc-main.yml Show resolved Hide resolved
.github/workflows/sql-odbc-main.yml Show resolved Hide resolved
.github/workflows/sql-odbc-main.yml Show resolved Hide resolved
Signed-off-by: Yury-Fridlyand <[email protected]>

Co-authored-by: Andrew Carbonetto <[email protected]>
.github/workflows/codeql-analysis.yml Outdated Show resolved Hide resolved
.github/workflows/link-checker.yml Outdated Show resolved Hide resolved
# tests are designed to run against http://localhost:9200, so we have to disable/remove security plugin
- name: Download and run OpenSearch
run: |
wget -q https://artifacts.opensearch.org/releases/bundle/opensearch/2.2.1/opensearch-2.2.1-linux-x64.tar.gz

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this use docker instead of downloading artifacts? IIRC there's a parameter there as well to turn off security.

At the very least, I'd like to see this parameterized by OpenSearch version.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For using docker we need to store somewhere a custom docker-compose file.
I will add parametrized version, thank you.

Copy link

@MaxKsyunz MaxKsyunz Sep 15, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does it need to customize? I thought this workflow needed an instance of opensearch to run test against.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, right, my bad! Going to fix this

@MaxKsyunz MaxKsyunz self-requested a review September 15, 2022 19:04
@MaxKsyunz MaxKsyunz self-requested a review September 15, 2022 20:09
@@ -9,7 +11,7 @@ on:

jobs:
build:
runs-on: ubuntu-latest

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why did we need to switch it off of ubuntu-latest?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To avoid any possible troubles when ubuntu-latest would be upgraded. See discussion thread there: #118 (comment).

with:
name: opensearch-sql
path: opensearch-sql-builds

- name: Upload test reports

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😂

@Yury-Fridlyand Yury-Fridlyand merged commit acb9fcc into integ-reorganize-workflows Sep 16, 2022
@Yury-Fridlyand Yury-Fridlyand deleted the dev-reorganize-workflows branch September 16, 2022 21:16
@Yury-Fridlyand Yury-Fridlyand mentioned this pull request Sep 18, 2022
6 tasks
MitchellGale pushed a commit that referenced this pull request Oct 3, 2022
**Reorganize GitHub workflows:**

* Remove obsoleve workflows, mostly related to releaseing ODFE artifacts.
* Update actions in rest workflows.
* Limit workflow scopes:
  * Reduce file scope, for example, JDBC workflow will be triggered on JDBC changes only.
  * Reduce action scope, so workflows shouldn't be triggered twice on PR.
* Strictly define env version to avoid unexpected failures.
* Upload test reports for SQL plugin workflow.
* Activate tests for SQL CLI.

Signed-off-by: Yury-Fridlyand <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants