Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: move remaining Cypress tests behind GH label #174523

Merged
merged 8 commits into from
Jan 17, 2024
Merged

Conversation

watson
Copy link
Contributor

@watson watson commented Jan 9, 2024

This PR moves the remaining Security Solution Cypress tests behind the GitHub flag ci:all-cypress-suites. This is a follow-up to #173815.

@watson watson added release_note:skip Skip the PR/issue when compiling release notes backport:skip This commit does not require backporting ci:all-cypress-suites labels Jan 9, 2024
@watson
Copy link
Contributor Author

watson commented Jan 9, 2024

/ci

@watson
Copy link
Contributor Author

watson commented Jan 11, 2024

/ci

@yngrdyn
Copy link
Contributor

yngrdyn commented Jan 11, 2024

/ci

@patrykkopycinski
Copy link
Contributor

@yngrdyn
Copy link
Contributor

yngrdyn commented Jan 12, 2024

/ci

Copy link
Contributor

@PhilippeOberti PhilippeOberti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@watson sorry for getting back to this so late. I not super familiar with how the paths should be done, so I left a few comments to add what the code is referring to.

Comment on lines 270 to 274
/^package.json/,
/^packages\/kbn-securitysolution-.*/,
/^x-pack\/plugins\/threat_intelligence/,
/^x-pack\/packages\/security-solution/,
/^x-pack\/test\/security_solution_cypress/,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/^x-pack\/test\/security_solution_cypress/
should be replaced by
/^x-pack\/test\/threat_intelligence_cypress/

Currently all the Cypress tests haven’t been migrated to the x-pack/test folder are still in the x-pack/plugins/threat_intelligence folder unfortunately.
I had started to migrated things over before the holidays (actually I was trying to merge them within the security_solution_cypress folder directly for simplicity and code reusability) but we had to jump on reducing flakiness instead. Not sure when I’ll have the time to get back to that…

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, looking at the code, here are a few that I think we should add

other x-pack plugins:

  • /x-pack\/plugins\/cases/
  • /x-pack\/plugins\/timelines/
  • /x-pack\/plugins\/triggers_actions_ui/
  • /x-pack\/plugins\/rule_registry/

other packages:

  • /packages\/kbn-es-query/
  • /packages\/kbn-securitysolution-io-ts-list-types/
  • /packages\/kbn-i18n-react/
  • /packages\/kbn-i18n/
  • /packages\/shared-ux/
  • /packages\/kbn-doc-links/
  • /packages\/kbn-securitysolution-io-ts-list-types/

other src plugins:

  • /src\/plugins\/data/
  • /src\/plugins\/kibana_utils/
  • /src\/plugins\/inspector/
  • /src\/plugins\/data_views/
  • /src\/core/

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done 👍

@watson watson marked this pull request as ready for review January 15, 2024 09:11
@watson watson requested a review from a team as a code owner January 15, 2024 09:11
@watson
Copy link
Contributor Author

watson commented Jan 15, 2024

@patrykkopycinski I copied over the old paths regexes from as you suggested. I had to change the following line because the file didn't exist (it actually didn't exist in the old code either, so I'm not sure what was going on):

-^x-pack\/plugins\/triggers_actions_ui\/public\/application\/context\/actions_connectors_context\.tsx/,
+^x-pack\/plugins\/triggers_actions_ui\/public\/application\/context\/connectors_context\.tsx/,

There is a file in that directory with almost the same name (connectors_context.tsx), so I changed it to that, but I'm not sure if that was the original intent 🤷

@kibana-ci
Copy link
Collaborator

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] Detection Engine - Exceptions - Security Solution Cypress Tests #1 / Exceptions match_any "before all" hook for "Creates exception item" "before all" hook for "Creates exception item"

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Copy link
Contributor

@PhilippeOberti PhilippeOberti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for updating the list of paths, LGTM now @watson

@watson watson merged commit 3dc5d2e into elastic:main Jan 17, 2024
51 checks passed
@watson watson deleted the move-cypress branch January 17, 2024 10:02
CoenWarmer pushed a commit to CoenWarmer/kibana that referenced this pull request Feb 15, 2024
Move the remaining Security Solution Cypress tests behind the
GitHub flag `ci:all-cypress-suites`. This is a follow-up to PR elastic#173815.

---------

Co-authored-by: Yngrid Coello <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting ci:all-cypress-suites release_note:skip Skip the PR/issue when compiling release notes v8.13.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants