Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution] Fix flakiness in: prebuilt_rules_management.cy.ts - Deletes and recovers more than one rule #164694

Merged
merged 3 commits into from
Aug 28, 2023

Conversation

jpdjere
Copy link
Contributor

@jpdjere jpdjere commented Aug 24, 2023

Relates to: #161507

Summary

  • Solves flakiness in following test:

    • Filename: x-pack/test/security_solution_cypress/cypress/e2e/detection_response/prebuilt_rules/prebuilt_rules_management.cy.ts
    • Test name: Prebuilt rules Actions with prebuilt rules Rules table Deletes and recovers more than one rule
  • Test was failing because of already observed issue of autoRefresh taking place while the rule selection is happening, causing Cypress to lose focus and preventing the checkbox from being checked. This PR disables autorefresh from the table to prevent that from happening.

Flaky test runner

350 iters: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2976 🟢

@jpdjere jpdjere requested a review from a team as a code owner August 24, 2023 12:07
@jpdjere jpdjere requested a review from nikitaindik August 24, 2023 12:07
@jpdjere
Copy link
Contributor Author

jpdjere commented Aug 24, 2023

@jpdjere jpdjere marked this pull request as draft August 24, 2023 15:35
@jpdjere jpdjere removed the request for review from nikitaindik August 24, 2023 15:35
@jpdjere jpdjere requested a review from maximpn August 25, 2023 10:03
@jpdjere jpdjere self-assigned this Aug 25, 2023
@jpdjere jpdjere added test release_note:skip Skip the PR/issue when compiling release notes Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Feature:Rule Management Security Solution Detection Rule Management area Team:Detection Rule Management Security Detection Rule Management Team v8.10.0 v8.11.0 labels Aug 25, 2023
@jpdjere jpdjere marked this pull request as ready for review August 25, 2023 10:07
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @jpdjere

Copy link
Contributor

@maximpn maximpn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jpdjere jpdjere merged commit e22f9b8 into elastic:main Aug 28, 2023
@jpdjere jpdjere deleted the flaky-prebuilt-rules-management branch August 28, 2023 11:02
jpdjere added a commit that referenced this pull request Aug 28, 2023
….cy.ts - Deletes and recovers more than one rule (#164824)

**NOTE: This is a manual backport of
#164694


Relates to: #161507

## Summary

- Solves flakiness in following test:
- Filename:
`x-pack/plugins/security_solution/cypress/e2e/detection_rules/prebuilt_rules_management.cy.ts`
- Test name: **Prebuilt rules Actions with prebuilt rules Rules table
Deletes and recovers more than one rule**

- Test was failing because of already observed issue of `autoRefresh`
taking place while the rule selection is happening, causing Cypress to
lose focus and preventing the checkbox from being checked. This PR
disables autorefresh from the table to prevent that from happening.

## Flaky test runner

350 iters:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2976
🟢
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Aug 28, 2023
…s` - Deletes and recovers more than one rule (elastic#164694)

Relates to: elastic#161507

## Summary

- Solves flakiness in following test:
- Filename:
`x-pack/test/security_solution_cypress/cypress/e2e/detection_response/prebuilt_rules/prebuilt_rules_management.cy.ts`
- Test name: **Prebuilt rules Actions with prebuilt rules Rules table
Deletes and recovers more than one rule**

- Test was failing because of already observed issue of `autoRefresh`
taking place while the rule selection is happening, causing Cypress to
lose focus and preventing the checkbox from being checked. This PR
disables autorefresh from the table to prevent that from happening.

## Flaky test runner

350 iters:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2976
🟢

(cherry picked from commit e22f9b8)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.10

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Aug 28, 2023
…nt.cy.ts` - Deletes and recovers more than one rule (#164694) (#164961)

# Backport

This will backport the following commits from `main` to `8.10`:
- [[Security Solution] Fix flakiness in:
`prebuilt_rules_management.cy.ts` - Deletes and recovers more than one
rule (#164694)](#164694)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Juan Pablo
Djeredjian","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-08-28T11:02:22Z","message":"[Security
Solution] Fix flakiness in: `prebuilt_rules_management.cy.ts` - Deletes
and recovers more than one rule (#164694)\n\nRelates to:
https://github.com/elastic/kibana/issues/161507\r\n\r\n##
Summary\r\n\r\n- Solves flakiness in following test:\r\n-
Filename:\r\n`x-pack/test/security_solution_cypress/cypress/e2e/detection_response/prebuilt_rules/prebuilt_rules_management.cy.ts`\r\n-
Test name: **Prebuilt rules Actions with prebuilt rules Rules
table\r\nDeletes and recovers more than one rule**\r\n\r\n- Test was
failing because of already observed issue of `autoRefresh`\r\ntaking
place while the rule selection is happening, causing Cypress to\r\nlose
focus and preventing the checkbox from being checked. This
PR\r\ndisables autorefresh from the table to prevent that from
happening.\r\n\r\n## Flaky test runner\r\n\r\n350
iters:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2976\r\n🟢","sha":"e22f9b860e6d62ddcaacae6a1b2f57178afa8e54","branchLabelMapping":{"^v8.11.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","Team:Detections
and Resp","Team: SecuritySolution","Feature:Rule
Management","Team:Detection Rule
Management","v8.10.0","v8.11.0"],"number":164694,"url":"https://github.com/elastic/kibana/pull/164694","mergeCommit":{"message":"[Security
Solution] Fix flakiness in: `prebuilt_rules_management.cy.ts` - Deletes
and recovers more than one rule (#164694)\n\nRelates to:
https://github.com/elastic/kibana/issues/161507\r\n\r\n##
Summary\r\n\r\n- Solves flakiness in following test:\r\n-
Filename:\r\n`x-pack/test/security_solution_cypress/cypress/e2e/detection_response/prebuilt_rules/prebuilt_rules_management.cy.ts`\r\n-
Test name: **Prebuilt rules Actions with prebuilt rules Rules
table\r\nDeletes and recovers more than one rule**\r\n\r\n- Test was
failing because of already observed issue of `autoRefresh`\r\ntaking
place while the rule selection is happening, causing Cypress to\r\nlose
focus and preventing the checkbox from being checked. This
PR\r\ndisables autorefresh from the table to prevent that from
happening.\r\n\r\n## Flaky test runner\r\n\r\n350
iters:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2976\r\n🟢","sha":"e22f9b860e6d62ddcaacae6a1b2f57178afa8e54"}},"sourceBranch":"main","suggestedTargetBranches":["8.10"],"targetPullRequestStates":[{"branch":"8.10","label":"v8.10.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.11.0","labelRegex":"^v8.11.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/164694","number":164694,"mergeCommit":{"message":"[Security
Solution] Fix flakiness in: `prebuilt_rules_management.cy.ts` - Deletes
and recovers more than one rule (#164694)\n\nRelates to:
https://github.com/elastic/kibana/issues/161507\r\n\r\n##
Summary\r\n\r\n- Solves flakiness in following test:\r\n-
Filename:\r\n`x-pack/test/security_solution_cypress/cypress/e2e/detection_response/prebuilt_rules/prebuilt_rules_management.cy.ts`\r\n-
Test name: **Prebuilt rules Actions with prebuilt rules Rules
table\r\nDeletes and recovers more than one rule**\r\n\r\n- Test was
failing because of already observed issue of `autoRefresh`\r\ntaking
place while the rule selection is happening, causing Cypress to\r\nlose
focus and preventing the checkbox from being checked. This
PR\r\ndisables autorefresh from the table to prevent that from
happening.\r\n\r\n## Flaky test runner\r\n\r\n350
iters:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2976\r\n🟢","sha":"e22f9b860e6d62ddcaacae6a1b2f57178afa8e54"}}]}]
BACKPORT-->

Co-authored-by: Juan Pablo Djeredjian <[email protected]>
@jpdjere jpdjere added the flake-docs Temp label to gather PRs used to create dev docs label Aug 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:Rule Management Security Solution Detection Rule Management area flake-docs Temp label to gather PRs used to create dev docs release_note:skip Skip the PR/issue when compiling release notes Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. test v8.10.0 v8.11.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants