-
Notifications
You must be signed in to change notification settings - Fork 8.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Security Solution] Refactor policy details tests to focus on only fields changed #126458
Conversation
Pinging @elastic/security-onboarding-and-lifecycle-mgt (Team:Onboarding and Lifecycle Mgt) |
💚 Build SucceededMetrics [docs]
To update your PR or re-run it, just comment with: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for working on this 🙏
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
…elds changed (elastic#126458) (cherry picked from commit bc4c8d6)
…elds changed (#126458) (#126585) (cherry picked from commit bc4c8d6) Co-authored-by: Kevin Logan <[email protected]>
@kevinlog, I'm going to kickoff a backport of this PR to 7.17 branch. These will help get my backport for ID changes to pass CI: #127671. This backport is for the initial changes to the input IDs which caused problems as we discussed earlier today; I am working on a subsequent fix in #127673 but this one needs to go in first. Let me know if any concerns with backporting your PR. |
This comment was marked as outdated.
This comment was marked as outdated.
…elds changed (elastic#126458) (cherry picked from commit bc4c8d6) # Conflicts: # x-pack/test/security_solution_endpoint/apps/endpoint/policy_details.ts
…elds changed (elastic#126458) (cherry picked from commit bc4c8d6) # Conflicts: # x-pack/test/security_solution_endpoint/apps/endpoint/policy_details.ts
…elds changed (#126458) (#127682) (cherry picked from commit bc4c8d6) # Conflicts: # x-pack/test/security_solution_endpoint/apps/endpoint/policy_details.ts Co-authored-by: Kevin Logan <[email protected]>
Summary
Refactors policy details tests to only focus on the fields changed in the test. Looking at the entire manifest was causing consistent test flakiness. This should narrow down the tests to only focus on what changes during the automation.
You can see from the failures we get on this test, the manifest is always the reason for failure. In this PR, we remove that check and focus on the fields changed only.
Flaky test runner: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/198
Checklist