Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution] Refactor policy details tests to focus on only fields changed #126458

Merged
merged 4 commits into from
Mar 1, 2022

Conversation

kevinlog
Copy link
Contributor

@kevinlog kevinlog commented Feb 28, 2022

Summary

Refactors policy details tests to only focus on the fields changed in the test. Looking at the entire manifest was causing consistent test flakiness. This should narrow down the tests to only focus on what changes during the automation.

You can see from the failures we get on this test, the manifest is always the reason for failure. In this PR, we remove that check and focus on the fields changed only.

Flaky test runner: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/198

Checklist

@kevinlog kevinlog added Team:Defend Workflows “EDR Workflows” sub-team of Security Solution v8.2.0 v8.1.0 release_note:skip Skip the PR/issue when compiling release notes labels Feb 28, 2022
@kevinlog kevinlog marked this pull request as ready for review February 28, 2022 14:17
@kevinlog kevinlog requested a review from a team as a code owner February 28, 2022 14:17
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-onboarding-and-lifecycle-mgt (Team:Onboarding and Lifecycle Mgt)

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Copy link
Contributor

@paul-tavares paul-tavares left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for working on this 🙏

@kevinlog kevinlog merged commit bc4c8d6 into elastic:main Mar 1, 2022
@kevinlog kevinlog deleted the task/refactor-policy-test branch March 1, 2022 13:28
@kevinlog kevinlog added the auto-backport Deprecated - use backport:version if exact versions are needed label Mar 1, 2022
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.1

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Mar 1, 2022
kibanamachine added a commit that referenced this pull request Mar 1, 2022
…elds changed (#126458) (#126585)

(cherry picked from commit bc4c8d6)

Co-authored-by: Kevin Logan <[email protected]>
@jen-huang
Copy link
Contributor

jen-huang commented Mar 15, 2022

@kevinlog, I'm going to kickoff a backport of this PR to 7.17 branch. These will help get my backport for ID changes to pass CI: #127671. This backport is for the initial changes to the input IDs which caused problems as we discussed earlier today; I am working on a subsequent fix in #127673 but this one needs to go in first.

Let me know if any concerns with backporting your PR.

@jen-huang jen-huang added auto-backport Deprecated - use backport:version if exact versions are needed and removed auto-backport Deprecated - use backport:version if exact versions are needed labels Mar 15, 2022
@kibanamachine

This comment was marked as outdated.

jen-huang pushed a commit to jen-huang/kibana that referenced this pull request Mar 15, 2022
…elds changed (elastic#126458)

(cherry picked from commit bc4c8d6)

# Conflicts:
#	x-pack/test/security_solution_endpoint/apps/endpoint/policy_details.ts
jen-huang pushed a commit to jen-huang/kibana that referenced this pull request Mar 15, 2022
…elds changed (elastic#126458)

(cherry picked from commit bc4c8d6)

# Conflicts:
#	x-pack/test/security_solution_endpoint/apps/endpoint/policy_details.ts
@jen-huang jen-huang removed the v8.0.2 label Mar 15, 2022
jen-huang added a commit that referenced this pull request Mar 15, 2022
…elds changed (#126458) (#127682)

(cherry picked from commit bc4c8d6)

# Conflicts:
#	x-pack/test/security_solution_endpoint/apps/endpoint/policy_details.ts

Co-authored-by: Kevin Logan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Deprecated - use backport:version if exact versions are needed release_note:skip Skip the PR/issue when compiling release notes Team:Defend Workflows “EDR Workflows” sub-team of Security Solution v7.17.2 v8.1.0 v8.2.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants