Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution] Add ServerlessQA tags for explore area tests #183087

Closed
wants to merge 22 commits into from

Conversation

@angorayc
Copy link
Contributor Author

angorayc commented May 9, 2024

buildkite test this

@angorayc
Copy link
Contributor Author

buildkite test this

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#5981

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@angorayc
Copy link
Contributor Author

/ci

@angorayc
Copy link
Contributor Author

buildkite test this

@angorayc
Copy link
Contributor Author

buildkite test this

@angorayc angorayc marked this pull request as ready for review May 16, 2024 16:12
@angorayc angorayc requested a review from a team as a code owner May 16, 2024 16:12
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-threat-hunting-explore (Team:Threat Hunting:Explore)

@angorayc angorayc added the release_note:skip Skip the PR/issue when compiling release notes label May 16, 2024
@angorayc angorayc requested a review from MadameSheema May 17, 2024 12:35
Copy link
Contributor

@semd semd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks @angorayc for doing this, and running the flaky test runner on these tests.

@angorayc
Copy link
Contributor Author

/ci

@angorayc
Copy link
Contributor Author

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6057

[❌] Security Solution Explore - Cypress: 73/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 99/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6060

[❌] Security Solution Explore - Cypress: 74/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6061

[❌] Security Solution Explore - Cypress: 73/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6068

[❌] Security Solution Explore - Cypress: 80/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 94/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6069

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6077

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 10/100 tests passed.

see run history

@MadameSheema
Copy link
Member

Please note that the flaky test suite runner is using an stateless environment, not an MKI one so greens there, does not assure for the test to be stable on MKI.

The periodic pipeline is the one that demonstrate how reliable a test is on MKI environments.

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6082

[❌] Security Solution Explore - Cypress: 68/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 0/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6128

[❌] Security Solution Explore - Cypress: 74/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@angorayc
Copy link
Contributor Author

Please note that the flaky test suite runner is using an stateless environment, not an MKI one so greens there, does not assure for the test to be stable on MKI.

The periodic pipeline is the one that demonstrate how reliable a test is on MKI environments.

Understood @MadameSheema , thanks for the reminder. I'm just hoping these tests will be stable enough for CI.

@angorayc
Copy link
Contributor Author

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6138

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibana-ci
Copy link
Collaborator

kibana-ci commented Jun 5, 2024

💔 Build Failed

Failed CI Steps

Test Failures

  • [job] [logs] Serverless Explore - Security Solution Cypress Tests #1 / Inspect Explore pages inspect Hosts page inspect Hosts page
  • [job] [logs] Serverless Explore - Security Solution Cypress Tests #1 / Inspect Explore pages inspect Users page inspect Users page

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
securitySolution 13.6MB 13.6MB +10.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@angorayc angorayc closed this Sep 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Threat Hunting:Explore v8.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants