Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[kbn/test/failed_test_reporter] handle cypress junit better #72968

Merged
merged 11 commits into from
Jul 23, 2020

Conversation

spalger
Copy link
Contributor

@spalger spalger commented Jul 22, 2020

I noticed recently that cypress failures reported by SIEM don't include the "Failed Test Reporter" messages, including the number of occurrences of a test. This means that we can't get the link to Github right out of Jenkins and instead have to search the issues which throws a major kink in the workflow that I follow when triaging CI failures.

This PR changes the way that we augment the cypress junit output as it seems that Jenkins doesn't render stdout when a <testcase><failure> has a message property. In that case the message property and the contents of the <failure> are rendered in the Jenkins UI. We instead prefix the <failure> when the message property exists.

Example of test failures enhanced by changes in this PR https://kibana-ci.elastic.co/job/elastic+kibana+pipeline-pull-request/63800/testReport/

image

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Build metrics

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@spalger spalger added release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.10.0 v7.9.0 v8.0.0 labels Jul 23, 2020
@spalger spalger marked this pull request as ready for review July 23, 2020 15:40
@spalger spalger requested a review from a team as a code owner July 23, 2020 15:40
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@spalger spalger requested a review from brianseeders July 23, 2020 15:44
@spalger spalger merged commit 367bece into elastic:master Jul 23, 2020
@spalger spalger deleted the fix/report-cypress-failures-to-github branch July 23, 2020 15:49
spalger added a commit to spalger/kibana that referenced this pull request Jul 23, 2020
spalger added a commit to spalger/kibana that referenced this pull request Jul 23, 2020
spalger added a commit that referenced this pull request Jul 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.9.0 v7.10.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants