Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cherry-pick #18835 to 7.8: Add missing Jenkins stages for Auditbeat #19151

Merged
merged 1 commit into from
Jun 12, 2020
Merged

Cherry-pick #18835 to 7.8: Add missing Jenkins stages for Auditbeat #19151

merged 1 commit into from
Jun 12, 2020

Conversation

v1v
Copy link
Member

@v1v v1v commented Jun 12, 2020

Backports the following commits to 7.8:

@jsoriano @v1v
Add missing Jenkins stages for Auditbeat (elastic#18835)
0ff7d9c 
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.
@v1v v1v requested a review from a team as a code owner June 12, 2020 07:34
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jun 12, 2020
@v1v v1v changed the title [7.8] Add missing Jenkins stages for Auditbeat (#18835) Cherry-pick #18777 to 7.8: [7.8] Add missing Jenkins stages for Auditbeat (#18835) Jun 12, 2020
@v1v v1v changed the title Cherry-pick #18777 to 7.8: [7.8] Add missing Jenkins stages for Auditbeat (#18835) Cherry-pick #18835 to 7.8: [7.8] Add missing Jenkins stages for Auditbeat Jun 12, 2020
@v1v v1v requested a review from jsoriano June 12, 2020 07:35
@v1v v1v self-assigned this Jun 12, 2020
@v1v v1v added the Team:SIEM label Jun 12, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/siem (Team:SIEM)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jun 12, 2020
@v1v v1v added backport needs_team Indicates that the issue/PR needs a Team:* label labels Jun 12, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jun 12, 2020
@botelastic
Copy link

botelastic bot commented Jun 12, 2020

This pull request doesn't have a Team:<team> label.

@elasticmachine
Copy link
Collaborator

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #19151 opened]

  • Start Time: 2020-06-12T07:35:36.968+0000

  • Duration: 59 min 13 sec

Test stats 🧪

Test Results
Failed 0
Passed 6077
Skipped 959
Total 7036

Steps errors

Expand to view the steps failures

  • Name: Report to Codecov

    • Description: curl -sSLo codecov https://codecov.io/bash for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat do FILE="${i}/build/coverage/full.cov" if [ -f "${FILE}" ]; then bash codecov -f "${FILE}" fi done

    • Duration: 2 min 22 sec

    • Start Time: 2020-06-12T08:26:39.972+0000

    • log

  • Name: Make -C libbeat testsuite

    • Description: make -C libbeat testsuite

    • Duration: 28 min 42 sec

    • Start Time: 2020-06-12T07:57:08.598+0000

    • log

  • Name: Mage build test

    • Description: mage build test

    • Duration: 9 min 52 sec

    • Start Time: 2020-06-12T07:59:43.652+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-06-12T08:34:19.610Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-06-12T08:34:19.610Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-06-12T08:34:19.610Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-06-12T08:34:19.610Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-06-12T08:34:19.610Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-06-12T08:34:20.066Z] + curl -sSLo codecov https://codecov.io/bash
[2020-06-12T08:34:20.327Z] + FILE=auditbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=filebeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=heartbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=libbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=metricbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=packetbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-06-12T08:34:20.327Z] + FILE=journalbeat/build/coverage/full.cov
[2020-06-12T08:34:20.327Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-06-12T08:34:21.697Z] Stage "Generators Metricbeat Mac OS X" skipped due to when conditional
[2020-06-12T08:34:21.826Z] Stage "Generators Beat Mac OS X" skipped due to when conditional
[2020-06-12T08:34:23.676Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats
[2020-06-12T08:34:24.012Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-12T08:34:24.036Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Lint
[2020-06-12T08:34:24.190Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Winlogbeat-oss
[2020-06-12T08:34:24.340Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-06-12T08:34:24.486Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-06-12T08:34:24.634Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Dockerlogbeat
[2020-06-12T08:34:24.833Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-06-12T08:34:24.980Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Journalbeat-oss
[2020-06-12T08:34:25.133Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-06-12T08:34:25.286Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-06-12T08:34:25.436Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-06-12T08:34:25.583Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-06-12T08:34:25.731Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-06-12T08:34:25.881Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Heartbeat-oss
[2020-06-12T08:34:26.027Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-06-12T08:34:26.170Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-06-12T08:34:26.319Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-06-12T08:34:26.463Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-06-12T08:34:26.608Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-06-12T08:34:26.752Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-06-12T08:34:26.898Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Libbeat-x-pack
[2020-06-12T08:34:27.042Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Packetbeat-oss
[2020-06-12T08:34:27.185Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Filebeat-Windows
[2020-06-12T08:34:27.332Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-06-12T08:34:27.478Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-06-12T08:34:27.625Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-Windows
[2020-06-12T08:34:27.771Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-06-12T08:34:27.916Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Filebeat-x-pack
[2020-06-12T08:34:28.060Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-06-12T08:34:28.207Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Heartbeat-Windows
[2020-06-12T08:34:28.353Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Functionbeat-Windows
[2020-06-12T08:34:28.497Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Libbeat-oss
[2020-06-12T08:34:28.642Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Filebeat-oss
[2020-06-12T08:34:28.785Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-06-12T08:34:29.212Z] + cat
[2020-06-12T08:34:29.212Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-12T08:34:29.212Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-12T08:34:35.814Z] runbld>>> runbld started
[2020-06-12T08:34:35.814Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-06-12T08:34:36.387Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-19151' in order of occurrence in the config (last value wins).
[2020-06-12T08:34:37.768Z] runbld>>> Debug logging enabled.
[2020-06-12T08:34:37.768Z] runbld>>> Storing result
[2020-06-12T08:34:38.028Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-12T08:34:38.028Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200612083437-4EBFF6CE
[2020-06-12T08:34:38.028Z] runbld>>> Adding system facts.
[2020-06-12T08:34:38.596Z] runbld>>> Adding vcs info for the latest commit:  0ff7d9cb6722939c106e54294835add01132f184
[2020-06-12T08:34:39.205Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-12T08:34:39.205Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-12T08:34:39.205Z] Processing JUnit reports with runbld...
[2020-06-12T08:34:39.205Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-12T08:34:39.471Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-12T08:34:39.471Z] runbld>>> DURATION: 25ms
[2020-06-12T08:34:39.471Z] runbld>>> STDOUT: 40 bytes
[2020-06-12T08:34:39.471Z] runbld>>> STDERR: 49 bytes
[2020-06-12T08:34:39.471Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-12T08:34:39.471Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats
[2020-06-12T08:34:40.851Z] runbld>>> Storing build metadata: 
[2020-06-12T08:34:40.851Z] runbld>>> Adding test report.
[2020-06-12T08:34:40.851Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151/src/github.com/elastic/beats
[2020-06-12T08:34:41.787Z] runbld>>> Found 39 test output files
[2020-06-12T08:34:43.166Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 6886 Skipped: 861
[2020-06-12T08:34:43.166Z] runbld>>> Storing result
[2020-06-12T08:34:43.166Z] runbld>>> FAILURES: 0
[2020-06-12T08:34:43.424Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-12T08:34:43.424Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200612083437-4EBFF6CE
[2020-06-12T08:34:43.424Z] runbld>>> Email notification disabled by environment variable.
[2020-06-12T08:34:43.424Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-12T08:34:49.387Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19151
[2020-06-12T08:34:49.674Z] [INFO] getVaultSecret: Getting secrets
[2020-06-12T08:34:49.744Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-12T08:34:50.724Z] + chmod 755 generate-build-data.sh
[2020-06-12T08:34:50.724Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19151/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19151/runs/1 FAILURE 3553483
[2020-06-12T08:34:50.724Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19151/runs/1/steps/?limit=10000 -o steps-info.json
[2020-06-12T08:34:52.068Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19151/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-06-12T08:34:52.319Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19151/runs/1/log/ -o pipeline-log.txt

jsoriano
jsoriano approved these changes Jun 12, 2020
View reviewed changes
Copy link
Member

@jsoriano jsoriano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for doing these backports!

@v1v v1v changed the title Cherry-pick #18835 to 7.8: [7.8] Add missing Jenkins stages for Auditbeat Cherry-pick #18835 to 7.8: Add missing Jenkins stages for Auditbeat Jun 12, 2020
@v1v v1v merged commit 262f6a6 into elastic:7.8 Jun 12, 2020
@v1v v1v deleted the backport/7.8/pr-18835 branch June 12, 2020 08:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jsoriano jsoriano jsoriano approved these changes

@kuisathaverat kuisathaverat kuisathaverat approved these changes

@mikemadden42 mikemadden42 Awaiting requested review from mikemadden42

Assignees

@v1v v1v

Labels
backport
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@v1v @elasticmachine @jsoriano @kuisathaverat