chore: refactor Fleet upgrade tests (#671) backport for 7.10.x #698

mdelapenya · 2021-02-04T16:16:05Z

Backports the following commits to 7.10.x:

chore: refactor Fleet upgrade tests (chore: refactor Fleet upgrade tests #671)

* chore: use nightly annotation for the Upgrade tests * chore: add two make goals for the nightly use cases - e2e-fleet-nightly: run the nightly tests not using CI snapshots. It should download the binaries from the official artifactory. - e2e-fleet-nightly-ci-snapshots: run the nightly tests using the CI snapshots for a specific SHA commit from Beats, downloading them from a GCP bucket * chore: bump elastic-agent stale version * chore: pass version and state state when creating an installer This will allow selecting the proper binary, depending if we are using a stale agent or a regular one. * fix: append snapshot to the stale version when using CI snapshots * fix: check for version aliases with non-stale versions * chore: store current agent version in the test suite struct * chore: make sure the layout is properly created for TAR installer * chore: add make goals for testing fleet use cases * chore: move Make goals to the e2e Makefile # Conflicts: # .ci/Jenkinsfile

elasticmachine · 2021-02-04T16:21:02Z

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #698 opened
- Start Time: 2021-02-04T16:16:19.899+0000
Duration: 5 min 35 sec
Commit: bcc9599

Test stats 🧪

Test	Results
Failed	0
Passed	40
Skipped	7
Total	47

Steps errors

Expand to view the steps failures

`Build and test`

Took 1 min 31 sec . View more details on here
Description: .ci/scripts/build-test.sh

`Archive the artifacts`

Took 0 min 0 sec . View more details on here
Description: [2021-02-04T16:20:23.231Z] Archiving artifacts script returned exit code 2

Log output

Expand to view the last 100 lines of log output

[2021-02-04T16:20:18.662Z] pre-commit installed at .git/hooks/pre-commit
[2021-02-04T16:20:18.662Z] [INFO] Initializing environment for git://github.com/pre-commit/pre-commit-hooks.
[2021-02-04T16:20:19.337Z] [INFO] Initializing environment for git://github.com/dnephin/pre-commit-golang.
[2021-02-04T16:20:19.601Z] [INFO] Initializing environment for [email protected]:elastic/apm-pipeline-library.
[2021-02-04T16:20:19.873Z] # github.com/elastic/e2e-testing/e2e/_suites/fleet [github.com/elastic/e2e-testing/e2e/_suites/fleet.test]
[2021-02-04T16:20:19.874Z] fleet/services_test.go:27:35: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:19.874Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:19.874Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:19.874Z] fleet/services_test.go:39:62: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:19.874Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:19.874Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:19.874Z] fleet/services_test.go:53:62: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:19.874Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:19.874Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:19.874Z] fleet/services_test.go:67:62: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:19.874Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:19.874Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:19.874Z] WARN invalid TestEvent: FAIL	github.com/elastic/e2e-testing/e2e/_suites/fleet [build failed]
[2021-02-04T16:20:19.874Z] bad output from test2json: FAIL	github.com/elastic/e2e-testing/e2e/_suites/fleet [build failed]
[2021-02-04T16:20:21.269Z] testing: warning: no tests to run
[2021-02-04T16:20:21.269Z] PASS _suites/helm
[2021-02-04T16:20:21.528Z] testing: warning: no tests to run
[2021-02-04T16:20:21.528Z] PASS _suites/metricbeat
[2021-02-04T16:20:21.528Z] 
[2021-02-04T16:20:21.528Z] === Errors
[2021-02-04T16:20:21.528Z] fleet/services_test.go:27:35: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:21.528Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:21.528Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:21.528Z] fleet/services_test.go:39:62: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:21.528Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:21.528Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:21.528Z] fleet/services_test.go:53:62: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:21.528Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:21.528Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:21.528Z] fleet/services_test.go:67:62: not enough arguments in call to downloadAgentBinary
[2021-02-04T16:20:21.528Z] 	have (string, string, string, string, string)
[2021-02-04T16:20:21.528Z] 	want (string, string, string, string, string, bool)
[2021-02-04T16:20:21.528Z] 
[2021-02-04T16:20:21.528Z] DONE 0 tests, 4 errors in 4.405s
[2021-02-04T16:20:21.528Z] Makefile:92: recipe for target 'unit-test' failed
[2021-02-04T16:20:21.528Z] make: *** [unit-test] Error 2
[2021-02-04T16:20:21.528Z] make: Leaving directory '/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/e2e'
[2021-02-04T16:20:21.531Z] [INFO] Installing environment for git://github.com/pre-commit/pre-commit-hooks.
[2021-02-04T16:20:21.531Z] [INFO] Once installed this environment will be reused.
[2021-02-04T16:20:21.531Z] [INFO] This may take a few minutes...
[2021-02-04T16:20:22.771Z] Post stage
[2021-02-04T16:20:22.799Z] Recording test results
[2021-02-04T16:20:23.197Z] [Checks API] No suitable checks publisher found.
[2021-02-04T16:20:23.231Z] Archiving artifacts
[2021-02-04T16:20:23.448Z] Failed in branch Unit Tests
[2021-02-04T16:20:28.602Z] + export PATH=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.gvm/versions/go1.14.12.linux.amd64/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/.ci/scripts
[2021-02-04T16:20:28.602Z] + set +e
[2021-02-04T16:20:28.602Z] + find /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.cache/pre-commit -type d -name scripts
[2021-02-04T16:20:28.602Z] + grep .ci/scripts
[2021-02-04T16:20:28.602Z] + searchFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.cache/pre-commit/repoq_5BNT/.ci/scripts
[2021-02-04T16:20:28.602Z] + [ -e /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.cache/pre-commit/repoq_5BNT/.ci/scripts ]
[2021-02-04T16:20:28.602Z] + export PATH=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.gvm/versions/go1.14.12.linux.amd64/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/bin:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/.ci/scripts:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.cache/pre-commit/repoq_5BNT/.ci/scripts
[2021-02-04T16:20:28.602Z] + set -e
[2021-02-04T16:20:28.602Z] + git diff-tree --no-commit-id --name-only -r bcc95999a9ddaa6b069244c4ffa94c62567f9f23
[2021-02-04T16:20:28.602Z] + xargs pre-commit run --files
[2021-02-04T16:20:28.602Z] + tee pre-commit.out
[2021-02-04T16:20:28.862Z] Check for case conflicts.................................................Passed
[2021-02-04T16:20:28.862Z] Check that executables have shebangs.................(no files to check)Skipped
[2021-02-04T16:20:28.862Z] Check JSON...........................................(no files to check)Skipped
[2021-02-04T16:20:28.863Z] Check for merge conflicts................................................Passed
[2021-02-04T16:20:28.863Z] Check Yaml...........................................(no files to check)Skipped
[2021-02-04T16:20:28.863Z] Check Xml............................................(no files to check)Skipped
[2021-02-04T16:20:28.863Z] Fix End of Files.........................................................Passed
[2021-02-04T16:20:28.863Z] go fmt...................................................................Passed
[2021-02-04T16:20:29.123Z] go lint..................................................................Passed
[2021-02-04T16:20:29.123Z] Check files aren't using go's testing package........(no files to check)Skipped
[2021-02-04T16:20:31.036Z] golangci-lint............................................................Passed
[2021-02-04T16:20:31.036Z] check-bash-syntax....................................(no files to check)Skipped
[2021-02-04T16:20:31.608Z] check-jenkins-pipelines..................................................Passed
[2021-02-04T16:20:31.608Z] - hook id: check-jenkins-pipelines
[2021-02-04T16:20:31.608Z] - duration: 0.47s
[2021-02-04T16:20:31.608Z] check-unicode-non-breaking-spaces........................................Passed
[2021-02-04T16:20:31.608Z] remove-unicode-non-breaking-spaces.......................................Passed
[2021-02-04T16:20:31.608Z] check-en-dashes..........................................................Passed
[2021-02-04T16:20:31.608Z] remove-en-dashes.........................................................Passed
[2021-02-04T16:20:31.608Z] check-jjbb...........................................(no files to check)Skipped
[2021-02-04T16:20:31.608Z] - hook id: check-jjbb
[2021-02-04T16:20:49.861Z] check-gherkin-lint.......................................................Passed
[2021-02-04T16:20:49.943Z] $ ssh-agent -k
[2021-02-04T16:20:49.949Z] unset SSH_AUTH_SOCK;
[2021-02-04T16:20:49.950Z] unset SSH_AGENT_PID;
[2021-02-04T16:20:49.950Z] echo Agent pid 4403 killed;
[2021-02-04T16:20:49.960Z] [ssh-agent] Stopped.
[2021-02-04T16:20:50.157Z] Archiving artifacts
[2021-02-04T16:20:50.441Z] Recording test results
[2021-02-04T16:20:50.904Z] [Checks API] No suitable checks publisher found.
[2021-02-04T16:20:52.366Z] Stage "Build Docs" skipped due to earlier failure(s)
[2021-02-04T16:20:52.488Z] Stage "End-To-End Tests" skipped due to earlier failure(s)
[2021-02-04T16:20:52.609Z] Stage "Release" skipped due to earlier failure(s)
[2021-02-04T16:20:53.412Z] Running on Jenkins in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698@2
[2021-02-04T16:20:53.529Z] [INFO] getVaultSecret: Getting secrets
[2021-02-04T16:20:53.620Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-02-04T16:20:55.022Z] + chmod 755 generate-build-data.sh
[2021-02-04T16:20:55.022Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/runs/1 FAILURE 274848
[2021-02-04T16:20:55.273Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/runs/1/steps/?limit=10000 -o steps-info.json

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	0
Passed	40
Skipped	7
Total	47

elasticmachine · 2021-02-04T17:25:30Z

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #698 updated
- Start Time: 2021-02-04T16:25:02.603+0000
Duration: 60 min 21 sec
Commit: 11185c6

Test stats 🧪

Test	Results
Failed	0
Passed	129
Skipped	9
Total	138

Log output

Expand to view the last 100 lines of log output

[2021-02-04T16:46:55.658Z] Recording test results
[2021-02-04T16:46:55.947Z] [Checks API] No suitable checks publisher found.
[2021-02-04T16:46:55.964Z] Archiving artifacts
[2021-02-04T16:46:56.196Z] time="2021-02-04T16:46:55Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:46:56.196Z] time="2021-02-04T16:46:55Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1.689195589s hostname=bcece7c2e0c2 isAgentInStatus=false retry=3 status=offline
[2021-02-04T16:46:57.132Z] time="2021-02-04T16:46:56Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:46:57.132Z] time="2021-02-04T16:46:56Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=2.776182363s hostname=bcece7c2e0c2 isAgentInStatus=false retry=4 status=offline
[2021-02-04T16:47:02.407Z] time="2021-02-04T16:47:02Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:02.407Z] time="2021-02-04T16:47:02Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=8.190435455s hostname=bcece7c2e0c2 isAgentInStatus=false retry=5 status=offline
[2021-02-04T16:47:06.600Z] time="2021-02-04T16:47:06Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:06.600Z] time="2021-02-04T16:47:06Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=11.971584909s hostname=bcece7c2e0c2 isAgentInStatus=false retry=6 status=offline
[2021-02-04T16:47:11.872Z] time="2021-02-04T16:47:11Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:11.872Z] time="2021-02-04T16:47:11Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=17.715792408s hostname=bcece7c2e0c2 isAgentInStatus=false retry=7 status=offline
[2021-02-04T16:47:16.069Z] time="2021-02-04T16:47:15Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:16.069Z] time="2021-02-04T16:47:15Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=21.500041979s hostname=bcece7c2e0c2 isAgentInStatus=false retry=8 status=offline
[2021-02-04T16:47:19.357Z] time="2021-02-04T16:47:18Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:19.357Z] time="2021-02-04T16:47:19Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=24.931459154s hostname=bcece7c2e0c2 isAgentInStatus=false retry=9 status=offline
[2021-02-04T16:47:24.641Z] time="2021-02-04T16:47:24Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:24.641Z] time="2021-02-04T16:47:24Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=30.452850505s hostname=bcece7c2e0c2 isAgentInStatus=false retry=10 status=offline
[2021-02-04T16:47:31.221Z] time="2021-02-04T16:47:31Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:31.221Z] time="2021-02-04T16:47:31Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=37.059724374s hostname=bcece7c2e0c2 isAgentInStatus=false retry=11 status=offline
[2021-02-04T16:47:37.788Z] time="2021-02-04T16:47:37Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:37.788Z] time="2021-02-04T16:47:37Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=43.059038514s hostname=bcece7c2e0c2 isAgentInStatus=false retry=12 status=offline
[2021-02-04T16:47:39.851Z] time="2021-02-04T16:47:39Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:39.851Z] time="2021-02-04T16:47:39Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=45.7388143s hostname=bcece7c2e0c2 isAgentInStatus=false retry=13 status=offline
[2021-02-04T16:47:45.334Z] time="2021-02-04T16:47:45Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:45.334Z] time="2021-02-04T16:47:45Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=50.963896681s hostname=bcece7c2e0c2 isAgentInStatus=false retry=14 status=offline
[2021-02-04T16:47:53.475Z] time="2021-02-04T16:47:52Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:53.475Z] time="2021-02-04T16:47:52Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=58.370583355s hostname=bcece7c2e0c2 isAgentInStatus=false retry=15 status=offline
[2021-02-04T16:47:58.753Z] time="2021-02-04T16:47:58Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:47:58.753Z] time="2021-02-04T16:47:58Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m4.658131147s hostname=bcece7c2e0c2 isAgentInStatus=false retry=16 status=offline
[2021-02-04T16:48:02.947Z] time="2021-02-04T16:48:02Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:02.947Z] time="2021-02-04T16:48:02Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m8.701385259s hostname=bcece7c2e0c2 isAgentInStatus=false retry=17 status=offline
[2021-02-04T16:48:09.527Z] time="2021-02-04T16:48:09Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:09.527Z] time="2021-02-04T16:48:09Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m14.998097678s hostname=bcece7c2e0c2 isAgentInStatus=false retry=18 status=offline
[2021-02-04T16:48:12.823Z] time="2021-02-04T16:48:12Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:12.823Z] time="2021-02-04T16:48:12Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m18.285401852s hostname=bcece7c2e0c2 isAgentInStatus=false retry=19 status=offline
[2021-02-04T16:48:17.020Z] time="2021-02-04T16:48:16Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:17.021Z] time="2021-02-04T16:48:16Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m22.597747413s hostname=bcece7c2e0c2 isAgentInStatus=false retry=20 status=offline
[2021-02-04T16:48:23.613Z] time="2021-02-04T16:48:23Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:23.613Z] time="2021-02-04T16:48:23Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m29.289393061s hostname=bcece7c2e0c2 isAgentInStatus=false retry=21 status=offline
[2021-02-04T16:48:27.810Z] time="2021-02-04T16:48:27Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:27.810Z] time="2021-02-04T16:48:27Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m32.981131096s hostname=bcece7c2e0c2 isAgentInStatus=false retry=22 status=offline
[2021-02-04T16:48:33.087Z] time="2021-02-04T16:48:32Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:33.087Z] time="2021-02-04T16:48:32Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m38.652599562s hostname=bcece7c2e0c2 isAgentInStatus=false retry=23 status=offline
[2021-02-04T16:48:38.365Z] time="2021-02-04T16:48:37Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:38.365Z] time="2021-02-04T16:48:37Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m43.676472885s hostname=bcece7c2e0c2 isAgentInStatus=false retry=24 status=offline
[2021-02-04T16:48:40.903Z] time="2021-02-04T16:48:40Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:40.903Z] time="2021-02-04T16:48:40Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m46.67587687s hostname=bcece7c2e0c2 isAgentInStatus=false retry=25 status=offline
[2021-02-04T16:48:43.441Z] time="2021-02-04T16:48:43Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:43.441Z] time="2021-02-04T16:48:43Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m49.332026424s hostname=bcece7c2e0c2 isAgentInStatus=false retry=26 status=offline
[2021-02-04T16:48:48.716Z] time="2021-02-04T16:48:47Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:48.716Z] time="2021-02-04T16:48:47Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m53.845434048s hostname=bcece7c2e0c2 isAgentInStatus=false retry=27 status=offline
[2021-02-04T16:48:53.991Z] time="2021-02-04T16:48:53Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:48:53.991Z] time="2021-02-04T16:48:53Z" level=warning msg="The Agent is not in the offline status yet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 elapsedTime=1m59.333657256s hostname=bcece7c2e0c2 isAgentInStatus=false retry=28 status=offline
[2021-02-04T16:49:02.114Z] time="2021-02-04T16:49:00Z" level=debug msg="Agent listed in Fleet with online status" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:49:02.114Z] time="2021-02-04T16:49:00Z" level=info msg="The Agent is in the desired status" elapsedTime=2m6.52077635s hostname=bcece7c2e0c2 isAgentInStatus=true retries=29 status=offline
[2021-02-04T16:49:02.114Z] OCI runtime exec failed: exec failed: container_linux.go:370: starting container process caused: exec: "elastic-agent": executable file not found in $PATH: unknown
[2021-02-04T16:49:02.114Z] time="2021-02-04T16:49:01Z" level=error msg="Could not execute command in container" command="[elastic-agent uninstall -f]" error="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent uninstall -f]. exit status 126" service=debian-systemd
[2021-02-04T16:49:02.114Z] time="2021-02-04T16:49:01Z" level=error msg="Could not run agent command in the box" command="[elastic-agent uninstall -f]" error="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent uninstall -f]. exit status 126" profile=fleet service=debian-systemd
[2021-02-04T16:49:02.114Z] time="2021-02-04T16:49:01Z" level=warning msg="Could not uninstall the agent after the scenario: Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent uninstall -f]. exit status 126"
[2021-02-04T16:49:02.114Z] time="2021-02-04T16:49:01Z" level=debug msg="Un-enrolling agent in Fleet" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8 hostname=bcece7c2e0c2
[2021-02-04T16:49:02.684Z] time="2021-02-04T16:49:02Z" level=debug msg="Fleet agent was unenrolled" agentID=72f242f6-6b18-4dab-a217-a2f124274fe8
[2021-02-04T16:49:03.623Z] Stopping fleet_debian-systemd_elastic-agent_1 ... 
[2021-02-04T16:49:04.145Z] 
Stopping fleet_debian-systemd_elastic-agent_1 ... done
Removing fleet_debian-systemd_elastic-agent_1 ... 
[2021-02-04T16:49:04.145Z] 
Removing fleet_debian-systemd_elastic-agent_1 ... done
Going to remove fleet_debian-systemd_elastic-agent_1
[2021-02-04T16:49:04.145Z] time="2021-02-04T16:49:04Z" level=debug msg="Docker compose executed." cmd="[rm -fvs debian-systemd]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.10.3-SNAPSHOT-linux-x86_64.tar.gz268178145 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.10.3-SNAPSHOT-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.10.3-SNAPSHOT-linux-x86_64.tar.gz268178145 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.10.3-SNAPSHOT-x86_64.tar.gz debian_systemdContainerName:fleet_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/e2e/_suites/fleet/configurations/kibana.config.yml stackVersion:7.10-SNAPSHOT]" profile=fleet
[2021-02-04T16:49:04.145Z] time="2021-02-04T16:49:04Z" level=debug msg="Service removed from compose" profile=fleet service=debian-systemd
[2021-02-04T16:49:04.715Z] time="2021-02-04T16:49:04Z" level=debug msg="The token was deleted" tokenID=36118e94-460f-4f8a-aa71-70678bfa3114
[2021-02-04T16:49:04.715Z] time="2021-02-04T16:49:04Z" level=info msg="Integration deleted from the configuration" integration= packageConfigId= policyID=a4e6dcb0-6706-11eb-99ef-2d413c9f910b version=
[2021-02-04T16:49:04.715Z] time="2021-02-04T16:49:04Z" level=debug msg="Destroying Fleet runtime dependencies"
[2021-02-04T16:49:05.654Z] Stopping fleet_kibana_1           ... 
[2021-02-04T16:49:05.654Z] Stopping fleet_package-registry_1 ... 
[2021-02-04T16:49:05.654Z] Stopping fleet_elasticsearch_1    ... 
[2021-02-04T16:49:07.111Z] 
Stopping fleet_kibana_1           ... done

Stopping fleet_package-registry_1 ... done

Stopping fleet_elasticsearch_1    ... done
Removing fleet_kibana_1           ... 
[2021-02-04T16:49:07.111Z] Removing fleet_package-registry_1 ... 
[2021-02-04T16:49:07.111Z] Removing fleet_elasticsearch_1    ... 
[2021-02-04T16:49:07.111Z] 
Removing fleet_package-registry_1 ... done

Removing fleet_kibana_1           ... done

Removing fleet_elasticsearch_1    ... done
Removing network fleet_default
[2021-02-04T16:49:07.111Z] time="2021-02-04T16:49:07Z" level=debug msg="Docker compose executed." cmd="[down --remove-orphans]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/.op/compose/profiles/fleet/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.10.3-SNAPSHOT-linux-x86_64.tar.gz268178145 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.10.3-SNAPSHOT-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.10.3-SNAPSHOT-linux-x86_64.tar.gz268178145 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.10.3-SNAPSHOT-x86_64.tar.gz debian_systemdContainerName:fleet_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698/src/github.com/elastic/e2e-testing/e2e/_suites/fleet/configurations/kibana.config.yml stackVersion:7.10-SNAPSHOT]" profile=fleet
[2021-02-04T16:49:07.111Z] time="2021-02-04T16:49:07Z" level=debug msg="Elastic Agent binary was removed." installer=centos-systemd-7.10.3-SNAPSHOT path=/tmp/elastic-agent-7.10.3-SNAPSHOT-x86_64.rpm711177994
[2021-02-04T16:49:07.111Z] time="2021-02-04T16:49:07Z" level=debug msg="Elastic Agent binary was removed." installer=centos-tar-7.10.3-SNAPSHOT path=/tmp/elastic-agent-7.10.3-SNAPSHOT-linux-x86_64.tar.gz268178145
[2021-02-04T16:49:07.111Z] time="2021-02-04T16:49:07Z" level=debug msg="Elastic Agent binary was removed." installer=debian-systemd-7.10.3-SNAPSHOT path=/tmp/elastic-agent-7.10.3-SNAPSHOT-amd64.deb152803020
[2021-02-04T16:49:07.176Z] [INFO] Stopping Filebeat Docker container
[2021-02-04T16:49:07.461Z] + docker exec -t 43c5cc1d52842e27e17471a94c817d0692e80d7e98a147bd4b8f35750ee952a7 chmod -R ugo+rw /output
[2021-02-04T16:49:07.721Z] + docker stop --time 30 43c5cc1d52842e27e17471a94c817d0692e80d7e98a147bd4b8f35750ee952a7
[2021-02-04T16:49:07.980Z] 43c5cc1d52842e27e17471a94c817d0692e80d7e98a147bd4b8f35750ee952a7
[2021-02-04T16:49:07.997Z] Archiving artifacts
[2021-02-04T16:49:08.724Z] Recording test results
[2021-02-04T16:49:09.103Z] [Checks API] No suitable checks publisher found.
[2021-02-04T16:49:09.120Z] Archiving artifacts
[2021-02-04T17:25:21.964Z] Cancelling nested steps due to timeout
[2021-02-04T17:25:22.035Z] Failed in branch ubuntu-18.04_helm_apm-server
[2021-02-04T17:25:23.035Z] Stage "Release" skipped due to earlier failure(s)
[2021-02-04T17:25:23.465Z] Running on Jenkins in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-698@2
[2021-02-04T17:25:23.509Z] [INFO] getVaultSecret: Getting secrets
[2021-02-04T17:25:23.586Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-02-04T17:25:24.291Z] + chmod 755 generate-build-data.sh
[2021-02-04T17:25:24.291Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/runs/2 ABORTED 3621427
[2021-02-04T17:25:24.541Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/runs/2/steps/?limit=10000 -o steps-info.json
[2021-02-04T17:25:25.452Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-698/runs/2/tests/?status=FAILED -o tests-errors.json

mdelapenya self-assigned this Feb 4, 2021

mdelapenya added the backport label Feb 4, 2021

Update services_test.go

11185c6

mdelapenya merged commit 53f6205 into elastic:7.10.x Feb 4, 2021

mdelapenya deleted the backport/7.10.x/pr-671 branch June 2, 2021 05:41

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: refactor Fleet upgrade tests (#671) backport for 7.10.x #698

chore: refactor Fleet upgrade tests (#671) backport for 7.10.x #698

mdelapenya commented Feb 4, 2021

elasticmachine commented Feb 4, 2021

Build stats

Test stats 🧪

`Build and test`

`Archive the artifacts`

Test stats 🧪

elasticmachine commented Feb 4, 2021

Build stats

Test stats 🧪

chore: refactor Fleet upgrade tests (#671) backport for 7.10.x #698

chore: refactor Fleet upgrade tests (#671) backport for 7.10.x #698

Conversation

mdelapenya commented Feb 4, 2021

elasticmachine commented Feb 4, 2021

💔 Build Failed

Build stats

Test stats 🧪

Steps errors

Build and test

Archive the artifacts

Log output

💚 Flaky test report

Test stats 🧪

elasticmachine commented Feb 4, 2021

❕ Build Aborted

Build stats

Test stats 🧪

Log output

`Build and test`

`Archive the artifacts`