Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

disable upgrade tests #537

Merged
merged 2 commits into from
Dec 10, 2020
Merged

Conversation

michalpristas
Copy link
Contributor

What does this PR do?

Disables upgrade tests

Why is it important?

Upgrade test fails on PR on

[2020-12-10T17:53:01.565Z] time="2020-12-10T17:53:00Z" level=error msg="Could not download the binary for the agent" arch=x86_64 artifact=elastic-agent error="Reached the end of the pages and the snapshots/elastic-agent-7.10.0-x86_64.tar.gz object was not found for the beats-ci-artifacts bucket" extension=tar.gz os=linux version=7.10.0

[2020-12-10T17:53:01.565Z] time="2020-12-10T17:53:00Z" level=fatal msg="Sorry, we could not download the installer" error="Reached the end of the pages and the snapshots/elastic-agent-7.10.0-x86_64.tar.gz object was not found for the beats-ci-artifacts bucket" image=debian installer=tar

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have run the Unit tests for the CLI, and they are passing locally
  • I have run the End-2-End tests for the suite I'm working on, and they are passing locally
  • I have noticed new Go dependencies (run make notice in the proper directory)

@michalpristas michalpristas added the bug Something isn't working label Dec 10, 2020
@michalpristas michalpristas self-assigned this Dec 10, 2020
Copy link
Contributor

@EricDavisX EricDavisX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a temp skip is ok by me, thanks Michal

@elasticmachine
Copy link
Contributor

❕ Build Aborted

There is a new build on-going so the previous on-going builds have been aborted.

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts

Expand to view the summary

Build stats

  • Build Cause: Pull request #537 opened

  • Reason: Aborted from #2

  • Start Time: 2020-12-10T18:13:24.492+0000

  • Duration: 10 min 3 sec

  • Commit: 67b9ed7

Test stats 🧪

Test Results
Failed 0
Passed 33
Skipped 12
Total 45

Log output

Expand to view the last 100 lines of log output

[2020-12-10T18:22:21.765Z] --- PASS: TestNewKibanaClientWithPathStartingWithSlash (0.00s)
[2020-12-10T18:22:21.765Z] === RUN   TestNewKibanaClientWithPathStartingWithoutSlash
[2020-12-10T18:22:21.765Z] --- PASS: TestNewKibanaClientWithPathStartingWithoutSlash (0.00s)
[2020-12-10T18:22:21.765Z] === RUN   TestNewKibanaClientWithMultiplePathsKeepsLastOne
[2020-12-10T18:22:21.765Z] --- PASS: TestNewKibanaClientWithMultiplePathsKeepsLastOne (0.00s)
[2020-12-10T18:22:21.765Z] PASS
[2020-12-10T18:22:21.765Z] ok  	github.com/elastic/e2e-testing/cli/services	0.020s
[2020-12-10T18:22:21.765Z] === RUN   TestGetEnvBool
[2020-12-10T18:22:21.765Z] --- PASS: TestGetEnvBool (0.00s)
[2020-12-10T18:22:21.766Z] PASS
[2020-12-10T18:22:21.766Z] ok  	github.com/elastic/e2e-testing/cli/shell	0.005s
[2020-12-10T18:22:22.026Z] make: Leaving directory '/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-537/src/github.com/elastic/e2e-testing/cli'
[2020-12-10T18:22:22.026Z] + go get -v -u github.com/jstemmer/go-junit-report
[2020-12-10T18:22:22.026Z] go: downloading github.com/jstemmer/go-junit-report v0.9.1
[2020-12-10T18:22:22.026Z] go: github.com/jstemmer/go-junit-report upgrade => v0.9.1
[2020-12-10T18:22:22.026Z] github.com/jstemmer/go-junit-report/parser
[2020-12-10T18:22:22.026Z] github.com/jstemmer/go-junit-report/formatter
[2020-12-10T18:22:22.287Z] github.com/jstemmer/go-junit-report
[2020-12-10T18:22:22.547Z] + go-junit-report
[2020-12-10T18:22:23.612Z] Post stage
[2020-12-10T18:22:23.636Z] Recording test results
[2020-12-10T18:22:24.024Z] Archiving artifacts
[2020-12-10T18:22:25.060Z] [INFO] getVaultSecret: Getting secrets
[2020-12-10T18:22:25.145Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-12-10T18:22:26.286Z] + set +x
[2020-12-10T18:22:26.286Z] Login Succeeded
[2020-12-10T18:22:26.453Z] Running in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-537/src/github.com/elastic/e2e-testing/e2e
[2020-12-10T18:22:26.772Z] + make build-docs
[2020-12-10T18:22:26.772Z] rm -fr docs
[2020-12-10T18:22:28.156Z] Pickles v.2.20.1.0
[2020-12-10T18:22:28.156Z]  
[2020-12-10T18:22:28.156Z] Generating documentation based on the following parameters 
[2020-12-10T18:22:28.156Z] ---------------------------------------------------------- 
[2020-12-10T18:22:28.156Z] Feature Directory              : /suites 
[2020-12-10T18:22:28.156Z] Output Directory               : /suites/docs 
[2020-12-10T18:22:28.156Z] Project Name                   : E2E Testing 
[2020-12-10T18:22:28.156Z] Project Version                : 1.0.0 
[2020-12-10T18:22:28.156Z] Language                       : en 
[2020-12-10T18:22:28.156Z] Incorporate Test Results?      : No 
[2020-12-10T18:22:28.156Z] Include Experimental Features? : No 
[2020-12-10T18:22:28.156Z] Exclude Tag                    :  
[2020-12-10T18:22:28.156Z] Technical Tag                    :  
[2020-12-10T18:22:28.416Z] Writing HTML to /suites/docs 
[2020-12-10T18:22:28.675Z] Pickles completed successfully 
[2020-12-10T18:22:28.936Z] # because pickledocs is a Windows tool, there is a wrong slash.
[2020-12-10T18:22:28.936Z] mv docs/.\\/index.html docs/index.html
[2020-12-10T18:22:28.936Z] rm -fr docs/.\\
[2020-12-10T18:22:28.992Z] Post stage
[2020-12-10T18:22:29.012Z] Running in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-537/src/github.com/elastic/e2e-testing
[2020-12-10T18:22:29.055Z] Archiving artifacts
[2020-12-10T18:22:31.027Z] Running in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-537/src/github.com/elastic/e2e-testing
[2020-12-10T18:22:31.438Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:31.501Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/helm/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:31.529Z] [WARN] The helm:apm-server test suite won't be executed because there are no modified files
[2020-12-10T18:22:31.851Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:31.914Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/helm/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:31.941Z] [WARN] The helm:filebeat test suite won't be executed because there are no modified files
[2020-12-10T18:22:32.258Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:32.323Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/helm/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:32.351Z] [WARN] The helm:metricbeat test suite won't be executed because there are no modified files
[2020-12-10T18:22:32.671Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:32.730Z] [INFO] isGitRegionMatch: found with regex [^e2e/_suites/fleet/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:32.756Z] [INFO] Adding fleet:agent_endpoint_integration test suite to the build execution
[2020-12-10T18:22:33.074Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:33.140Z] [INFO] isGitRegionMatch: found with regex [^e2e/_suites/fleet/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:33.166Z] [INFO] Adding fleet:stand_alone_agent test suite to the build execution
[2020-12-10T18:22:33.489Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:33.550Z] [INFO] isGitRegionMatch: found with regex [^e2e/_suites/fleet/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:33.577Z] [INFO] Adding fleet:fleet_mode_agent test suite to the build execution
[2020-12-10T18:22:33.897Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:33.959Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/metricbeat/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:33.987Z] [WARN] The metricbeat:integrations && apache test suite won't be executed because there are no modified files
[2020-12-10T18:22:34.307Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:34.371Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/metricbeat/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:34.399Z] [WARN] The metricbeat:metricbeat test suite won't be executed because there are no modified files
[2020-12-10T18:22:34.721Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:34.784Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/metricbeat/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:34.810Z] [WARN] The metricbeat:integrations && mysql test suite won't be executed because there are no modified files
[2020-12-10T18:22:35.130Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:35.197Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/metricbeat/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:35.226Z] [WARN] The metricbeat:integrations && redis test suite won't be executed because there are no modified files
[2020-12-10T18:22:35.545Z] + git diff --name-only origin/master...67b9ed7f7805df33a5dbdeb597edc460d92c9a88
[2020-12-10T18:22:35.608Z] [INFO] isGitRegionMatch: not found with regex [^e2e/_suites/metricbeat/.*, ^.ci/.*, ^cli/.*, ^e2e/.*\.go]
[2020-12-10T18:22:35.637Z] [WARN] The metricbeat:integrations && vsphere test suite won't be executed because there are no modified files
[2020-12-10T18:22:50.722Z] Still waiting to schedule task
[2020-12-10T18:22:50.723Z] All nodes of label ‘ubuntu-18.04&&immutable&&docker’ are offline
[2020-12-10T18:22:50.738Z] Still waiting to schedule task
[2020-12-10T18:22:50.738Z] All nodes of label ‘ubuntu-18.04&&immutable&&docker’ are offline
[2020-12-10T18:22:50.753Z] Still waiting to schedule task
[2020-12-10T18:22:50.754Z] All nodes of label ‘ubuntu-18.04&&immutable&&docker’ are offline
[2020-12-10T18:23:22.774Z] Failed in branch fleet_agent_endpoint_integration
[2020-12-10T18:23:22.784Z] Failed in branch fleet_stand_alone_agent
[2020-12-10T18:23:22.795Z] Failed in branch fleet_fleet_mode_agent
[2020-12-10T18:23:25.312Z] Stage "Release" skipped due to earlier failure(s)
[2020-12-10T18:23:26.103Z] Running on beats-ci-immutable-ubuntu-1804-1607624557463999938 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-537@2
[2020-12-10T18:23:26.220Z] [INFO] getVaultSecret: Getting secrets
[2020-12-10T18:23:26.302Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-12-10T18:23:28.412Z] + chmod 755 generate-build-data.sh
[2020-12-10T18:23:28.412Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-537/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-537/runs/1 ABORTED 602596
[2020-12-10T18:23:28.412Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-537/runs/1/steps/?limit=10000 -o steps-info.json

@EricDavisX EricDavisX merged commit cb8d4c9 into elastic:master Dec 10, 2020
@ph
Copy link
Contributor

ph commented Dec 10, 2020

@EricDavisX Is because the artifact is gone or not build is that the situation?

@elasticmachine
Copy link
Contributor

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #537 updated

  • Start Time: 2020-12-10T18:20:44.519+0000

  • Duration: 22 min 13 sec

Test stats 🧪

Test Results
Failed 0
Passed 60
Skipped 12
Total 72

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 60
Skipped 12
Total 72

@michalpristas
Copy link
Contributor Author

@ph tests are failing for PR build which are configured a bit differently i spoke with eric and he shared a way how this might be possible to configure locally.
for me it looks like the path to artifacts are hardcoded and it tries to find 7.10 artifact in this hardcoded path which contains PR artifacts.
nightly tests were working ok

@EricDavisX
Copy link
Contributor

indeed. there are different ways to fix it, but the pr tests runs (signed by a pr-1234 type of notation passed in for the agent_version string) will need a different logic branching for how / where to find the desired artifacts based on how we write the tests. michal let me know if you want to chat it

mdelapenya pushed a commit that referenced this pull request Jan 4, 2021
This was referenced Jan 4, 2021
mdelapenya added a commit that referenced this pull request Jan 12, 2021
* upgrade

* may the force

* working yay

* jenkins var

* revert json logs

* uninstall revert

* looogs

* added wait

* then and

* no online check

* updated

* rephrased

* tar installer

* install certs

* be declarative

* conflicts

* make it nice

* reverse order

* reverse order

* removed wait

* disable upgrade tests (#537)

* chore: bump stale version for 7.x

Co-authored-by: Michal Pristas <[email protected]>
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Jan 12, 2021
* upgrade

* may the force

* working yay

* jenkins var

* revert json logs

* uninstall revert

* looogs

* added wait

* then and

* no online check

* updated

* rephrased

* tar installer

* install certs

* be declarative

* conflicts

* make it nice

* reverse order

* reverse order

* removed wait

* disable upgrade tests (elastic#537)

* chore: bump stale version for 7.x

Co-authored-by: Michal Pristas <[email protected]>
@mdelapenya mdelapenya mentioned this pull request Jan 12, 2021
10 tasks
mdelapenya added a commit that referenced this pull request Jan 12, 2021
* [7.10.x] Backport #537

* upgrade

* may the force

* working yay

* jenkins var

* revert json logs

* uninstall revert

* looogs

* added wait

* then and

* no online check

* updated

* rephrased

* tar installer

* install certs

* be declarative

* conflicts

* make it nice

* reverse order

* reverse order

* removed wait

* disable upgrade tests (#537)

* chore: bump stale version for 7.x

Co-authored-by: Michal Pristas <[email protected]>

* chore: bump stale version to (7.10.x - 1)

At this moment 7.10.x = 7.10.2

Co-authored-by: Michal Pristas <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants