Upgrade elasticsearch client library used in tests #20405

jsoriano · 2020-08-03T17:03:10Z

What does this PR do?

Upgrade elasticsearch client library used in python tests.

Why is it important?

Old version uses deprecated Python functions that will be removed in Python 3.9.

Related issues

Relates to Support Python 3.9 in developer tools #20384

elasticmachine · 2020-08-03T17:03:13Z

Pinging @elastic/integrations (Team:Integrations)

elasticmachine · 2020-08-03T19:13:15Z

💔 Tests Failed

Expand to view the summary

Build stats

Build Cause: [jsoriano commented: jenkins run the tests please]
Start Time: 2020-08-04T18:13:37.439+0000
Duration: 69 min 41 sec

Test stats 🧪

Test	Results
Failed	11
Passed	14467
Skipped	1373
Total	15851

Test errors

Expand to view the tests failures

Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_0_ccr – test_elasticsearch.Test
- Age: 1
- Duration: 0.043
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/module/dropwizard/docker-compose.yml
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  compose.parallel: DEBUG: Pending: {<Container: dropwizard_4faacb4a71472c5b_dropwizard_1 (e26395)>}
  compose.parallel: DEBUG: Starting producer thread for <Container: dropwizard_4faacb4a71472c5b_dropwizard_1 (e26395)>
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Finished processing: <Container: dropwizard_4faacb4a71472c5b_dropwizard_1 (e26395)>
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: {<Container: dropwizard_4faacb4a71472c5b_dropwizard_1 (e26395)>}
  compose.parallel: DEBUG: Starting producer thread for <Container: dropwizard_4faacb4a71472c5b_dropwizard_1 (e26395)>
  compose.parallel: DEBUG: Finished processing: <Container: dropwizard_4faacb4a71472c5b_dropwizard_1 (e26395)>
  compose.parallel: DEBUG: Pending: set()
  compose.network: INFO: Removing network dropwizard_4faacb4a71472c5b_default
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  compose.service: INFO: Pulling elasticsearch (docker.elastic.co/integrations-ci/beats-elasticsearch:7.7.0-1)...
  docker.auth: DEBUG: Looking for auth config
  docker.auth: DEBUG: No auth config in memory - loading from filesystem
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.auth: DEBUG: Looking for auth entry for 'docker.elastic.co'
  docker.auth: DEBUG: No entry found
  docker.auth: DEBUG: No auth config found
  compose.service: ERROR: 404 Client Error: Not Found ("manifest for docker.elastic.co/integrations-ci/beats-elasticsearch:7.7.0-1 not found: manifest unknown: manifest unknown")
  compose.parallel: DEBUG: Pending: {<Service: elasticsearch>}
  compose.parallel: DEBUG: Starting producer thread for <Service: elasticsearch>
  compose.parallel: DEBUG: Pending: {<Container: metricbeat_7918a246f6f8_elasticsearch_1 (d1ef39)>}
  compose.parallel: DEBUG: Starting producer thread for <Container: metricbeat_7918a246f6f8_elasticsearch_1 (d1ef39)>
  compose.service: DEBUG: Added config hash: 43d81a13e65dcc2e8fb581276c4d2048a90e41fb0d0fa9411a57052a2d5d5e24
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Finished processing: <Container: metricbeat_7918a246f6f8_elasticsearch_1 (d1ef39)>
  compose.parallel: DEBUG: Pending: set()
  compose.parallel: DEBUG: Finished processing: <Service: elasticsearch>
  compose.parallel: DEBUG: Pending: set()
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_1_enrich – test_elasticsearch.Test
- Age: 1
- Duration: 0.037
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_2_index – test_elasticsearch.Test
- Age: 1
- Duration: 0.037
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_3_index_summary – test_elasticsearch.Test
- Age: 1
- Duration: 0.037
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_4_ml_job – test_elasticsearch.Test
- Age: 1
- Duration: 0.035
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_5_index_recovery – test_elasticsearch.Test
- Age: 1
- Duration: 0.036
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_6_node_stats – test_elasticsearch.Test
- Age: 1
- Duration: 0.036
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_7_node – test_elasticsearch.Test
- Age: 1
- Duration: 0.037
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_metricsets_8_shard – test_elasticsearch.Test
- Age: 1
- Duration: 0.036
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_xpack – test_elasticsearch.Test
- Age: 1
- Duration: 0.036
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------
Name: Build and Test / Metricbeat OSS Python Integration tests / test_xpack_cluster_stats – test_elasticsearch.Test
- Age: 1
- Duration: 0.035
- Error Details: module 'elasticsearch.client.xpack' has no attribute 'ml'
  -------------------- >> begin captured logging << --------------------
  compose.config.config: DEBUG: Using configuration files: /go/src/github.com/elastic/beats/metricbeat/docker-compose.yml
  compose.config.environment: WARNING: The PWD variable is not set. Defaulting to a blank string.
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  docker.utils.config: DEBUG: Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
  docker.utils.config: DEBUG: No config file found
  --------------------- >> end captured logging << ---------------------

Steps errors

Expand to view the steps failures

Name: Install docker-compose 1.21.0
- Description: .ci/scripts/install-docker-compose.sh
- Duration: 1 min 57 sec
- Start Time: 2020-08-04T18:37:53.015+0000
- log
Name: Install docker-compose 1.21.0
- Description: .ci/scripts/install-docker-compose.sh
- Duration: 1 min 57 sec
- Start Time: 2020-08-04T18:37:54.917+0000
- log
Name: Install Go 1.14.4
- Description: .ci/scripts/install-go.sh
- Duration: 3 min 37 sec
- Start Time: 2020-08-04T18:37:12.685+0000
- log
Name: Install Go 1.14.4
- Description: .ci/scripts/install-go.sh
- Duration: 2 min 22 sec
- Start Time: 2020-08-04T18:37:19.452+0000
- log
Name: Mage pythonIntegTest
- Description: mage pythonIntegTest
- Duration: 37 min 9 sec
- Start Time: 2020-08-04T18:39:58.719+0000
- log
Name: Install Go 1.14.4
- Description: .ci/scripts/install-go.sh
- Duration: 2 min 22 sec
- Start Time: 2020-08-04T18:37:16.402+0000
- log
Name: Install Go 1.14.4
- Description: .ci/scripts/install-go.sh
- Duration: 1 min 57 sec
- Start Time: 2020-08-04T18:37:19.175+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-08-04T19:21:46.959Z] + chmod +x /var/lib/jenkins/workspace/Beats_beats_PR-20405/bin/terraform
[2020-08-04T19:21:47.319Z] + make mage
[2020-08-04T19:21:47.319Z] Installing mage v1.10.0.
[2020-08-04T19:21:48.257Z] go: downloading github.com/magefile/mage v1.10.0
[2020-08-04T19:21:50.164Z] /var/lib/jenkins/workspace/Beats_beats_PR-20405/.magefile cleaned
[2020-08-04T19:21:50.495Z] + git config --get user.email
[2020-08-04T19:21:50.495Z] + [ -z  ]
[2020-08-04T19:21:50.495Z] + git config user.email [email protected]
[2020-08-04T19:21:50.495Z] + git config user.name beatsmachine
[2020-08-04T19:21:50.876Z] + .ci/scripts/terraform-cleanup.sh x-pack/metricbeat
[2020-08-04T19:21:50.876Z] + DIRECTORY=x-pack/metricbeat
[2020-08-04T19:21:50.876Z] + FAILED=0
[2020-08-04T19:21:50.876Z] ++ find x-pack/metricbeat -name terraform.tfstate
[2020-08-04T19:21:50.876Z] + exit 0
[2020-08-04T19:21:51.367Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats
[2020-08-04T19:21:51.683Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-08-04T19:21:51.695Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Lint
[2020-08-04T19:21:51.788Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-08-04T19:21:51.867Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Winlogbeat-oss
[2020-08-04T19:21:51.955Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Journalbeat-oss
[2020-08-04T19:21:52.039Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Dockerlogbeat
[2020-08-04T19:21:52.123Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-08-04T19:21:52.204Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-08-04T19:21:52.289Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-08-04T19:21:52.384Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-08-04T19:21:52.472Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-08-04T19:21:52.555Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-08-04T19:21:52.636Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-08-04T19:21:52.727Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Packetbeat-Linux
[2020-08-04T19:21:52.817Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Heartbeat-oss
[2020-08-04T19:21:52.908Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-08-04T19:21:52.995Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-08-04T19:21:53.082Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-08-04T19:21:53.169Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-08-04T19:21:53.254Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Filebeat-Windows
[2020-08-04T19:21:53.339Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Libbeat-x-pack
[2020-08-04T19:21:53.424Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-08-04T19:21:53.507Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-08-04T19:21:53.589Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-Windows
[2020-08-04T19:21:53.686Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-08-04T19:21:53.768Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Heartbeat-Windows
[2020-08-04T19:21:53.850Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Functionbeat-Windows
[2020-08-04T19:21:53.942Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-08-04T19:21:54.019Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Packetbeat-Windows
[2020-08-04T19:21:54.101Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Filebeat-oss
[2020-08-04T19:21:54.177Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Filebeat-x-pack
[2020-08-04T19:21:54.270Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Libbeat-oss
[2020-08-04T19:21:54.364Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests
[2020-08-04T19:21:54.437Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Libbeat-crosscompile
[2020-08-04T19:21:54.513Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Libbeat-stress-tests
[2020-08-04T19:21:54.587Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-OSS-Python-Integration-tests
[2020-08-04T19:21:54.666Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-08-04T19:21:55.031Z] + cat
[2020-08-04T19:21:55.031Z] + /usr/local/bin/runbld ./runbld-script
[2020-08-04T19:21:55.031Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-08-04T19:22:01.604Z] runbld>>> runbld started
[2020-08-04T19:22:01.604Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-08-04T19:22:02.546Z] runbld>>> The following profiles matched the job 'Beats/beats/PR-20405' in order of occurrence in the config (last value wins).
[2020-08-04T19:22:03.923Z] runbld>>> Debug logging enabled.
[2020-08-04T19:22:03.923Z] runbld>>> Storing result
[2020-08-04T19:22:04.183Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-08-04T19:22:04.183Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200804192203-84D8438F
[2020-08-04T19:22:04.183Z] runbld>>> Adding system facts.
[2020-08-04T19:22:05.120Z] runbld>>> Adding vcs info for the latest commit:  a89265a07ef9920464150f716bdb34ca202f468c
[2020-08-04T19:22:05.120Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-08-04T19:22:05.120Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-08-04T19:22:05.120Z] Processing JUnit reports with runbld...
[2020-08-04T19:22:05.120Z] + echo 'Processing JUnit reports with runbld...'
[2020-08-04T19:22:05.379Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-08-04T19:22:05.379Z] runbld>>> DURATION: 19ms
[2020-08-04T19:22:05.379Z] runbld>>> STDOUT: 40 bytes
[2020-08-04T19:22:05.379Z] runbld>>> STDERR: 49 bytes
[2020-08-04T19:22:05.379Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-08-04T19:22:05.379Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats
[2020-08-04T19:22:06.764Z] runbld>>> Storing build metadata: 
[2020-08-04T19:22:06.764Z] runbld>>> Adding test report.
[2020-08-04T19:22:06.764Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats
[2020-08-04T19:22:07.332Z] runbld>>> Found 119 test output files
[2020-08-04T19:22:07.902Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-08-04T19:22:07.903Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-08-04T19:22:08.162Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-08-04T19:22:08.162Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-08-04T19:22:08.162Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-08-04T19:22:08.162Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-08-04T19:22:08.162Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20405/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-08-04T19:22:10.077Z] runbld>>> Test output logs contained: Errors: 11 Failures: 0 Tests: 15701 Skipped: 1136
[2020-08-04T19:22:10.077Z] runbld>>> Storing result
[2020-08-04T19:22:10.077Z] runbld>>> FAILURES: 11
[2020-08-04T19:22:12.612Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-08-04T19:22:12.612Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200804192203-84D8438F
[2020-08-04T19:22:12.612Z] runbld>>> Email notification disabled by environment variable.
[2020-08-04T19:22:12.612Z] runbld>>> Slack notification disabled by environment variable.
[2020-08-04T19:22:18.118Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats_PR-20405
[2020-08-04T19:22:18.226Z] [INFO] getVaultSecret: Getting secrets
[2020-08-04T19:22:18.299Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-08-04T19:22:20.313Z] + chmod 755 generate-build-data.sh
[2020-08-04T19:22:20.313Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20405/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20405/runs/2 FAILURE 4121444
[2020-08-04T19:22:20.313Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20405/runs/2/steps/?limit=10000 -o steps-info.json
[2020-08-04T19:22:22.661Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20405/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-08-04T19:22:23.372Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20405/runs/2/log/ -o pipeline-log.txt

jsoriano · 2020-08-04T18:13:11Z

jenkins run the tests please

ycombinator

LGTM. WFG.

jsoriano · 2020-08-05T14:14:54Z

Jenkins CI was interrupted due to long time waiting for an osx worker. Tests that weren't executed were executed in Travis. I am merging this.

Upgrade elasticsearch client library used in python tests. Old version uses deprecated Python functions that will be removed in Python 3.9. (cherry picked from commit 945da26)

…ne-2.0 * upstream/master: [docs] Promote ingest management to beta (elastic#20295) Upgrade elasticsearch client library used in tests (elastic#20405) Disable logging when pulling on python integration tests (elastic#20397) Remove pillow from testing requirements.txt (elastic#20407) [Filebeat][ATP Module]Setting user agent field required by the API (elastic#20440) [Ingest Manager] Send datastreams fields (elastic#20402) Add event.ingested to all Filebeat modules (elastic#20386) [Elastic Agent] Fix agent control socket path to always be less than 107 characters (elastic#20426) Improve cgroup_regex docs with examples (elastic#20425) Makes `metrics` config option required in app_insights (elastic#20406) Ensure install scripts only install if needed (elastic#20349) Update container name for the azure filesets (elastic#19899) Group same timestamp metrics values in app_insights metricset (elastic#20403) add_process_metadata processor adds container id even if process metadata not accessible (elastic#19767) Support "cluster" scope in Metricbeat elasticsearch module (elastic#18547) [Filebeat][SophosXG Module] Renaming module and fileset (elastic#20396) Update Suricata dashboards (elastic#20394) [Elastic Agent] Improve version, restart, enroll CLI commands (elastic#20359) Prepare home directories for docker images in a different stage (elastic#20356)

…allation * upstream/master: (23 commits) [docs] Promote ingest management to beta (elastic#20295) Upgrade elasticsearch client library used in tests (elastic#20405) Disable logging when pulling on python integration tests (elastic#20397) Remove pillow from testing requirements.txt (elastic#20407) [Filebeat][ATP Module]Setting user agent field required by the API (elastic#20440) [Ingest Manager] Send datastreams fields (elastic#20402) Add event.ingested to all Filebeat modules (elastic#20386) [Elastic Agent] Fix agent control socket path to always be less than 107 characters (elastic#20426) Improve cgroup_regex docs with examples (elastic#20425) Makes `metrics` config option required in app_insights (elastic#20406) Ensure install scripts only install if needed (elastic#20349) Update container name for the azure filesets (elastic#19899) Group same timestamp metrics values in app_insights metricset (elastic#20403) add_process_metadata processor adds container id even if process metadata not accessible (elastic#19767) Support "cluster" scope in Metricbeat elasticsearch module (elastic#18547) [Filebeat][SophosXG Module] Renaming module and fileset (elastic#20396) Update Suricata dashboards (elastic#20394) [Elastic Agent] Improve version, restart, enroll CLI commands (elastic#20359) Prepare home directories for docker images in a different stage (elastic#20356) New multiline mode in Filebeat: while_pattern (elastic#19662) ...

Upgrade elasticsearch client library used in python tests. Old version uses deprecated Python functions that will be removed in Python 3.9. (cherry picked from commit 945da26)

Upgrade elasticsearch client library used in python tests. Old version uses deprecated Python functions that will be removed in Python 3.9.

Upgrade elasticsearch client library used in tests

8c71157

jsoriano added review :Testing [zube]: In Review Team:Integrations Label for the Integrations team labels Aug 3, 2020

jsoriano self-assigned this Aug 3, 2020

botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 3, 2020

jsoriano mentioned this pull request Aug 3, 2020

Support Python 3.9 in developer tools #20384

Closed

5 tasks

jsoriano added the needs_backport PR is waiting to be backported to other branches. label Aug 3, 2020

Fix reference to ml client

f3cadaf

ycombinator approved these changes Aug 5, 2020

View reviewed changes

jsoriano merged commit 945da26 into elastic:master Aug 5, 2020

jsoriano deleted the elasticsearch-py-7-8 branch August 5, 2020 14:15

jsoriano mentioned this pull request Aug 5, 2020

Cherry-pick #20405 to 7.x: Upgrade elasticsearch client library used in tests #20452

Merged

jsoriano added v7.10.0 and removed needs_backport PR is waiting to be backported to other branches. labels Aug 5, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upgrade elasticsearch client library used in tests #20405

Upgrade elasticsearch client library used in tests #20405

jsoriano commented Aug 3, 2020 •

edited

Loading

elasticmachine commented Aug 3, 2020

elasticmachine commented Aug 3, 2020 •

edited by jenkins-beats-ci bot

Loading

Build stats

Test stats 🧪

jsoriano commented Aug 4, 2020

ycombinator left a comment

jsoriano commented Aug 5, 2020

Upgrade elasticsearch client library used in tests #20405

Upgrade elasticsearch client library used in tests #20405

Conversation

jsoriano commented Aug 3, 2020 • edited Loading

What does this PR do?

Why is it important?

Related issues

elasticmachine commented Aug 3, 2020

elasticmachine commented Aug 3, 2020 • edited by jenkins-beats-ci bot Loading

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

jsoriano commented Aug 4, 2020

ycombinator left a comment

Choose a reason for hiding this comment

jsoriano commented Aug 5, 2020

jsoriano commented Aug 3, 2020 •

edited

Loading

elasticmachine commented Aug 3, 2020 •

edited by jenkins-beats-ci bot

Loading