Cherry-pick #21391 to 7.x: [libbeat] Enable WriteAheadLimit in the disk queue #21401

faec · 2020-09-29T20:25:42Z

Cherry-pick of PR #21391 to 7.x branch. Original message:

This PR activates the previously inert setting WriteAheadLimit, which limits how many events the disk queue will store in memory waiting to be written to disk (this is to prevent unbounded memory use / provide back-pressure when the beat is under extremely high load and is receiving inputs faster than they can be written to disk).

(cherry picked from commit ef6274d)

elasticmachine · 2020-09-29T21:52:20Z

💔 Tests Failed

Expand to view the summary

Build stats

Build Cause: [Pull request #21401 opened]
Start Time: 2020-09-29T20:27:05.664+0000
Duration: 85 min 56 sec

Test stats 🧪

Test	Results
Failed	321
Passed	15689
Skipped	1350
Total	17360

Test errors

Expand to view the tests failures

Name: Build&Test / x-pack/metricbeat-build / TestFetch – ec2
- Age: 1
- Duration: 19.11
- Error Details: Failed
Name: Build&Test / libbeat-build / TestOutputReload – pipeline
- Age: 1
- Duration: 65.3
- Error Details: Failed
Name: Build&Test / libbeat-build / TestOutputReload/network_client – pipeline
- Age: 1
- Duration: 36.61
- Error Details: Failed
Name: Build&Test / filebeat-build / test_fileset_file_034_osquery – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 90.003
- Error Details: Failed: Timeout >90.0s
Name: Build&Test / filebeat-build / test_fileset_file_035_osquery – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.264
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_036_osquery – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.208
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_037_osquery – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.203
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_038_redis – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.207
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_039_redis – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.155
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_040_redis – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.191
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_041_redis – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.155
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_042_redis – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.228
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_043_haproxy – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.18
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_044_haproxy – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.208
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_045_haproxy – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.167
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_046_haproxy – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.136
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_047_nats – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.146
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_048_santa – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.143
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_049_icinga – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.161
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_050_icinga – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.18
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_051_icinga – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.185
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_052_traefik – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.182
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_053_logstash – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.191
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_054_logstash – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.204
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_055_logstash – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.165
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_056_logstash – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.19
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_057_logstash – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.169
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_058_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.152
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_059_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.13
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_060_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.15
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_061_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.119
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_062_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.163
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_063_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.187
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_064_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.171
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_065_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.123
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_066_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.227
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_067_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.135
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_068_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.128
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_069_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.147
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_070_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.167
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_071_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.192
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_072_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.165
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_073_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.138
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_074_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.159
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_075_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.122
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_076_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.139
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_077_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.102
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_078_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.101
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_079_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.156
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_080_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.142
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_081_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.143
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_082_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.233
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_083_elasticsearch – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.141
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_084_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.113
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_085_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.148
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_086_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.17
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_087_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.15
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_088_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.138
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_089_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.139
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_090_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.103
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_091_apache – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.087
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_092_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.091
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_093_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.105
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_094_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.104
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_095_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.095
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_096_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.094
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_097_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.186
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_098_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.137
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_099_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.114
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_100_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.112
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_101_postgresql – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.142
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_102_auditd – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.184
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_103_auditd – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.137
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_104_auditd – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.172
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_105_auditd – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.14
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_106_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.14
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_107_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.097
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_108_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.142
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_109_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.101
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_110_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.09
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_111_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.095
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_112_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.086
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_113_system – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.091
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_114_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.146
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_115_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.099
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_116_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.25
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_117_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.117
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_118_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.117
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_119_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.132
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_120_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.107
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_fileset_file_121_kafka – filebeat.tests.system.test_modules.Test
- Age: 1
- Duration: 10.13
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / filebeat-build / test_stdin_eof – filebeat.tests.system.test_stdin.Test
- Age: 1
- Duration: 10.099
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_002_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 90.003
- Error Details: Failed: Timeout >90.0s
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_003_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.239
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_004_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.138
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_005_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.245
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_006_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.218
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_007_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.221
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_008_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.238
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_009_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.241
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

Steps errors

Expand to view the steps failures

Name: mage build test
- Description: mage build test
- Duration: 42 min 39 sec
- Start Time: 2020-09-29T20:53:45.817+0000
- log
Name: Notifies GitHub of the status of a Pull Request
- Description: script returned exit code 1
- Duration: 0 min 1 sec
- Start Time: 2020-09-29T21:35:46.885+0000
- log
Name: mage build test
- Description: mage build test
- Duration: 22 min 41 sec
- Start Time: 2020-09-29T20:53:48.333+0000
- log
Name: Notifies GitHub of the status of a Pull Request
- Description: script returned exit code 1
- Duration: 0 min 1 sec
- Start Time: 2020-09-29T21:15:44.531+0000
- log
Name: mage build test
- Description: mage build test
- Duration: 55 min 8 sec
- Start Time: 2020-09-29T20:53:59.478+0000
- log
Name: Notifies GitHub of the status of a Pull Request
- Description: script returned exit code 1
- Duration: 0 min 1 sec
- Start Time: 2020-09-29T21:49:59.519+0000
- log
Name: mage build test
- Description: mage build test
- Duration: 25 min 50 sec
- Start Time: 2020-09-29T21:00:22.235+0000
- log
Name: Notifies GitHub of the status of a Pull Request
- Description: script returned exit code 1
- Duration: 0 min 2 sec
- Start Time: 2020-09-29T21:25:24.808+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-09-29T21:49:52.782Z]  runc:
[2020-09-29T21:49:52.782Z]   Version:          1.0.0-rc10
[2020-09-29T21:49:52.782Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-09-29T21:49:52.782Z]  docker-init:
[2020-09-29T21:49:52.782Z]   Version:          0.18.0
[2020-09-29T21:49:52.782Z]   GitCommit:        fec3683
[2020-09-29T21:50:00.964Z] Failed in branch x-pack/filebeat-build
[2020-09-29T21:50:05.700Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-09-29T21:50:05.728Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-09-29T21:50:05.804Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21401-1/source/source.tgz
[2020-09-29T21:50:05.823Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21401-1/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21401/source.tgz
[2020-09-29T21:50:19.259Z] + tar --version
[2020-09-29T21:50:19.583Z] + tar -xpf source.tgz
[2020-09-29T21:50:32.188Z] + rm source.tgz
[2020-09-29T21:50:32.281Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats
[2020-09-29T21:50:32.311Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/uncategorized-1601412592711
[2020-09-29T21:50:32.401Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/libbeat-stress-tests-1601412837149
[2020-09-29T21:50:32.494Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/winlogbeat-crosscompile-1601412912394
[2020-09-29T21:50:32.589Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/auditbeat-crosscompile-1601412935024
[2020-09-29T21:50:32.681Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-elastic-agent-build-1601412961573
[2020-09-29T21:50:32.777Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-dockerlogbeat-build-1601413001915
[2020-09-29T21:50:32.868Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/journalbeat-unitTest-1601413021533
[2020-09-29T21:50:32.964Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/libbeat-crosscompile-1601413085689
[2020-09-29T21:50:33.063Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-functionbeat-build-1601413109532
[2020-09-29T21:50:33.157Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/packetbeat-build-1601413216479
[2020-09-29T21:50:33.247Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-elastic-agent-windows-windows-2019-1601413317478
[2020-09-29T21:50:33.338Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-unitTest-1601413337900
[2020-09-29T21:50:33.428Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/auditbeat-windows-windows-2019-1601413383407
[2020-09-29T21:50:33.521Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/heartbeat-build-1601413427664
[2020-09-29T21:50:33.611Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/heartbeat-windows-windows-2019-1601413433261
[2020-09-29T21:50:33.701Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-auditbeat-windows-windows-2019-1601413437628
[2020-09-29T21:50:33.790Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-crosscompile-1601413479275
[2020-09-29T21:50:33.880Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-auditbeat-build-1601413486967
[2020-09-29T21:50:33.970Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/generator-beat-test-1601413492065
[2020-09-29T21:50:34.059Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/generator-metricbeat-test-1601413520869
[2020-09-29T21:50:34.149Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/auditbeat-build-1601413535145
[2020-09-29T21:50:34.239Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/winlogbeat-windows-windows-2019-1601413624643
[2020-09-29T21:50:34.327Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-libbeat-build-1601413632121
[2020-09-29T21:50:34.418Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-functionbeat-windows-windows-2019-1601413632322
[2020-09-29T21:50:34.508Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/packetbeat-windows-windows-2019-1601413662683
[2020-09-29T21:50:34.597Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1601413667416
[2020-09-29T21:50:34.689Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/filebeat-windows-windows-2019-1601413675937
[2020-09-29T21:50:34.784Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-winlogbeat-build-windows-2019-1601413736696
[2020-09-29T21:50:34.877Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-windows-windows-2019-1601413860346
[2020-09-29T21:50:34.967Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/libbeat-build-1601414134725
[2020-09-29T21:50:35.063Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-windows-windows-2019-1601414143610
[2020-09-29T21:50:35.156Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-build-1601414717967
[2020-09-29T21:50:35.252Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-pythonIntegTest-1601414824703
[2020-09-29T21:50:35.345Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-goIntegTest-1601415142024
[2020-09-29T21:50:35.439Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/filebeat-build-1601415331379
[2020-09-29T21:50:35.528Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-filebeat-build-1601416156160
[2020-09-29T21:50:35.947Z] + cat
[2020-09-29T21:50:35.947Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-09-29T21:50:35.947Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-09-29T21:50:42.557Z] runbld>>> runbld started
[2020-09-29T21:50:42.557Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-09-29T21:50:44.488Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-09-29T21:50:44.488Z] runbld>>> Matches in the system config:
[2020-09-29T21:50:44.488Z] runbld>>> - Matched ^elastic\+beats
[2020-09-29T21:50:44.488Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-09-29T21:50:45.884Z] runbld>>> Debug logging enabled.
[2020-09-29T21:50:45.884Z] runbld>>> Storing result
[2020-09-29T21:50:46.148Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-09-29T21:50:46.148Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20200929215045-6B2975D1
[2020-09-29T21:50:46.148Z] runbld>>> Adding system facts.
[2020-09-29T21:50:47.555Z] runbld>>> Adding vcs info for the latest commit:  b4a000d30134110c5e00db8adfe03baca1d4adde
[2020-09-29T21:50:47.555Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-09-29T21:50:47.555Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-09-29T21:50:47.555Z] + echo 'Processing JUnit reports with runbld...'
[2020-09-29T21:50:47.555Z] Processing JUnit reports with runbld...
[2020-09-29T21:50:47.823Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-09-29T21:50:47.823Z] runbld>>> DURATION: 35ms
[2020-09-29T21:50:47.823Z] runbld>>> STDOUT: 40 bytes
[2020-09-29T21:50:47.823Z] runbld>>> STDERR: 49 bytes
[2020-09-29T21:50:47.823Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-09-29T21:50:47.824Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21401
[2020-09-29T21:50:48.774Z] runbld>>> Storing build metadata: 
[2020-09-29T21:50:48.774Z] runbld>>> Adding test report.
[2020-09-29T21:50:48.774Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats
[2020-09-29T21:50:49.725Z] runbld>>> Found 121 test output files
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-goIntegTest-1601415142024/metricbeat/build/TEST-go-integration-graphite.xml
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/metricbeat-goIntegTest-1601415142024/metricbeat/build/TEST-go-integration-windows.xml
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-build-1601414717967/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-build-1601414717967/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-build-1601414717967/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-build-1601414717967/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-09-29T21:50:52.296Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21401/src/github.com/elastic/beats/x-pack-metricbeat-build-1601414717967/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-09-29T21:50:52.872Z] runbld>>> Test output logs contained: Errors: 0 Failures: 321 Tests: 17360 Skipped: 1083
[2020-09-29T21:50:53.136Z] runbld>>> Storing result
[2020-09-29T21:50:53.136Z] runbld>>> FAILURES: 321
[2020-09-29T21:52:00.921Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-09-29T21:52:00.921Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20200929215045-6B2975D1
[2020-09-29T21:52:00.921Z] runbld>>> Email notification disabled by environment variable.
[2020-09-29T21:52:00.922Z] runbld>>> Slack notification disabled by environment variable.
[2020-09-29T21:52:01.257Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21401
[2020-09-29T21:52:01.352Z] [INFO] getVaultSecret: Getting secrets
[2020-09-29T21:52:01.442Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-09-29T21:52:02.312Z] + chmod 755 generate-build-data.sh
[2020-09-29T21:52:02.313Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21401/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21401/runs/1 FAILURE 5096376
[2020-09-29T21:52:02.313Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21401/runs/1/steps/?limit=10000 -o steps-info.json

[libbeat] Enable WriteAheadLimit in the disk queue (elastic#21391)

b4a000d

(cherry picked from commit ef6274d)

faec added [zube]: In Review backport Team:Integrations Label for the Integrations team labels Sep 29, 2020

botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Sep 29, 2020

faec requested a review from kvch September 29, 2020 20:26

kvch approved these changes Sep 30, 2020

View reviewed changes

faec merged commit 7e2c03d into elastic:7.x Sep 30, 2020

faec deleted the backport_21391_7.x branch September 30, 2020 17:45

zube bot added [zube]: Done and removed [zube]: In Review labels Sep 30, 2020

zube bot removed the [zube]: Done label Dec 30, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-pick #21391 to 7.x: [libbeat] Enable WriteAheadLimit in the disk queue #21401

Cherry-pick #21391 to 7.x: [libbeat] Enable WriteAheadLimit in the disk queue #21401

faec commented Sep 29, 2020 •

edited by zube bot

Loading

elasticmachine commented Sep 29, 2020

Build stats

Test stats 🧪

Cherry-pick #21391 to 7.x: [libbeat] Enable WriteAheadLimit in the disk queue #21401

Cherry-pick #21391 to 7.x: [libbeat] Enable WriteAheadLimit in the disk queue #21401

Conversation

faec commented Sep 29, 2020 • edited by zube bot Loading

elasticmachine commented Sep 29, 2020

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

faec commented Sep 29, 2020 •

edited by zube bot

Loading