[QA] Switch to Saved Objs API #89633

wayneseymour · 2021-01-28T20:21:06Z

Closes #89368

Add fns for dir creation, exporting and persisting.

wayneseymour · 2021-01-29T18:10:51Z

@elasticmachine merge upstream

Temporarily hijack es archiver's load fn to export saved objects.

kibanamachine · 2021-02-03T19:16:07Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request
Commit: dfa51e8
Pipeline Steps (look for red circles / failed steps)
Interpreting CI Failures

Failed CI Steps

Test Failures

Kibana Pipeline / general / Chrome UI Functional Tests.test/functional/apps/visualize/index·ts.visualize app "before all" hook in "visualize app"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://github.com/elastic/kibana/issues/50337

[00:00:00]       │
[00:00:00]         └-: visualize app
[00:00:00]           └-> "before all" hook
[00:00:00]           └-> "before all" hook
[00:00:00]             │ debg Starting visualize before method
[00:00:00]             │ info [logstash_functional] Loading "mappings.json"
[00:00:00]             │ info [logstash_functional] Loading "data.json.gz"
[00:00:00]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [logstash-2015.09.22] creating index, cause [api], templates [], shards [1]/[0]
[00:00:00]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.22][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.22][0]]"
[00:00:00]             │ info [logstash_functional] Created index "logstash-2015.09.22"
[00:00:00]             │ debg [logstash_functional] "logstash-2015.09.22" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:00]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [logstash-2015.09.20] creating index, cause [api], templates [], shards [1]/[0]
[00:00:00]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.20][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.20][0]]"
[00:00:00]             │ info [logstash_functional] Created index "logstash-2015.09.20"
[00:00:00]             │ debg [logstash_functional] "logstash-2015.09.20" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:00]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [logstash-2015.09.21] creating index, cause [api], templates [], shards [1]/[0]
[00:00:00]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.21][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.21][0]]"
[00:00:00]             │ info [logstash_functional] Created index "logstash-2015.09.21"
[00:00:00]             │ debg [logstash_functional] "logstash-2015.09.21" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:10]             │ info progress: 10823
[00:00:12]             │ info [logstash_functional] Indexed 4633 docs into "logstash-2015.09.22"
[00:00:12]             │ info [logstash_functional] Indexed 4757 docs into "logstash-2015.09.20"
[00:00:12]             │ info [logstash_functional] Indexed 4614 docs into "logstash-2015.09.21"
[00:00:12]             │ info Taking screenshot "/dev/shm/workspace/parallel/10/kibana/test/functional/screenshots/failure/visualize app _before all_ hook.png"
[00:00:12]             │ info Current URL is: data:/,
[00:00:12]             │ info Saving page source to: /dev/shm/workspace/parallel/10/kibana/test/functional/failure_debug/html/visualize app _before all_ hook.html
[00:00:12]             └- ✖ fail: visualize app "before all" hook in "visualize app"
[00:00:12]             │      Error: ECONNREFUSED: Connection refused
[00:00:12]             │       at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:165:15)
[00:00:12]             │       at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
[00:00:12]             │       at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
[00:00:12]             │       at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
[00:00:12]             │       at ClientRequest.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:646:10)
[00:00:12]             │       at Socket.socketErrorListener (_http_client.js:469:9)
[00:00:12]             │       at emitErrorNT (internal/streams/destroy.js:106:8)
[00:00:12]             │       at emitErrorCloseNT (internal/streams/destroy.js:74:3)
[00:00:12]             │       at processTicksAndRejections (internal/process/task_queues.js:80:21)
[00:00:12]             │ 
[00:00:12]             │

Stack Trace

Error: ECONNREFUSED: Connection refused
    at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:165:15)
    at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
    at ClientRequest.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:646:10)
    at Socket.socketErrorListener (_http_client.js:469:9)
    at emitErrorNT (internal/streams/destroy.js:106:8)
    at emitErrorCloseNT (internal/streams/destroy.js:74:3)
    at processTicksAndRejections (internal/process/task_queues.js:80:21)

Kibana Pipeline / general / Chrome UI Functional Tests.test/functional/apps/management/index·ts.management "before all" hook in "management"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: management
[00:00:00]           └-> "before all" hook
[00:00:00]           └-> "before all" hook
[00:00:00]             │ info [logstash_functional] Unloading indices from "mappings.json"
[00:00:00]             │ info [logstash_functional] Unloading indices from "data.json.gz"
[00:00:00]             │ info [empty_kibana] Loading "mappings.json"
[00:00:00]             │ info [empty_kibana] Loading "data.json.gz"
[00:00:01]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana_1/kAeX7UtKQ5mUZ0aPV80DwQ] deleting index
[00:00:01]             │ info [empty_kibana] Deleted existing index ".kibana_1"
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:00:01]             │ info [empty_kibana] Created index ".kibana"
[00:00:01]             │ debg [empty_kibana] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:00:01]             │ info [empty_kibana] Indexed 1 docs into ".kibana"
[00:00:01]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana/YBMCK-m1SuKxkKb0-ItJRg] update_mapping [_doc]
[00:00:01]             │ debg Migrating saved objects
[00:00:01]             │ proc [kibana]   log   [19:26:05.785] [info][savedobjects-service] Creating index .kibana_2.
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] updating number_of_replicas to [0] for indices [.kibana_2]
[00:00:01]             │ proc [kibana]   log   [19:26:05.866] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] updating number_of_replicas to [0] for indices [.kibana_1]
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.tasks] creating index, cause [auto(task api)], templates [], shards [1]/[1]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] updating number_of_replicas to [0] for indices [.tasks]
[00:00:01]             │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] 104 finished with response BulkByScrollResponse[took=75.2ms,timed_out=false,sliceId=null,updated=0,created=1,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:00:01]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana/YBMCK-m1SuKxkKb0-ItJRg] deleting index
[00:00:01]             │ proc [kibana]   log   [19:26:06.267] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:00:01]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [.kibana_2/5J-VbVCaS1GYY1vbiW-UKQ] update_mapping [_doc]
[00:00:01]             │ proc [kibana]   log   [19:26:06.349] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:00:01]             │ proc [kibana]   log   [19:26:06.396] [info][savedobjects-service] Finished in 615ms.
[00:00:01]             │ debg [empty_kibana] Migrated Kibana index after loading Kibana data
[00:00:01]             │ info Taking screenshot "/dev/shm/workspace/parallel/14/kibana/test/functional/screenshots/failure/management _before all_ hook.png"
[00:00:02]             │ info Current URL is: data:/,
[00:00:02]             │ info Saving page source to: /dev/shm/workspace/parallel/14/kibana/test/functional/failure_debug/html/management _before all_ hook.html
[00:00:02]             └- ✖ fail: management "before all" hook in "management"
[00:00:02]             │      Error: ECONNREFUSED: Connection refused
[00:00:02]             │       at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:165:15)
[00:00:02]             │       at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
[00:00:02]             │       at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
[00:00:02]             │       at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
[00:00:02]             │       at ClientRequest.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:646:10)
[00:00:02]             │       at Socket.socketErrorListener (_http_client.js:469:9)
[00:00:02]             │       at emitErrorNT (internal/streams/destroy.js:106:8)
[00:00:02]             │       at emitErrorCloseNT (internal/streams/destroy.js:74:3)
[00:00:02]             │       at processTicksAndRejections (internal/process/task_queues.js:80:21)
[00:00:02]             │ 
[00:00:02]             │

Stack Trace

Error: ECONNREFUSED: Connection refused
    at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:165:15)
    at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
    at ClientRequest.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:646:10)
    at Socket.socketErrorListener (_http_client.js:469:9)
    at emitErrorNT (internal/streams/destroy.js:106:8)
    at emitErrorCloseNT (internal/streams/destroy.js:74:3)
    at processTicksAndRejections (internal/process/task_queues.js:80:21)

Kibana Pipeline / general / Chrome UI Functional Tests.test/functional/apps/dashboard/index·ts.dashboard app using current data "before all" hook: loadCurrentData in "using current data"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: dashboard app
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: using current data
[00:00:00]             └-> "before all" hook
[00:00:00]             └-> "before all" hook: loadCurrentData
[00:00:00]               │ info [logstash_functional] Unloading indices from "mappings.json"
[00:00:00]               │ info [logstash_functional] Unloading indices from "data.json.gz"
[00:00:01]               │ info [dashboard/current/data] Loading "mappings.json"
[00:00:01]               │ info [dashboard/current/data] Loading "data.json.gz"
[00:00:01]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [animals-dogs-2018-01-01] creating index, cause [api], templates [], shards [5]/[1]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-dogs-2018-01-01"
[00:00:01]               │ debg [dashboard/current/data] "animals-dogs-2018-01-01" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [animals-dogs-2018-04-10] creating index, cause [api], templates [], shards [5]/[1]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-dogs-2018-04-10"
[00:00:01]               │ debg [dashboard/current/data] "animals-dogs-2018-04-10" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [animals-cats-2018-01-01] creating index, cause [api], templates [], shards [5]/[1]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-cats-2018-01-01"
[00:00:01]               │ debg [dashboard/current/data] "animals-cats-2018-01-01" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [animals-cats-2018-04-10] creating index, cause [api], templates [], shards [5]/[1]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-cats-2018-04-10"
[00:00:01]               │ debg [dashboard/current/data] "animals-cats-2018-04-10" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [dogbreeds] creating index, cause [api], templates [], shards [5]/[1]
[00:00:02]               │ info [dashboard/current/data] Created index "dogbreeds"
[00:00:02]               │ debg [dashboard/current/data] "dogbreeds" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:02]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612378745666887292] [logstash-0] creating index, cause [api], templates [], shards [1]/[0]
[00:00:02]               │ info [dashboard/current/data] Created index "logstash-0"
[00:00:02]               │ debg [dashboard/current/data] "logstash-0" settings {"index":{"analysis":{"analyzer":{"makelogs_url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:11]               │ info progress: 6912
[00:00:17]               │ info [dashboard/current/data] Indexed 6 docs into "animals-dogs-2018-01-01"
[00:00:17]               │ info [dashboard/current/data] Indexed 6 docs into "animals-dogs-2018-04-10"
[00:00:17]               │ info [dashboard/current/data] Indexed 6 docs into "animals-cats-2018-01-01"
[00:00:17]               │ info [dashboard/current/data] Indexed 5 docs into "animals-cats-2018-04-10"
[00:00:17]               │ info [dashboard/current/data] Indexed 6 docs into "dogbreeds"
[00:00:17]               │ info [dashboard/current/data] Indexed 14005 docs into "logstash-0"
[00:00:18]               │ info Taking screenshot "/dev/shm/workspace/parallel/15/kibana/test/functional/screenshots/failure/dashboard app using current data _before all_ hook_ loadCurrentData.png"
[00:00:18]               │ info Current URL is: data:/,
[00:00:18]               │ info Saving page source to: /dev/shm/workspace/parallel/15/kibana/test/functional/failure_debug/html/dashboard app using current data _before all_ hook_ loadCurrentData.html
[00:00:18]               └- ✖ fail: dashboard app using current data "before all" hook: loadCurrentData in "using current data"
[00:00:18]               │      Error: ECONNREFUSED: Connection refused
[00:00:18]               │       at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:165:15)
[00:00:18]               │       at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
[00:00:18]               │       at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
[00:00:18]               │       at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
[00:00:18]               │       at ClientRequest.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:646:10)
[00:00:18]               │       at Socket.socketErrorListener (_http_client.js:469:9)
[00:00:18]               │       at emitErrorNT (internal/streams/destroy.js:106:8)
[00:00:18]               │       at emitErrorCloseNT (internal/streams/destroy.js:74:3)
[00:00:18]               │       at processTicksAndRejections (internal/process/task_queues.js:80:21)
[00:00:18]               │ 
[00:00:18]               │

Stack Trace

Error: ECONNREFUSED: Connection refused
    at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:165:15)
    at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
    at ClientRequest.<anonymous> (/dev/shm/workspace/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:646:10)
    at Socket.socketErrorListener (_http_client.js:469:9)
    at emitErrorNT (internal/streams/destroy.js:106:8)
    at emitErrorCloseNT (internal/streams/destroy.js:74:3)
    at processTicksAndRejections (internal/process/task_queues.js:80:21)

and 30 more failures, only showing the first 3.

Metrics [docs]

✅ unchanged

History

💔 Build #103280 failed fa9b7e3
💔 Build #102731 failed 482bb345d5ee6a39def6d6141c1e512342eeb6ae
💛 Build #102305 was flaky 072f200
💚 Build #102266 succeeded f4b28e35793436340d192d9e54b46f2dced872f4

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

wayneseymour added v8.0.0 release_note:skip Skip the PR/issue when compiling release notes labels Jan 28, 2021

wayneseymour self-assigned this Jan 28, 2021

wayneseymour force-pushed the use-save-objs-api branch 2 times, most recently from 072f200 to 482bb34 Compare February 1, 2021 19:39

LeeDr mentioned this pull request Feb 2, 2021

ESArchiver should specify 'x-elastic-product-origin': 'kibana' when accessing Kibana's system-indices #89805

Closed

wayneseymour force-pushed the use-save-objs-api branch from 482bb34 to fa9b7e3 Compare February 3, 2021 02:41

wayneseymour requested a review from a team as a code owner February 3, 2021 02:41

[QA] Switch to Saved Objs API

dfa51e8

Temporarily hijack es archiver's load fn to export saved objects.

wayneseymour force-pushed the use-save-objs-api branch from fa9b7e3 to dfa51e8 Compare February 3, 2021 18:58

wayneseymour closed this Feb 3, 2021

wayneseymour deleted the use-save-objs-api branch August 10, 2021 12:38

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[QA] Switch to Saved Objs API #89633

[QA] Switch to Saved Objs API #89633

wayneseymour commented Jan 28, 2021 •

edited

Loading

wayneseymour commented Jan 29, 2021

kibanamachine commented Feb 3, 2021 •

edited

Loading

Standard Out

Stack Trace

Standard Out

Stack Trace

Standard Out

Stack Trace

[QA] Switch to Saved Objs API #89633

[QA] Switch to Saved Objs API #89633

Conversation

wayneseymour commented Jan 28, 2021 • edited Loading

wayneseymour commented Jan 29, 2021

kibanamachine commented Feb 3, 2021 • edited Loading

💔 Build Failed

Failed CI Steps

Test Failures

Standard Out

Stack Trace

Standard Out

Stack Trace

Standard Out

Stack Trace

Metrics [docs]

History

wayneseymour commented Jan 28, 2021 •

edited

Loading

kibanamachine commented Feb 3, 2021 •

edited

Loading