Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: X-Pack Alerting API Integration Tests.x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy·ts - alerting api integration security and spaces enabled Alerts legacy alerts alerts space_1_all_alerts_none_actions at space1 should schedule actions on legacy alerts #87010

Closed
kibanamachine opened this issue Dec 29, 2020 · 14 comments · Fixed by #87642
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Dec 29, 2020

A test failed on a tracked branch

Error: expected 204 to sort of equal 403
    at Assertion.assert (/dev/shm/workspace/parallel/2/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/2/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:131:83)
    at Object.apply (/dev/shm/workspace/parallel/2/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:84:16) {
  actual: '204',
  expected: '403',
  showDiff: true
}

First failure: Jenkins Build

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Dec 29, 2020
@spalger spalger added the Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) label Dec 29, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-alerting-services (Team:Alerting Services)

@spalger
Copy link
Contributor

spalger commented Dec 29, 2020

Looks like this has only failed in one unrelated PR and here in the last 30 days, making this not particularly flaky, so waiting and watching for now.

@jbudz
Copy link
Member

jbudz commented Jan 1, 2021

We had another failure with https://kibana-ci.elastic.co/job/elastic+kibana+master/10822/, skips:

main: 308827a
7.x: b4400b7

jloleysens added a commit to jloleysens/kibana that referenced this issue Jan 4, 2021
…meline-component

* 'master' of github.com:elastic/kibana: (955 commits)
  remove SameSite:None workaround (elastic#86994)
  URL encoding for URL drilldown (elastic#86902)
  [Security Solution] Fix few styling issues (elastic#87045)
  [APM] Custom links can still be created with a read only user. (elastic#87089)
  prevent double update (elastic#86794)
  Upgrade @hapi/hoek to revert hack introduced in hapi v20 upgrade (elastic#87113)
  [APM] Every time the new Header Icon is clicked it fetches data (elastic#87093)
  [APM] Add range query to service map trace walk (elastic#86631)
  [Discover] Deangularize navbar in context app (elastic#86353)
  skip "should schedule actions on legacy alerts" elastic#87010
  🍾 update notice text for 2021
  [logstash] remove "upgrade" functionality now that .logstash is a system index (elastic#87056)
  Enable prototype pollution protection in TSVB (elastic#85952)
  [Security Solution] add a consistent spelling of ES in Policy Response (elastic#87073)
  [SECURITY_SOLUTION][ENDPOINT] Delete Endpoint Policy List code (elastic#87063)
  Adds more URLs to the docs links service (elastic#86972)
  Add missing backticks in reporting-settings.asciidoc (elastic#77979)
  [test/functional_cors] 9000 is sometimes in use, make getPort random (elastic#87050)
  [Security Solution] Fix Timeline filter EuiSuperSelect styling (elastic#87033)
  [Lens] Fix duplicate suggestions on single-bucket charts (elastic#86996)
  ...

# Conflicts:
#	x-pack/plugins/index_lifecycle_management/public/application/sections/edit_policy/components/index.ts
@mikecote mikecote self-assigned this Jan 4, 2021
@mikecote
Copy link
Contributor

mikecote commented Jan 4, 2021

https://kibana-ci.elastic.co/job/elastic+kibana+master/10752/
[00:05:09]                 └-: space_1_all_alerts_none_actions at space1
[00:05:09]                   └-> "before all" hook
[00:05:09]                   └-> "before all" hook
[00:05:09]                   └-> should schedule actions on legacy alerts
[00:05:09]                     └-> "before each" hook: global before each
[00:05:10]                     │ proc [kibana]   log   [17:43:23.570] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:23.569Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.573] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:23.572Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.576] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:23.575Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.578] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:23.577Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.583] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:21.595Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:21.595Z","outcome":"success","end":"2020-12-29T17:43:23.582Z","duration":1987000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.587] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:21.596Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:21.596Z","outcome":"success","end":"2020-12-29T17:43:23.586Z","duration":1990000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.589] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:21.596Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:21.596Z","outcome":"success","end":"2020-12-29T17:43:23.589Z","duration":1993000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:10]                     │ proc [kibana]   log   [17:43:23.592] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:21.595Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:21.595Z","outcome":"success","end":"2020-12-29T17:43:23.592Z","duration":1997000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:11]                     │ debg --- retry.try error: expected 0 to be above 0
[00:05:12]                     │ proc [kibana]   log   [17:43:25.604] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.603Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.609] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.609Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.614] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.614Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.620] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.618Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:24.725Z","end":"2020-12-29T17:43:25.618Z","duration":893000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.622] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.622Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:24.734Z","end":"2020-12-29T17:43:25.622Z","duration":888000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.630] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.629Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.635] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.634Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:24.736Z","end":"2020-12-29T17:43:25.634Z","duration":898000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ proc [kibana]   log   [17:43:25.638] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:25.637Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:24.729Z","end":"2020-12-29T17:43:25.637Z","duration":908000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:12]                     │ debg --- retry.try failed again with the same message...
[00:05:12]                     │ debg --- retry.try failed again with the same message...
[00:05:13]                     │ proc [kibana]   log   [17:43:26.600] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:26.599Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.602] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:26.601Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.605] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:26.604Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.606] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:26.606Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.611] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:24.607Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:24.607Z","outcome":"success","end":"2020-12-29T17:43:26.610Z","duration":2003000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.623] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:24.607Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:24.607Z","outcome":"success","end":"2020-12-29T17:43:26.622Z","duration":2015000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.626] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:24.607Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:24.608Z","outcome":"success","end":"2020-12-29T17:43:26.625Z","duration":2017000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ proc [kibana]   log   [17:43:26.631] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:24.606Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:24.606Z","outcome":"success","end":"2020-12-29T17:43:26.631Z","duration":2025000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:13]                     │ debg --- retry.try failed again with the same message...
[00:05:13]                     │ debg --- retry.try failed again with the same message...
[00:05:14]                     │ debg --- retry.try failed again with the same message...
[00:05:14]                     │ debg --- retry.try failed again with the same message...
[00:05:15]                     │ proc [kibana]   log   [17:43:28.621] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.620Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.629] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.628Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.635] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.634Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.641] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.641Z","event":{"provider":"alerting","action":"new-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc' created new instance: '1'","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.642] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.642Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.647] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.646Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.650] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.650Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:27.706Z","end":"2020-12-29T17:43:28.650Z","duration":944000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.652] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.652Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:27.709Z","end":"2020-12-29T17:43:28.652Z","duration":943000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.654] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.654Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:27.716Z","end":"2020-12-29T17:43:28.654Z","duration":938000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ proc [kibana]   log   [17:43:28.657] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:28.656Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:27.719Z","end":"2020-12-29T17:43:28.656Z","duration":937000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:15]                     │ debg --- retry.try failed again with the same message...
[00:05:15]                     │ debg --- retry.try failed again with the same message...
[00:05:16]                     │ proc [kibana]   log   [17:43:29.631] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:29.630Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.633] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:29.633Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.635] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:29.635Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.639] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:29.639Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.641] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:29.640Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.646] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:27.618Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:27.618Z","outcome":"success","end":"2020-12-29T17:43:29.645Z","duration":2027000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc'","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.649] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:27.618Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:27.618Z","outcome":"success","end":"2020-12-29T17:43:29.648Z","duration":2030000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.653] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:27.617Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:27.617Z","outcome":"success","end":"2020-12-29T17:43:29.652Z","duration":2035000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.656] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:27.617Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:27.617Z","outcome":"success","end":"2020-12-29T17:43:29.655Z","duration":2038000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ proc [kibana]   log   [17:43:29.660] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:27.617Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:27.617Z","outcome":"success","end":"2020-12-29T17:43:29.659Z","duration":2042000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:16]                     │ debg --- retry.try failed again with the same message...
[00:05:17]                     │ debg --- retry.try failed again with the same message...
[00:05:17]                     │ debg --- retry.try failed again with the same message...
[00:05:18]                     │ debg --- retry.try failed again with the same message...
[00:05:18]                     │ proc [kibana]   log   [17:43:31.651] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.650Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.662] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.661Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.668] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.667Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:30.687Z","end":"2020-12-29T17:43:31.667Z","duration":980000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.671] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.670Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.677] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.676Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.684] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.683Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.689] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.689Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:30.721Z","end":"2020-12-29T17:43:31.689Z","duration":968000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.693] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.692Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:30.723Z","end":"2020-12-29T17:43:31.692Z","duration":969000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.696] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.695Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:30.726Z","end":"2020-12-29T17:43:31.695Z","duration":969000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:18]                     │ proc [kibana]   log   [17:43:31.700] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:31.700Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:30.732Z","end":"2020-12-29T17:43:31.700Z","duration":968000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.682] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:32.681Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.684] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:32.684Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.699] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:32.698Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.702] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:32.701Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.705] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:32.705Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.713] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:30.563Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:30.563Z","outcome":"success","end":"2020-12-29T17:43:32.712Z","duration":2149000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc'","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.717] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:30.564Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:30.564Z","outcome":"success","end":"2020-12-29T17:43:32.716Z","duration":2152000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.726] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:30.563Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:30.563Z","outcome":"success","end":"2020-12-29T17:43:32.726Z","duration":2163000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.730] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:30.564Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:30.564Z","outcome":"success","end":"2020-12-29T17:43:32.729Z","duration":2165000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:19]                     │ proc [kibana]   log   [17:43:32.737] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:30.564Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:30.564Z","outcome":"success","end":"2020-12-29T17:43:32.736Z","duration":2172000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.660] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.658Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.662] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.662Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.664] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.664Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.666] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.665Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.670] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.669Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.672] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.672Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:33.629Z","end":"2020-12-29T17:43:33.672Z","duration":43000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.674] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.674Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:33.636Z","end":"2020-12-29T17:43:33.674Z","duration":38000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.676] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.676Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:33.639Z","end":"2020-12-29T17:43:33.676Z","duration":37000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.679] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.678Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:33.642Z","end":"2020-12-29T17:43:33.678Z","duration":36000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.680] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.680Z","event":{"provider":"actions","action":"execute","start":"2020-12-29T17:43:33.645Z","end":"2020-12-29T17:43:33.680Z","duration":35000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.699] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.545Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:33.545Z","outcome":"success","end":"2020-12-29T17:43:33.698Z","duration":153000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.703] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.544Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:33.545Z","outcome":"success","end":"2020-12-29T17:43:33.702Z","duration":157000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"6ee9630a-a20e-44af-9465-217a3717d2ab","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:6ee9630a-a20e-44af-9465-217a3717d2ab: 'abc'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.706] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.546Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:33.546Z","outcome":"success","end":"2020-12-29T17:43:33.705Z","duration":159000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.710] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.545Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:33.545Z","outcome":"success","end":"2020-12-29T17:43:33.710Z","duration":165000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:20]                     │ proc [kibana]   log   [17:43:33.840] [warning][alerting][alerts][plugins][plugins] alertsClient.update('6ee9630a-a20e-44af-9465-217a3717d2ab') conflict, exceeded retries
[00:05:21]                     │ proc [kibana]   log   [17:43:34.712] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:34.711Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:05:21]                     │ proc [kibana]   log   [17:43:34.720] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:33.545Z","event":{"provider":"alerting","action":"execute","start":"2020-12-29T17:43:33.545Z","outcome":"success","end":"2020-12-29T17:43:34.719Z","duration":1174000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:05:23]                     │ proc [kibana]   log   [17:43:36.669] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:36.668Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"5cc59319-74ee-4edc-8646-a79ea91067cd","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:5cc59319-74ee-4edc-8646-a79ea91067cd: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:23]                     │ proc [kibana]   log   [17:43:36.676] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:36.675Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:23]                     │ proc [kibana]   log   [17:43:36.682] [info][eventLog][plugins] event logged: {"@timestamp":"2020-12-29T17:43:36.681Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:05:23]                     └- ✖ fail: alerting api integration security and spaces enabled Alerts legacy alerts alerts space_1_all_alerts_none_actions at space1 should schedule actions on legacy alerts
[00:05:23]                     │       Error: expected 204 to sort of equal 403
[00:05:23]                     │       + expected - actual
[00:05:23]                     │ 
[00:05:23]                     │       -204
[00:05:23]                     │       +403
[00:05:23]                     │       
[00:05:23]                     │       at Assertion.assert (/dev/shm/workspace/parallel/2/kibana/packages/kbn-expect/expect.js:100:11)
[00:05:23]                     │       at Assertion.eql (/dev/shm/workspace/parallel/2/kibana/packages/kbn-expect/expect.js:244:8)
[00:05:23]                     │       at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:131:83)
[00:05:23]                     │       at Object.apply (/dev/shm/workspace/parallel/2/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:84:16)
[00:05:23]                     │ 
[00:05:23]                     │ 
https://kibana-ci.elastic.co/job/elastic+kibana+master/10822/
[00:04:42]                 └-: space_1_all at space1
[00:04:42]                   └-> "before all" hook
[00:04:42]                   └-> "before all" hook
[00:04:42]                   └-> should schedule actions on legacy alerts
[00:04:42]                     └-> "before each" hook: global before each
[00:04:44]                     │ proc [kibana]   log   [15:45:03.732] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:03.731Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:02.755Z","end":"2021-01-01T15:45:03.731Z","duration":976000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:44]                     │ proc [kibana]   log   [15:45:03.735] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:03.734Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:44]                     │ proc [kibana]   log   [15:45:03.739] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:03.739Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:44]                     │ proc [kibana]   log   [15:45:03.746] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:03.745Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:02.757Z","end":"2021-01-01T15:45:03.745Z","duration":988000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:45]                     │ debg --- retry.try error: expected 0 to be above 0
[00:04:45]                     │ proc [kibana]   log   [15:45:04.501] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:04.500Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:45]                     │ proc [kibana]   log   [15:45:04.503] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:04.502Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:45]                     │ proc [kibana]   log   [15:45:04.508] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:02.689Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:02.689Z","outcome":"success","end":"2021-01-01T15:45:04.508Z","duration":1819000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:45]                     │ proc [kibana]   log   [15:45:04.511] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:02.689Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:02.689Z","outcome":"success","end":"2021-01-01T15:45:04.510Z","duration":1821000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:45]                     │ debg --- retry.try failed again with the same message...
[00:04:46]                     │ debg --- retry.try failed again with the same message...
[00:04:46]                     │ debg --- retry.try failed again with the same message...
[00:04:47]                     │ debg --- retry.try failed again with the same message...
[00:04:47]                     │ proc [kibana]   log   [15:45:06.744] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:06.743Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:47]                     │ proc [kibana]   log   [15:45:06.749] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:06.748Z","event":{"provider":"alerting","action":"new-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc' created new instance: '1'","ecs":{"version":"1.6.0"}}
[00:04:47]                     │ proc [kibana]   log   [15:45:06.750] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:06.749Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:47]                     │ proc [kibana]   log   [15:45:06.755] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:06.754Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:05.757Z","end":"2021-01-01T15:45:06.754Z","duration":997000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:47]                     │ proc [kibana]   log   [15:45:06.758] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:06.757Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:47]                     │ proc [kibana]   log   [15:45:06.762] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:06.762Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:05.758Z","end":"2021-01-01T15:45:06.762Z","duration":1004000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:47]                     │ debg --- retry.try failed again with the same message...
[00:04:48]                     │ debg --- retry.try failed again with the same message...
[00:04:48]                     │ proc [kibana]   log   [15:45:07.528] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:07.527Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:48]                     │ proc [kibana]   log   [15:45:07.530] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:07.529Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:48]                     │ proc [kibana]   log   [15:45:07.532] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:07.531Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:48]                     │ proc [kibana]   log   [15:45:07.546] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:05.700Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:05.700Z","outcome":"success","end":"2021-01-01T15:45:07.545Z","duration":1845000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:48]                     │ proc [kibana]   log   [15:45:07.549] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:05.700Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:05.700Z","outcome":"success","end":"2021-01-01T15:45:07.549Z","duration":1849000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc'","ecs":{"version":"1.6.0"}}
[00:04:48]                     │ proc [kibana]   log   [15:45:07.553] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:05.700Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:05.700Z","outcome":"success","end":"2021-01-01T15:45:07.552Z","duration":1852000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:48]                     │ debg --- retry.try failed again with the same message...
[00:04:49]                     │ debg --- retry.try failed again with the same message...
[00:04:50]                     │ debg --- retry.try failed again with the same message...
[00:04:50]                     │ debg --- retry.try failed again with the same message...
[00:04:50]                     │ proc [kibana]   log   [15:45:09.759] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:09.758Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:08.758Z","end":"2021-01-01T15:45:09.758Z","duration":1000000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:50]                     │ proc [kibana]   log   [15:45:09.765] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:09.764Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:50]                     │ proc [kibana]   log   [15:45:09.770] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:09.769Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:50]                     │ proc [kibana]   log   [15:45:09.776] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:09.775Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:50]                     │ proc [kibana]   log   [15:45:09.782] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:09.781Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:08.775Z","end":"2021-01-01T15:45:09.781Z","duration":1006000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:50]                     │ proc [kibana]   log   [15:45:09.785] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:09.784Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:08.777Z","end":"2021-01-01T15:45:09.784Z","duration":1007000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:51]                     │ proc [kibana]   log   [15:45:10.560] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:10.559Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:51]                     │ proc [kibana]   log   [15:45:10.562] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:10.562Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:51]                     │ proc [kibana]   log   [15:45:10.564] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:10.564Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:51]                     │ proc [kibana]   log   [15:45:10.570] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:08.692Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:08.692Z","outcome":"success","end":"2021-01-01T15:45:10.569Z","duration":1877000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'abc'","ecs":{"version":"1.6.0"}}
[00:04:51]                     │ proc [kibana]   log   [15:45:10.573] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:08.692Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:08.692Z","outcome":"success","end":"2021-01-01T15:45:10.572Z","duration":1880000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:51]                     │ proc [kibana]   log   [15:45:10.576] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:08.692Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:08.692Z","outcome":"success","end":"2021-01-01T15:45:10.576Z","duration":1884000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:52]                     │ proc [kibana]   log   [15:45:11.773] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:11.772Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:52]                     │ proc [kibana]   log   [15:45:11.782] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:11.782Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.586] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:12.585Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.589] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:12.588Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.601] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:11.687Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:11.687Z","outcome":"success","end":"2021-01-01T15:45:12.600Z","duration":913000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.607] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:11.687Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:11.687Z","outcome":"success","end":"2021-01-01T15:45:12.606Z","duration":919000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.776] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:12.776Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:11.769Z","end":"2021-01-01T15:45:12.775Z","duration":1006000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.779] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:12.779Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.784] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:12.783Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:11.787Z","end":"2021-01-01T15:45:12.783Z","duration":996000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:53]                     │ proc [kibana]   log   [15:45:12.786] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:12.786Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:11.789Z","end":"2021-01-01T15:45:12.786Z","duration":997000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:54]                     │ proc [kibana]   log   [15:45:13.609] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:13.608Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:54]                     │ proc [kibana]   log   [15:45:13.620] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:11.687Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:11.687Z","outcome":"success","end":"2021-01-01T15:45:13.619Z","duration":1932000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:55]                     │ proc [kibana]   log   [15:45:14.786] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.785Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:55]                     │ proc [kibana]   log   [15:45:14.792] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.791Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:55]                     │ proc [kibana]   log   [15:45:14.796] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.795Z","event":{"provider":"alerting","action":"active-instance"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' active instance: '1' in actionGroup: 'default'","ecs":{"version":"1.6.0"}}
[00:04:55]                     │ proc [kibana]   log   [15:45:14.800] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.799Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:14.767Z","end":"2021-01-01T15:45:14.799Z","duration":32000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:55]                     │ proc [kibana]   log   [15:45:14.802] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.801Z","event":{"provider":"actions","action":"execute","start":"2021-01-01T15:45:14.772Z","end":"2021-01-01T15:45:14.801Z","duration":29000000,"outcome":"success"},"kibana":{"saved_objects":[{"rel":"primary","type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"action executed: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b: My action","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.637] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:15.636Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.640] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:15.639Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.642] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:15.641Z","event":{"provider":"alerting","action":"execute-action"},"kibana":{"alerting":{"instance_id":"1","action_group_id":"default"},"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"},{"type":"action","id":"17f38826-5a8d-4a76-975a-b496e7fffe0b","namespace":"space1"}],"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert' instanceId: '1' scheduled actionGroup: 'default' action: test.index-record:17f38826-5a8d-4a76-975a-b496e7fffe0b","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.648] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.693Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:14.693Z","outcome":"success","end":"2021-01-01T15:45:15.648Z","duration":955000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"362e362b-a137-4aa2-9434-43e3d0d84a34","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:362e362b-a137-4aa2-9434-43e3d0d84a34: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.651] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.693Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:14.693Z","outcome":"success","end":"2021-01-01T15:45:15.650Z","duration":957000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"d41a6abb-b93b-46df-a80a-926221ea847c","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:d41a6abb-b93b-46df-a80a-926221ea847c: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.653] [info][eventLog][plugins] event logged: {"@timestamp":"2021-01-01T15:45:14.692Z","event":{"provider":"alerting","action":"execute","start":"2021-01-01T15:45:14.692Z","outcome":"success","end":"2021-01-01T15:45:15.653Z","duration":961000000},"kibana":{"saved_objects":[{"rel":"primary","type":"alert","id":"b384be60-ec53-4b26-857e-0253ee55b277","namespace":"space1"}],"alerting":{"status":"active"},"server_uuid":"5b2de169-2785-441b-ae8c-186a1936b17d"},"message":"alert executed: test.always-firing:b384be60-ec53-4b26-857e-0253ee55b277: 'Updated Alert'","ecs":{"version":"1.6.0"}}
[00:04:56]                     │ proc [kibana]   log   [15:45:15.659] [warning][alerting][alerts][plugins][plugins] alertsClient.updateApiKey('d41a6abb-b93b-46df-a80a-926221ea847c') conflict, exceeded retries
[00:04:56]                     └- ✖ fail: alerting api integration security and spaces enabled Alerts legacy alerts alerts space_1_all at space1 should schedule actions on legacy alerts
[00:04:56]                     │       Error: expected 409 to sort of equal 204
[00:04:56]                     │       + expected - actual
[00:04:56]                     │ 
[00:04:56]                     │       -409
[00:04:56]                     │       +204
[00:04:56]                     │       
[00:04:56]                     │       at Assertion.assert (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:100:11)
[00:04:56]                     │       at Assertion.eql (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:244:8)
[00:04:56]                     │       at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:89:56)
[00:04:56]                     │       at Object.apply (/dev/shm/workspace/parallel/5/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:84:16)
[00:04:56]                     │ 
[00:04:56]                     │ 

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine kibanamachine reopened this Feb 27, 2021
@mikecote mikecote removed their assignment Mar 1, 2021
@ymao1
Copy link
Contributor

ymao1 commented Mar 2, 2021

04:37:41       │1 failing
04:37:41       │
04:37:41       │1)    alerting api integration security and spaces enabled
04:37:41       │       Alerts
04:37:41       │         legacy alerts
04:37:41       │           alerts
04:37:41       │             space_1_all_alerts_none_actions at space1
04:37:41       │               should schedule actions on legacy alerts:
04:37:41       │
04:37:41       │      retry.try timeout: Error: expected 1 to be above 1
04:37:41       │     at Assertion.assert (/dev/shm/workspace/parallel/14/kibana/packages/kbn-expect/expect.js:100:11)
04:37:41       │     at Assertion.greaterThan.Assertion.above (/dev/shm/workspace/parallel/14/kibana/packages/kbn-expect/expect.js:317:8)
04:37:41       │     at Function.greaterThan (/dev/shm/workspace/parallel/14/kibana/packages/kbn-expect/expect.js:531:15)
04:37:41       │     at /dev/shm/workspace/parallel/14/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:215:64
04:37:41       │     at runMicrotasks (<anonymous>)
04:37:41       │     at processTicksAndRejections (internal/process/task_queues.js:93:5)
04:37:41       │     at runAttempt (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry_for_success.ts:27:15)
04:37:41       │     at retryForSuccess (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry_for_success.ts:66:21)
04:37:41       │     at Retry.try (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry.ts:32:14)
04:37:41       │     at ensureAlertIsRunning (/dev/shm/workspace/parallel/14/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:204:13)
04:37:41       │     at Context.<anonymous> (/dev/shm/workspace/parallel/14/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:125:15)
04:37:41       │     at Object.apply (/dev/shm/workspace/parallel/14/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
04:37:41       │   Error: retry.try timeout: Error: expected 1 to be above 1
04:37:41       │       at Assertion.assert (/dev/shm/workspace/parallel/14/kibana/packages/kbn-expect/expect.js:100:11)
04:37:41       │       at Assertion.greaterThan.Assertion.above (/dev/shm/workspace/parallel/14/kibana/packages/kbn-expect/expect.js:317:8)
04:37:41       │       at Function.greaterThan (/dev/shm/workspace/parallel/14/kibana/packages/kbn-expect/expect.js:531:15)
04:37:41       │       at /dev/shm/workspace/parallel/14/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:215:64
04:37:41       │       at runMicrotasks (<anonymous>)
04:37:41       │       at processTicksAndRejections (internal/process/task_queues.js:93:5)
04:37:41       │       at runAttempt (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry_for_success.ts:27:15)
04:37:41       │       at retryForSuccess (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry_for_success.ts:66:21)
04:37:41       │       at Retry.try (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry.ts:32:14)
04:37:41       │       at ensureAlertIsRunning (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:204:13)
04:37:41       │       at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:125:15)
04:37:41       │       at Object.apply (/dev/shm/workspace/parallel/14/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
04:37:41       │       at onFailure (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry_for_success.ts:17:9)
04:37:41       │       at retryForSuccess (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry_for_success.ts:57:13)
04:37:41       │       at Retry.try (/dev/shm/workspace/parallel/14/kibana/test/common/services/retry/retry.ts:32:14)
04:37:41       │       at ensureAlertIsRunning (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:204:13)
04:37:41       │       at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:125:15)
04:37:41       │       at Object.apply (/dev/shm/workspace/parallel/14/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)

@pmuellr
Copy link
Member

pmuellr commented Mar 2, 2021

I'm wondering if there is some odd chance that this has caught an error in our code - we've had a couple of reports of "legacy" alerts not running in the field, when we expected them to, but never determined what was causing that. The specific failure in this test is showing the same problem.

Might be useful to spend a couple of minutes looking through the legacy RBAC stuff ... but I assume this is probably just a flaky test of some kind.

@ymao1
Copy link
Contributor

ymao1 commented Mar 2, 2021

I recently fixed another legacy rbac test failure #92549 where the root cause was a race condition in how the functional test runner loads and migrates from the esArchiver. This could be another flake caused by something similar.

@gmmorris
Copy link
Contributor

gmmorris commented Mar 2, 2021

Looks like the previous failures in this test were a different issue (fixed by Mike), so I'd put money down on flaky test rather than functionality....
Definitely worth checking if it's the same issue @ymao1

@mikecote
Copy link
Contributor

It's been a few weeks since the last flaky failure. I will go ahead and close this.

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine kibanamachine reopened this Apr 3, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@mikecote
Copy link
Contributor

[00:07:11]                     └- ✖ fail: alerting api integration security and spaces enabled Alerts legacy alerts alerts space_1_all_alerts_none_actions at space1 should schedule actions on legacy alerts
[00:07:11]                     │      retry.try timeout: Error: expected 0 to be above 0
[00:07:11]                     │     at Assertion.assert (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/expect/expect.js:100:11)
[00:07:11]                     │     at Assertion.greaterThan.Assertion.above (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/expect/expect.js:317:8)
[00:07:11]                     │     at Function.greaterThan (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/expect/expect.js:531:15)
[00:07:11]                     │     at /dev/shm/workspace/parallel/2/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:215:64
[00:07:11]                     │     at runMicrotasks (<anonymous>)
[00:07:11]                     │     at processTicksAndRejections (internal/process/task_queues.js:93:5)
[00:07:11]                     │     at runAttempt (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry_for_success.ts:27:15)
[00:07:11]                     │     at retryForSuccess (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry_for_success.ts:66:21)
[00:07:11]                     │     at Retry.try (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry.ts:32:14)
[00:07:11]                     │     at ensureAlertIsRunning (/dev/shm/workspace/parallel/2/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:204:13)
[00:07:11]                     │     at Context.<anonymous> (/dev/shm/workspace/parallel/2/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:125:15)
[00:07:11]                     │     at Object.apply (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:07:11]                     │   Error: retry.try timeout: Error: expected 0 to be above 0
[00:07:11]                     │       at Assertion.assert (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/expect/expect.js:100:11)
[00:07:11]                     │       at Assertion.greaterThan.Assertion.above (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/expect/expect.js:317:8)
[00:07:11]                     │       at Function.greaterThan (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/expect/expect.js:531:15)
[00:07:11]                     │       at /dev/shm/workspace/parallel/2/kibana/x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:215:64
[00:07:11]                     │       at runMicrotasks (<anonymous>)
[00:07:11]                     │       at processTicksAndRejections (internal/process/task_queues.js:93:5)
[00:07:11]                     │       at runAttempt (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry_for_success.ts:27:15)
[00:07:11]                     │       at retryForSuccess (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry_for_success.ts:66:21)
[00:07:11]                     │       at Retry.try (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry.ts:32:14)
[00:07:11]                     │       at ensureAlertIsRunning (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:204:13)
[00:07:11]                     │       at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:125:15)
[00:07:11]                     │       at Object.apply (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:07:11]                     │       at onFailure (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry_for_success.ts:17:9)
[00:07:11]                     │       at retryForSuccess (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry_for_success.ts:57:13)
[00:07:11]                     │       at Retry.try (/dev/shm/workspace/parallel/2/kibana/test/common/services/retry/retry.ts:32:14)
[00:07:11]                     │       at ensureAlertIsRunning (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:204:13)
[00:07:11]                     │       at Context.<anonymous> (test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:125:15)
[00:07:11]                     │       at Object.apply (/dev/shm/workspace/parallel/2/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:07:11]                     │ 
[00:07:11]                     │ 

@mikecote
Copy link
Contributor

Flakiness hasn't returned in a few weeks, closing for now.

@kobelb kobelb added the needs-team Issues missing a team label label Jan 31, 2022
@botelastic botelastic bot removed the needs-team Issues missing a team label label Jan 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)
Projects
None yet
Development

Successfully merging a pull request may close this issue.

9 participants