Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts·ts - Actions and Triggers app alerts should delete all selection #77401

kibanamachine · 2020-09-14T19:55:30Z

A test failed on a tracked branch

{ TimeoutError: The element [data-test-subj="deleteIdsConfirmation"] was still present when it should have disappeared.
Wait timed out after 5106ms
    at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at process._tickCallback (internal/process/next_tick.js:68:7) name: 'TimeoutError', remoteStacktrace: '' }

First failure: Jenkins Build

The text was updated successfully, but these errors were encountered:

elasticmachine · 2020-09-14T19:55:31Z

Pinging @elastic/kibana-test-triage (failed-test)

elasticmachine · 2020-09-16T14:55:05Z

Pinging @elastic/kibana-alerting-services (Team:Alerting Services)

kibanamachine · 2020-09-16T14:57:38Z

New failure: Jenkins Build

spalger · 2020-09-16T17:06:10Z

@gmmorris It looks like this might be caused by an unnecessary timeout being set here:

kibana/x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts.ts

Line 387 in 53a2175

await testSubjects.missingOrFail('deleteIdsConfirmation', { timeout: 5000 });

. Do you think we can just delete the timeout and use the default?

(cherry picked from commit d352edb)

spalger · 2020-09-16T17:18:15Z

My hunch is revealing my bias against people customizing the default timeouts without explanation, but based on the failure pattern in the last 2 weeks seems to indicate this was caused by something else:

6 failures across master and PRs, there doesn't seem to be a clear indicator which PR might have caused an issue causing deletion to be a little slower on CI, but removing the timeout will probably fix it.

Skipping in master and 7.x as a precaution

master: d352edb
7.x/7.10: 3d145da

gmmorris · 2020-09-29T09:27:18Z

@gmmorris It looks like this might be caused by an unnecessary timeout being set here:

kibana/x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts.ts

Line 387 in 53a2175

await testSubjects.missingOrFail('deleteIdsConfirmation', { timeout: 5000 });

. Do you think we can just delete the timeout and use the default?

Sorry Spence, didn't mean to ignore you... missed the notification...
Thanks for handling @YulNaumenko

(cherry picked from commit 886ad85)

spalger · 2020-09-30T22:38:44Z

This test just failed on a snapshot build, and it has failed 11 PRs in the last 7 days since it was unskipped.

Sorry @YulNaumenko but I'm skipping again

master: 886ad85
7.x/7.10: 71e54d5

kibanamachine · 2020-10-17T14:47:38Z

New failure: Jenkins Build

kibanamachine · 2020-12-14T21:42:01Z

New failure: Jenkins Build

mikecote · 2020-12-14T21:54:04Z

[00:02:37]             └-> should delete all selection
[00:02:37]               └-> "before each" hook: global before each
[00:02:42]               │ debg TestSubjects.find(alertSearchField)
[00:02:42]               │ debg Find.findByCssSelector('[data-test-subj="alertSearchField"]') with timeout=10000
[00:02:42]               │ debg Find.findByCssSelector('.euiBasicTable[data-test-subj="alertsList"]:not(.euiBasicTable-loading)') with timeout=10000
[00:02:42]               │ debg TestSubjects.click(checkboxSelectRow-5c7a2641-b482-488a-8717-1b275b02c54a)
[00:02:42]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-5c7a2641-b482-488a-8717-1b275b02c54a"]') with timeout=10000
[00:02:42]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-5c7a2641-b482-488a-8717-1b275b02c54a"]') with timeout=10000
[00:02:42]               │ debg TestSubjects.click(checkboxSelectRow-11ea804a-a7eb-40c9-a1aa-54c05ed5857a)
[00:02:42]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-11ea804a-a7eb-40c9-a1aa-54c05ed5857a"]') with timeout=10000
[00:02:42]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-11ea804a-a7eb-40c9-a1aa-54c05ed5857a"]') with timeout=10000
[00:02:42]               │ debg TestSubjects.click(checkboxSelectRow-68ec0edb-b9ec-445d-aa8c-9bf9734d5d89)
[00:02:42]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-68ec0edb-b9ec-445d-aa8c-9bf9734d5d89"]') with timeout=10000
[00:02:42]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-68ec0edb-b9ec-445d-aa8c-9bf9734d5d89"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-96aa06b7-6d7b-471c-91a7-6423f80f74f2)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-96aa06b7-6d7b-471c-91a7-6423f80f74f2"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-96aa06b7-6d7b-471c-91a7-6423f80f74f2"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-a90b78d3-bdd8-489d-8b01-7e8b1353df6e)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-a90b78d3-bdd8-489d-8b01-7e8b1353df6e"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-a90b78d3-bdd8-489d-8b01-7e8b1353df6e"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-6efbad2b-017d-4bfc-8bac-cdead773eafb)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-6efbad2b-017d-4bfc-8bac-cdead773eafb"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-6efbad2b-017d-4bfc-8bac-cdead773eafb"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-4dd51628-5fc7-48f3-be18-6399ef278800)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-4dd51628-5fc7-48f3-be18-6399ef278800"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-4dd51628-5fc7-48f3-be18-6399ef278800"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-7c9dcb58-8ce6-44aa-8e7f-48e202ee7597)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-7c9dcb58-8ce6-44aa-8e7f-48e202ee7597"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-7c9dcb58-8ce6-44aa-8e7f-48e202ee7597"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-5e894133-8f0b-4bab-905d-2f5f76e9480e)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-5e894133-8f0b-4bab-905d-2f5f76e9480e"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-5e894133-8f0b-4bab-905d-2f5f76e9480e"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(checkboxSelectRow-b70f62f8-6765-451c-b237-a52b3ae54c09)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="checkboxSelectRow-b70f62f8-6765-451c-b237-a52b3ae54c09"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="checkboxSelectRow-b70f62f8-6765-451c-b237-a52b3ae54c09"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(bulkAction)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="bulkAction"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="bulkAction"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.click(deleteAll)
[00:02:43]               │ debg Find.clickByCssSelector('[data-test-subj="deleteAll"]') with timeout=10000
[00:02:43]               │ debg Find.findByCssSelector('[data-test-subj="deleteAll"]') with timeout=10000
[00:02:43]               │ debg TestSubjects.exists(deleteIdsConfirmation)
[00:02:43]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="deleteIdsConfirmation"]') with timeout=120000
[00:02:44]               │ debg TestSubjects.click(deleteIdsConfirmation > confirmModalConfirmButton)
[00:02:44]               │ debg Find.clickByCssSelector('[data-test-subj="deleteIdsConfirmation"] [data-test-subj="confirmModalConfirmButton"]') with timeout=10000
[00:02:44]               │ debg Find.findByCssSelector('[data-test-subj="deleteIdsConfirmation"] [data-test-subj="confirmModalConfirmButton"]') with timeout=10000
[00:02:44]               │ debg TestSubjects.missingOrFail(deleteIdsConfirmation)
[00:02:44]               │ debg Find.waitForDeletedByCssSelector('[data-test-subj="deleteIdsConfirmation"]') with timeout=2500
[00:02:44]               │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:02:54]               │ERROR browser[SEVERE] http://localhost:61171/api/alerts/alert/4dd51628-5fc7-48f3-be18-6399ef278800 - Failed to load resource: net::ERR_NETWORK_CHANGED
[00:02:54]               │ERROR browser[SEVERE] http://localhost:61171/api/alerts/alert/7c9dcb58-8ce6-44aa-8e7f-48e202ee7597 - Failed to load resource: net::ERR_NETWORK_CHANGED
[00:02:54]               │ERROR browser[SEVERE] http://localhost:61171/api/alerts/alert/5e894133-8f0b-4bab-905d-2f5f76e9480e - Failed to load resource: net::ERR_NETWORK_CHANGED
[00:02:54]               │ERROR browser[SEVERE] http://localhost:61171/api/alerts/alert/b70f62f8-6765-451c-b237-a52b3ae54c09 - Failed to load resource: net::ERR_NETWORK_CHANGED
[00:02:54]               │ debg browser[INFO] http://localhost:61171/36102/bundles/core/core.entry.js 12:234471 "Detected an unhandled Promise rejection.
[00:02:54]               │      TypeError: Invalid attempt to spread non-iterable instance.
[00:02:54]               │      In order to be iterable, non-array objects must have a [Symbol.iterator]() method."
[00:02:54]               │ERROR browser[SEVERE] http://localhost:61171/36102/bundles/plugin/triggersActionsUi/triggersActionsUi.chunk.1.js 2:9091 Uncaught TypeError: Invalid attempt to spread non-iterable instance.
[00:02:54]               │      I…y objects must have a [Symbol.iterator]() method.
[00:03:05]               │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast)
[00:03:05]               │      Wait timed out after 20306ms
[00:03:05]               │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:03:25]               │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast)
[00:03:25]               │      Wait timed out after 20262ms
[00:03:26]               │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:03:46]               │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast)
[00:03:46]               │      Wait timed out after 20274ms
[00:03:47]               │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:04:07]               │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast)
[00:04:07]               │      Wait timed out after 20244ms
[00:04:07]               │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:04:28]               │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast)
[00:04:28]               │      Wait timed out after 20283ms
[00:04:28]               │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:04:48]               │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast)
[00:04:48]               │      Wait timed out after 20300ms
[00:04:49]               │ info Taking screenshot "/dev/shm/workspace/parallel/17/kibana/x-pack/test/functional/screenshots/failure/Actions and Triggers app alerts should delete all selection.png"
[00:04:49]               │ info Current URL is: http://localhost:61171/app/management/insightsAndAlerting/triggersActions/alerts
[00:04:49]               │ info Saving page source to: /dev/shm/workspace/parallel/17/kibana/x-pack/test/functional/failure_debug/html/Actions and Triggers app alerts should delete all selection.html
[00:04:49]               └- ✖ fail: Actions and Triggers app alerts should delete all selection
[00:04:49]               │      Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, .euiToast)
[00:04:49]               │ Wait timed out after 20300ms
[00:04:49]               │     at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:04:49]               │     at process._tickCallback (internal/process/next_tick.js:68:7)
[00:04:49]               │       at onFailure (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:28:9)
[00:04:49]               │       at retryForSuccess (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:68:13)
[00:04:49]               │ 
[00:04:49]               │

jbudz · 2020-12-14T22:12:34Z

skipped
main: eee237b
7.x: 4046444

YulNaumenko · 2020-12-14T23:59:08Z

According to the log, that is weird that we have such a big number of alerts to delete - should be only 2 if all the tests have implemented clean up logic..

gmmorris · 2020-12-15T10:32:51Z

According to the log, that is weird that we have such a big number of alerts to delete - should be only 2 if all the tests have implemented clean up logic..

That suggests we've introduced some new tests that create alerts that haven't been removed by the objectRemover 🤔

kibanamachine · 2020-12-24T02:41:27Z

New failure: Jenkins Build

kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Sep 14, 2020

mikecote added the Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) label Sep 16, 2020

spalger added a commit that referenced this issue Sep 16, 2020

skip flaky suite (#77401)

d352edb

spalger added a commit that referenced this issue Sep 16, 2020

skip flaky suite (#77401)

3d145da

(cherry picked from commit d352edb)

spalger added blocker skipped-test v7.10.0 labels Sep 16, 2020

YulNaumenko self-assigned this Sep 17, 2020

YulNaumenko mentioned this issue Sep 18, 2020

Removed delete confirmation timeout to avoid flaky failing because deletion to be a little slower on CI #77963

Merged

YulNaumenko closed this as completed in #77963 Sep 23, 2020

spalger added a commit that referenced this issue Sep 30, 2020

skip flaky suite (#77401)

886ad85

spalger added a commit that referenced this issue Sep 30, 2020

skip flaky suite (#77401)

71e54d5

(cherry picked from commit 886ad85)

spalger reopened this Sep 30, 2020

YulNaumenko mentioned this issue Oct 5, 2020

[Alerting UI] Fixed flaky alerting e2e tests #79533

Merged

YulNaumenko closed this as completed in #79533 Oct 6, 2020

kibanamachine reopened this Oct 17, 2020

YulNaumenko mentioned this issue Oct 19, 2020

Fixed alerts ui test timeout issue, related to the multiple server calls for delete all alerts, by reducing the number of alerts to the two and increasing retry timeout. #81067

Merged

YulNaumenko closed this as completed in #81067 Oct 20, 2020

kibanamachine reopened this Dec 14, 2020

mikecote unassigned YulNaumenko Dec 14, 2020

jbudz added a commit that referenced this issue Dec 14, 2020

skip 'alerts should delete all selection' #77401

eee237b

jbudz added a commit that referenced this issue Dec 14, 2020

skip 'alerts should delete all selection' #77401

4046444

YulNaumenko self-assigned this Dec 15, 2020

YulNaumenko mentioned this issue Dec 17, 2020

Flaky test fix for Actions and Triggers app alerts should delete all selection #86175

Merged

YulNaumenko closed this as completed in #86175 Jan 5, 2021

kobelb added the needs-team Issues missing a team label label Jan 31, 2022

botelastic bot removed the needs-team Issues missing a team label label Jan 31, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts·ts - Actions and Triggers app alerts should delete all selection #77401

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts·ts - Actions and Triggers app alerts should delete all selection #77401

kibanamachine commented Sep 14, 2020 •

edited

Loading

elasticmachine commented Sep 14, 2020

elasticmachine commented Sep 16, 2020

kibanamachine commented Sep 16, 2020

spalger commented Sep 16, 2020 •

edited

Loading

spalger commented Sep 16, 2020

gmmorris commented Sep 29, 2020 •

edited

Loading

spalger commented Sep 30, 2020

kibanamachine commented Oct 17, 2020

kibanamachine commented Dec 14, 2020

mikecote commented Dec 14, 2020

jbudz commented Dec 14, 2020

YulNaumenko commented Dec 14, 2020 •

edited

Loading

gmmorris commented Dec 15, 2020

kibanamachine commented Dec 24, 2020

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts·ts - Actions and Triggers app alerts should delete all selection #77401

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/triggers_actions_ui/alerts·ts - Actions and Triggers app alerts should delete all selection #77401

Comments

kibanamachine commented Sep 14, 2020 • edited Loading

elasticmachine commented Sep 14, 2020

elasticmachine commented Sep 16, 2020

kibanamachine commented Sep 16, 2020

spalger commented Sep 16, 2020 • edited Loading

spalger commented Sep 16, 2020

gmmorris commented Sep 29, 2020 • edited Loading

spalger commented Sep 30, 2020

kibanamachine commented Oct 17, 2020

kibanamachine commented Dec 14, 2020

mikecote commented Dec 14, 2020

jbudz commented Dec 14, 2020

YulNaumenko commented Dec 14, 2020 • edited Loading

gmmorris commented Dec 15, 2020

kibanamachine commented Dec 24, 2020

kibanamachine commented Sep 14, 2020 •

edited

Loading

spalger commented Sep 16, 2020 •

edited

Loading

gmmorris commented Sep 29, 2020 •

edited

Loading

YulNaumenko commented Dec 14, 2020 •

edited

Loading