Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Firefox UI Functional Tests - Visualize.test/functional/apps/visualize/group5/_tsvb_time_series·ts - visualize app visual builder Time Series basics Clicking on the chart should create a filter for series with multiple split by terms fields one of which has formatting #162995

Closed
kibanamachine opened this issue Aug 2, 2023 · 7 comments
Closed

Failing test: Firefox UI Functional Tests - Visualize.test/functional/apps/visualize/group5/_tsvb_time_series·ts - visualize app visual builder Time Series basics Clicking on the chart should create a filter for series with multiple split by terms fields one of which has formatting #162995

kibanamachine opened this issue Aug 2, 2023 · 7 comments
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Visualizations Visualization editors, elastic-charts and infrastructure

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Aug 2, 2023 •
edited
Loading

A test failed on a tracked branch

Error: retry.try timeout: StaleElementReferenceError: The element with the reference a0e92ac8-b1a8-42f5-811f-bd614ce2fd5b is stale; either its node document is not the active document, or it is no longer connected to the DOM
    at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:524:15)
    at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:601:13)
    at Executor.execute (node_modules/selenium-webdriver/lib/http.js:529:28)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at Task.exec (prevent_parallel_calls.ts:28:20)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.try (retry.ts:31:12)
    at VisualBuilderPageObject.setAnotherGroupByTermsField (visual_builder_page.ts:854:5)
    at Context.<anonymous> (_tsvb_time_series.ts:229:13)
    at Object.apply (wrap_function.js:73:16)

First failure: CI Build - 8.9
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Aug 2, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Aug 2, 2023
@dej611 dej611 added the Team:Visualizations Visualization editors, elastic-charts and infrastructure label Aug 3, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-visualizations @elastic/kibana-visualizations-external (Team:Visualizations)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Aug 3, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@stratoula
Copy link
Contributor

@dmlemeshko this seems similar with the one you fixed, right?

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@jbudz
Copy link
Member

jbudz commented Aug 8, 2023

/skip

kibanamachine added a commit that referenced this issue Aug 8, 2023
@kibanamachine
skip failing test suite (#162995)
fb16a55
@kibanamachine
Copy link
Contributor Author

Skipped

8.9: fb16a55
main: 727d58f

kibanamachine added a commit that referenced this issue Aug 8, 2023
@kibanamachine
skip failing test suite (#162995)
727d58f
@dmlemeshko
Copy link
Member

Flakiness is the case only in Firefox: screenshot shows that 2nd field was not selected

download (4)

I tried it manually in Firefox 116.0.2 and can confirm I can select aggregations, though sometimes picking an item in dropdown is not working for me, could be a click position or maybe my personal experience. I will unskip it for Chrome only since flaky-test-runner has no failures

@dmlemeshko dmlemeshko mentioned this issue Aug 9, 2023
Merged
bryce-b pushed a commit to bryce-b/kibana that referenced this issue Aug 9, 2023
@kibanamachine @bryce-b
skip failing test suite (elastic#162995)
63920a0
dmlemeshko added a commit that referenced this issue Aug 10, 2023
@dmlemeshko
[FTR] unskip tsvb time series tests for Chrome (#163510)
072ad96 
## Summary

Related to #162995

This PR unskip TSVB tests for Chrome browser since it is proved to be
stable

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2836
100x passed

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2835
100x passed
On Firefox the flakiness is related to Terms 2nd aggregation field
sometimes is not selected. I tested it manually in Firefox 116 and was
able to set fields, though I have a feeling that values are not always
selected on click in the drop-down. But I didn't see any errors in
console.

I also returned back retry for dropdown selection I removed in #161202
though flaky-test-runner proves there is no need. Let's have just to
keep logic as before my PR.
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Aug 10, 2023
@dmlemeshko
[FTR] unskip tsvb time series tests for Chrome (elastic#163510)
1408517 
## Summary

Related to elastic#162995

This PR unskip TSVB tests for Chrome browser since it is proved to be
stable

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2836
100x passed

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2835
100x passed
On Firefox the flakiness is related to Terms 2nd aggregation field
sometimes is not selected. I tested it manually in Firefox 116 and was
able to set fields, though I have a feeling that values are not always
selected on click in the drop-down. But I didn't see any errors in
console.

I also returned back retry for dropdown selection I removed in elastic#161202
though flaky-test-runner proves there is no need. Let's have just to
keep logic as before my PR.

(cherry picked from commit 072ad96)
kibanamachine added a commit that referenced this issue Aug 10, 2023
@kibanamachine @dmlemeshko
[8.9] [FTR] unskip tsvb time series tests for Chrome (#163510) (#163555)
86f579d 
# Backport

This will backport the following commits from `main` to `8.9`:
- [[FTR] unskip tsvb time series tests for Chrome
(#163510)](#163510)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Dzmitry
Lemechko","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-08-10T07:17:12Z","message":"[FTR]
unskip tsvb time series tests for Chrome (#163510)\n\n##
Summary\r\n\r\nRelated to #162995\r\n\r\nThis PR unskip TSVB tests for
Chrome browser since it is proved to
be\r\nstable\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2836\r\n100x
passed\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2835\r\n100x
passed\r\nOn Firefox the flakiness is related to Terms 2nd aggregation
field\r\nsometimes is not selected. I tested it manually in Firefox 116
and was\r\nable to set fields, though I have a feeling that values are
not always\r\nselected on click in the drop-down. But I didn't see any
errors in\r\nconsole.\r\n\r\nI also returned back retry for dropdown
selection I removed in #161202\r\nthough flaky-test-runner proves there
is no need. Let's have just to\r\nkeep logic as before my
PR.","sha":"072ad967fc04e2b79bf75fd9e6618f3bf0e46b9f","branchLabelMapping":{"^v8.10.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v8.10.0","v8.9.1"],"number":163510,"url":"https://github.com/elastic/kibana/pull/163510","mergeCommit":{"message":"[FTR]
unskip tsvb time series tests for Chrome (#163510)\n\n##
Summary\r\n\r\nRelated to #162995\r\n\r\nThis PR unskip TSVB tests for
Chrome browser since it is proved to
be\r\nstable\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2836\r\n100x
passed\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2835\r\n100x
passed\r\nOn Firefox the flakiness is related to Terms 2nd aggregation
field\r\nsometimes is not selected. I tested it manually in Firefox 116
and was\r\nable to set fields, though I have a feeling that values are
not always\r\nselected on click in the drop-down. But I didn't see any
errors in\r\nconsole.\r\n\r\nI also returned back retry for dropdown
selection I removed in #161202\r\nthough flaky-test-runner proves there
is no need. Let's have just to\r\nkeep logic as before my
PR.","sha":"072ad967fc04e2b79bf75fd9e6618f3bf0e46b9f"}},"sourceBranch":"main","suggestedTargetBranches":["8.9"],"targetPullRequestStates":[{"branch":"main","label":"v8.10.0","labelRegex":"^v8.10.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/163510","number":163510,"mergeCommit":{"message":"[FTR]
unskip tsvb time series tests for Chrome (#163510)\n\n##
Summary\r\n\r\nRelated to #162995\r\n\r\nThis PR unskip TSVB tests for
Chrome browser since it is proved to
be\r\nstable\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2836\r\n100x
passed\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2835\r\n100x
passed\r\nOn Firefox the flakiness is related to Terms 2nd aggregation
field\r\nsometimes is not selected. I tested it manually in Firefox 116
and was\r\nable to set fields, though I have a feeling that values are
not always\r\nselected on click in the drop-down. But I didn't see any
errors in\r\nconsole.\r\n\r\nI also returned back retry for dropdown
selection I removed in #161202\r\nthough flaky-test-runner proves there
is no need. Let's have just to\r\nkeep logic as before my
PR.","sha":"072ad967fc04e2b79bf75fd9e6618f3bf0e46b9f"}},{"branch":"8.9","label":"v8.9.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Dzmitry Lemechko <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Visualizations Visualization editors, elastic-charts and infrastructure
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@dej611 @jbudz @dmlemeshko @elasticmachine @stratoula @kibanamachine