Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Chrome UI Functional Tests.test/functional/apps/visualize/group3/_annotation_listing·ts - visualize app annotation listing page search by text matches on the first word #168281

Closed
kibanamachine opened this issue Oct 6, 2023 · 16 comments · Fixed by #168139, #178443 or #190053
Closed

Failing test: Chrome UI Functional Tests.test/functional/apps/visualize/group3/_annotation_listing·ts - visualize app annotation listing page search by text matches on the first word #168281

kibanamachine opened this issue Oct 6, 2023 · 16 comments · Fixed by #168139, #178443 or #190053
Assignees
@mbondyra
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Visualizations Visualization editors, elastic-charts and infrastructure

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Oct 6, 2023 •
edited
Loading

A test failed on a tracked branch

Error: retry.try timeout: Error: expected 20 to equal 1
    at Assertion.assert (expect.js:100:11)
    at Assertion.equal (expect.js:227:8)
    at listing_table.ts:198:34
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:68:21)
    at RetryService.try (retry.ts:31:12)
    at ListingTableService.expectItemsCount (listing_table.ts:193:5)
    at Context.<anonymous> (_annotation_listing.ts:52:11)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.try (retry.ts:31:12)
    at ListingTableService.expectItemsCount (listing_table.ts:193:5)
    at Context.<anonymous> (_annotation_listing.ts:52:11)
    at Object.apply (wrap_function.js:73:16)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Oct 6, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Oct 6, 2023
@kibanamachine kibanamachine added the Team:Visualizations Visualization editors, elastic-charts and infrastructure label Oct 6, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Oct 6, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-visualizations (Team:Visualizations)

@drewdaemon
Copy link
Contributor

Looking at the screenshot it expected one matching group but no query got entered so no filter was applied...

@drewdaemon drewdaemon mentioned this issue Oct 6, 2023
Merged
drewdaemon added a commit that referenced this issue Oct 10, 2023
@drewdaemon @kibanamachine
[Event annotations] expand and stabilize listing page tests (#168139)
3131bc2 
## Summary

Fix #167434 (reenables embeddable test)
Fix #168281

Flaky test runner (100 times):
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3417

---------

Co-authored-by: Kibana Machine <[email protected]>
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Oct 10, 2023
@drewdaemon
[Event annotations] expand and stabilize listing page tests (elastic#…
813edfe 
…168139)

## Summary

Fix elastic#167434 (reenables embeddable test)
Fix elastic#168281

Flaky test runner (100 times):
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3417

---------

Co-authored-by: Kibana Machine <[email protected]>
(cherry picked from commit 3131bc2)
kibanamachine referenced this issue Oct 10, 2023
@kibanamachine @drewdaemon
[8.11] [Event annotations] expand and stabilize listing page tests (#…
14e9682 
…168139) (#168477)

# Backport

This will backport the following commits from `main` to `8.11`:
- [[Event annotations] expand and stabilize listing page tests
(#168139)](#168139)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Drew
Tate","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-10-10T13:57:52Z","message":"[Event
annotations] expand and stabilize listing page tests (#168139)\n\n##
Summary\r\n\r\nFix #167434 (reenables embeddable test)\r\nFix
https://github.com/elastic/kibana/issues/168281\r\n\r\nFlaky test runner
(100
times):\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3417\r\n\r\n---------\r\n\r\nCo-authored-by:
Kibana Machine
<[email protected]>","sha":"3131bc228124e8641dca52508cffd91c14290564","branchLabelMapping":{"^v8.12.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Team:Visualizations","release_note:skip","backport:prev-minor","v8.12.0"],"number":168139,"url":"https://github.com/elastic/kibana/pull/168139","mergeCommit":{"message":"[Event
annotations] expand and stabilize listing page tests (#168139)\n\n##
Summary\r\n\r\nFix #167434 (reenables embeddable test)\r\nFix
https://github.com/elastic/kibana/issues/168281\r\n\r\nFlaky test runner
(100
times):\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3417\r\n\r\n---------\r\n\r\nCo-authored-by:
Kibana Machine
<[email protected]>","sha":"3131bc228124e8641dca52508cffd91c14290564"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.12.0","labelRegex":"^v8.12.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/168139","number":168139,"mergeCommit":{"message":"[Event
annotations] expand and stabilize listing page tests (#168139)\n\n##
Summary\r\n\r\nFix #167434 (reenables embeddable test)\r\nFix
https://github.com/elastic/kibana/issues/168281\r\n\r\nFlaky test runner
(100
times):\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3417\r\n\r\n---------\r\n\r\nCo-authored-by:
Kibana Machine
<[email protected]>","sha":"3131bc228124e8641dca52508cffd91c14290564"}}]}]
BACKPORT-->

Co-authored-by: Drew Tate <[email protected]>
@kibanamachine kibanamachine reopened this Oct 16, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.11

@stratoula
Copy link
Contributor

It failed again in 8.11 🤔 but maybe the snapshot doesn't have Drew's fixes yet. I am closing it for now

dej611 pushed a commit to dej611/kibana that referenced this issue Oct 17, 2023
@drewdaemon @kibanamachine @dej611
[Event annotations] expand and stabilize listing page tests (elastic#…
adb2f79 
…168139)

## Summary

Fix elastic#167434 (reenables embeddable test)
Fix elastic#168281

Flaky test runner (100 times):
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3417

---------

Co-authored-by: Kibana Machine <[email protected]>
@kibanamachine kibanamachine reopened this Oct 31, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.11

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine kibanamachine reopened this Feb 1, 2024
@kibanamachine kibanamachine reopened this Feb 12, 2024
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@stratoula
Copy link
Contributor

@drewdaemon maybe this needs investigation. It fails every 2 weeks or so

@drewdaemon drewdaemon self-assigned this Feb 12, 2024
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.13

@drewdaemon
Copy link
Contributor

All these fail with the following message

expected 20 to equal 1

And this screenshot

image

This suggests that very occasionally, the test fails to enter the query and press "submit" (this line).

@drewdaemon drewdaemon mentioned this issue Mar 11, 2024
Merged
drewdaemon added a commit that referenced this issue Mar 12, 2024
@drewdaemon
[FTR] add an extra retry (#178443)
01301d9 
Close #168281
@kibanamachine kibanamachine reopened this Apr 15, 2024
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@drewdaemon drewdaemon removed their assignment Apr 15, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

mistic added a commit that referenced this issue May 29, 2024
@mistic
skip flaky suite (#168281)
2bc3192
@mistic
Copy link
Member

mistic commented May 29, 2024

Skipped.

main: 2bc3192

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.14

kibanamachine added a commit that referenced this issue May 30, 2024
@kibanamachine
skip failing test suite (#168281)
bf6549b
@kibanamachine
Copy link
Contributor Author

Skipped

main: bf6549b
8.14: f1a6cf3

kibanamachine added a commit that referenced this issue May 30, 2024
@kibanamachine
skip failing test suite (#168281)
f1a6cf3
@szaffarano szaffarano mentioned this issue Jul 12, 2024
Closed
@mbondyra mbondyra assigned mbondyra and unassigned ppisljar Aug 7, 2024
@mbondyra mbondyra mentioned this issue Aug 7, 2024
Merged
mbondyra added a commit that referenced this issue Aug 8, 2024
@mbondyra
[Annotations listing page] unskip flaky test (#190053)
ef8caa8 
Fixes #168281
Fixes #190030

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6706
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6718
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Aug 8, 2024
@mbondyra
[Annotations listing page] unskip flaky test (elastic#190053)
eac66a1 
Fixes elastic#168281
Fixes elastic#190030

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6706
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6718
(cherry picked from commit ef8caa8)
kibanamachine referenced this issue Aug 8, 2024
@kibanamachine @mbondyra
[8.15] [Annotations listing page] unskip flaky test (#190053) (#190134)
fb544f1 
# Backport

This will backport the following commits from `main` to `8.15`:
- [[Annotations listing page] unskip flaky test
(#190053)](#190053)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Marta
Bondyra","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-08-08T13:23:39Z","message":"[Annotations
listing page] unskip flaky test (#190053)\n\nFixes
https://github.com/elastic/kibana/issues/168281\r\nFixes
https://github.com/elastic/kibana/issues/190030\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6706\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6718","sha":"ef8caa8abf983dfd45760ab7aa292e41e2eb1999","branchLabelMapping":{"^v8.16.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Team:Visualizations","release_note:skip","Feature:Lens","backport:prev-minor","v8.16.0"],"title":"[Annotations
listing page] unskip flaky
test","number":190053,"url":"https://github.com/elastic/kibana/pull/190053","mergeCommit":{"message":"[Annotations
listing page] unskip flaky test (#190053)\n\nFixes
https://github.com/elastic/kibana/issues/168281\r\nFixes
https://github.com/elastic/kibana/issues/190030\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6706\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6718","sha":"ef8caa8abf983dfd45760ab7aa292e41e2eb1999"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.16.0","branchLabelMappingKey":"^v8.16.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/190053","number":190053,"mergeCommit":{"message":"[Annotations
listing page] unskip flaky test (#190053)\n\nFixes
https://github.com/elastic/kibana/issues/168281\r\nFixes
https://github.com/elastic/kibana/issues/190030\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6706\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/6718","sha":"ef8caa8abf983dfd45760ab7aa292e41e2eb1999"}}]}]
BACKPORT-->

Co-authored-by: Marta Bondyra <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mbondyra mbondyra

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Visualizations Visualization editors, elastic-charts and infrastructure
Projects
None yet
Milestone
No milestone
7 participants
@drewdaemon @mbondyra @mistic @ppisljar @elasticmachine @stratoula @kibanamachine