Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Upgrade] Fixes cloud upgrade test failures for 8.x #138684

Merged
merged 13 commits into from
Aug 18, 2022

Conversation

liza-mae
Copy link
Contributor

@liza-mae liza-mae commented Aug 11, 2022

This PR fixes test failures on 8.4 and 8.5 branches.

  1. Discover smoke tests broke after a change in the UI data view text drop down went from id to name. I have added a way to do a search of the data views by a pattern instead, so it works for both.
  2. Canvas smoke tests broke because we now need to use length on the elements found. Also I added testing the elements shown are at least a certain number.
  3. Maps smoke tests broke with tool tips blocking access to elements per issue: [maps] do not open layer tooltip when layer action is clicked #132554, so applied a workaround to click on the tool tip if it is present.
  4. Rules smoke tests broke since search filter does not work per issue: Rules and Connectors search does not filter exact name #138147, so applied a workaround by removing spaces in the name. Also fixed an issue with the loading spinner element not being found.

We had around 90+ test failures here:
https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-upgrade-snapshot-tests+main/103/
https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-upgrade-snapshot-tests+8.4/8/testReport/

This PR has dropped the failures down to about 20: (Looks like some security solutions tests are also now failing) -- Only 4 are Kibana core failures, two are discover flaky test problem and still some issues with the rules search filter for the other two failures.

https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-upgrade-snapshot-tests+main/114/testReport/

@liza-mae liza-mae added release_note:skip Skip the PR/issue when compiling release notes auto-backport Deprecated - use backport:version if exact versions are needed v8.4.0 v8.5.0 labels Aug 11, 2022
@liza-mae liza-mae self-assigned this Aug 11, 2022
@liza-mae liza-mae requested review from nreese, a team, kobelb and kertal August 11, 2022 22:59
@kertal kertal requested a review from a team August 12, 2022 04:54
Copy link
Contributor

@jughosta jughosta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Data Discovery changes LGTM 👍

Copy link
Contributor

@jloleysens jloleysens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving to unblock this progress 👏🏻

// Please keep in mind when udpating, removing or adding to this method
// upgrade needs to be tested too
async clearLegendTooltip() {
const isTooltipOpen = await this.testSubjects.exists(`layerTocTooltip`, { timeout: 5000 });
Copy link
Contributor

@nreese nreese Aug 15, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One more thing, can this exists timeout be shorter? how about 1000 or 1500?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What I noticed when testing against cloud is things in the UI are slower, take longer to show up, so if it is too short we may miss it and it will cause it to be flaky

Copy link
Contributor

@nreese nreese left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

kibana-gis changes LGMT. Thanks for moving changes into gis_page.

@liza-mae
Copy link
Contributor Author

@elasticmachine merge upstream

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @liza-mae

@liza-mae liza-mae merged commit 9969513 into elastic:main Aug 18, 2022
@liza-mae liza-mae deleted the liza/upg-fixes branch August 18, 2022 12:58
kibanamachine pushed a commit that referenced this pull request Aug 18, 2022
* Update discover and canvas tests

* Add length

* Update rule name to have no spaces

* Fix calling function

* Try to close tooltip

* Fix rules spinner

* Move toggleLayerVisibility to gis_page

* Add wait for layers to load

* Remove unused declaration

Co-authored-by: Kibana Machine <[email protected]>
(cherry picked from commit 9969513)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.4

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation and see the Github Action logs for details

kibanamachine added a commit to kibanamachine/kibana that referenced this pull request Aug 18, 2022
…lastic#139101)

* Update discover and canvas tests

* Add length

* Update rule name to have no spaces

* Fix calling function

* Try to close tooltip

* Fix rules spinner

* Move toggleLayerVisibility to gis_page

* Add wait for layers to load

* Remove unused declaration

Co-authored-by: Kibana Machine <[email protected]>
(cherry picked from commit 9969513)

Co-authored-by: liza-mae <[email protected]>
Mpdreamz pushed a commit to Mpdreamz/kibana that referenced this pull request Sep 6, 2022
* Update discover and canvas tests

* Add length

* Update rule name to have no spaces

* Fix calling function

* Try to close tooltip

* Fix rules spinner

* Move toggleLayerVisibility to gis_page

* Add wait for layers to load

* Remove unused declaration

Co-authored-by: Kibana Machine <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Deprecated - use backport:version if exact versions are needed release_note:skip Skip the PR/issue when compiling release notes v8.4.0 v8.5.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants