Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WebDriver FTR flaky tests #32385

Closed
2 of 3 tasks
dmlemeshko opened this issue Mar 4, 2019 · 4 comments
Closed
2 of 3 tasks

WebDriver FTR flaky tests #32385

dmlemeshko opened this issue Mar 4, 2019 · 4 comments

Comments

@dmlemeshko
Copy link
Member

dmlemeshko commented Mar 4, 2019

In order to make sure #31446 is not introducing more flakiness, we've been monitoring tests #32366 with over 260 builds were run.

Following tests failed and require fix/stability improvement:

  • kibana-ciGroup2 UI Functional Tests.test/functional/apps/dashboard/_embeddable_rendering·js.dashboard app using current data dashboard embeddable rendering adding visualizations

     00:15:27.775            └-: dashboard embeddable rendering
     00:15:27.775              └-> "before all" hook
     00:15:27.781              └-> "before all" hook
     00:15:33.117              └-> adding visualizations
     00:15:33.117                └-> "before each" hook: global before each
     00:18:03.351                └- ✖ fail: "dashboard app using current data dashboard embeddable rendering adding visualizations"
     00:18:03.351                │      retry.try timeout: Error: expected 26 to equal 27
     00:18:03.353                │     at Assertion.assert (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/kibana-ciGroup2-10/node/immutable/kibana/node_modules/expect.js/index.js:96:13)
     00:18:03.353                │     at Assertion.be.Assertion.equal (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/kibana-ciGroup2-10/node/immutable/kibana/node_modules/expect.js/index.js:216:10)
     00:18:03.353                │     at Assertion.(anonymous function) [as be] (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/kibana-ciGroup2-10/node/immutable/kibana/node_modules/expect.js/index.js:69:24)
     00:18:03.353                │     at retry.try (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/kibana-ciGroup2-10/node/immutable/kibana/test/functional/services/dashboard/expectations.js:36:31)
     00:18:03.353                │     at process._tickCallback (internal/process/next_tick.js:68:7)
    
  • kibana-ciGroup3 UI Functional Tests.test/functional/apps/dashboard/_full_screen_mode·js.dashboard app using current data full screen mode "before all" hook

     [00:03:02]                 │   Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj~="dashboardListingTitleLink-few-panels"])
     [00:03:02]                 │   Wait timed out after 10019ms
    

    Failed due to incorrect input: fw instead of few

  • [logstash/pipelineCreate] retry reading rows #32436 x-pack-ciGroup2 X-Pack Functional Tests.x-pack/test/functional/apps/logstash/pipeline_create·js.logstash pipeline create new save button creates the pipeline and redirects to the list

     TypeError: Cannot read property 'description' of undefined
         at Assertion.property (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/x-pack-ciGroup2-6/node/immutable/kibana/node_modules/expect.js/index.js:378:41)
         at Context.it (test/functional/apps/logstash/pipeline_create.js:74:20)
         at process._tickCallback (internal/process/next_tick.js:68:7)
    
@dmlemeshko
Copy link
Member Author

dmlemeshko commented Mar 4, 2019

/cc @spalger @silne30

@spalger
Copy link
Contributor

spalger commented Mar 4, 2019

I assume this is a variation of the third issue we need to fix: https://kibana-ci.elastic.co/job/elastic+kibana+pull-request/3425/JOB=x-pack-ciGroup2-1,node=immutable/testReport/junit/X-Pack%20Functional%20Tests/x-pack_test_functional_apps_logstash_pipeline_create%C2%B7js/logstash_pipeline_create_new_cancel_button_discards_the_pipeline_and_redirects_to_the_list/

        { Error: expected [ ... tons of timeline objects... ] to sort of equal []
    at Assertion.assert (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/x-pack-ciGroup2-1/node/immutable/kibana/node_modules/expect.js/index.js:96:13)
    at Assertion.eql (/var/lib/jenkins/workspace/elastic+kibana+pull-request/JOB/x-pack-ciGroup2-1/node/immutable/kibana/node_modules/expect.js/index.js:230:10)
    at Context.it (test/functional/apps/logstash/pipeline_create.js:89:33)
    at process._tickCallback (internal/process/next_tick.js:68:7)

from https://github.com/elastic/kibana/blob/master/x-pack/test/functional/apps/logstash/pipeline_create.js#L89
image

@dmlemeshko
Copy link
Member Author

Recent failure in master:

X-Pack Functional Tests.x-pack/test/functional/apps/logstash/pipeline_list·js.logstash pipeline list route clone button links to the pipeline editor with cloned pipeline details

Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj~="pipelineList"] [data-test-subj~="lnkPipelineClone-con"])
Wait timed out after 10049ms

jobs elastic kibana master job x-pack-cigroup2 nod

@dmlemeshko
Copy link
Member Author

Closing since we track failed tests in its own tickets

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants