Flaky Test [Build&Test / x-pack/metricbeat-cloud / test_dashboards – x-pack.metricbeat.tests.system.test_xpack_base.Test]

[kaiyan-sheng]

Flaky Test

• Test Name: test_dashboards
• Link:

  beats/metricbeat/tests/system/test_base.py

  Line 61 in ef6274d

  def test_dashboards(self):

• Branch: master
• Artifact Link: https://beats-ci.elastic.co//blue/rest/organizations/jenkins/pipelines/Beats/pipelines/beats/pipelines/PR-24263/runs/7/steps/2148/log/?start=0

Stack Trace

[2021-03-25T15:32:07.635Z] E         2021-03-25T15:23:46.825Z	ERROR	instance/beat.go:953	Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/x-pack/metricbeat/build/system-tests/run/test_xpack_base.Test.test_dashboards/kibana/7/dashboard:
[2021-03-25T15:32:07.635Z] E           error loading /go/src/github.com/elastic/beats/x-pack/metricbeat/build/system-tests/run/test_xpack_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-cockroachdb-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
[2021-03-25T15:32:07.635Z] E           error loading /go/src/github.com/elastic/beats/x-pack/metricbeat/build/system-tests/run/test_xpack_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-cockroachdb-sql.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
[2021-03-25T15:32:07.635Z] E         Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/x-pack/metricbeat/build/system-tests/run/test_xpack_base.Test.test_dashboards/kibana/7/dashboard:
[2021-03-25T15:32:07.635Z] E           error loading /go/src/github.com/elastic/beats/x-pack/metricbeat/build/system-tests/run/test_xpack_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-cockroachdb-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
[2021-03-25T15:32:07.635Z] E           error loading /go/src/github.com/elastic/beats/x-pack/metricbeat/build/system-tests/run/test_xpack_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-cockroachdb-sql.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
[2021-03-25T15:32:07.635Z] E         
[2021-03-25T15:32:07.635Z] E       assert 1 == 0
[2021-03-25T15:32:07.635Z] 
[2021-03-25T15:32:07.635Z] ../../metricbeat/tests/system/test_base.py:79: AssertionError
[2021-03-25T15:32:07.635Z] ---------------------------- Captured stderr setup -----------------------------
[2021-03-25T15:32:07.635Z] Creating metricbeat_7918a246f6f8_elasticsearch_1 ... 
[2021-03-25T15:32:07.635Z] 
Creating metricbeat_7918a246f6f8_elasticsearch_1 ... done
Creating metricbeat_7918a246f6f8_kibana_1        ... 
[2021-03-25T15:32:07.635Z] 
Creating metricbeat_7918a246f6f8_kibana_1        ... done

[elasticmachine]

Pinging @elastic/integrations (Team:Integrations)

[ChrsMark]

This one looks like there is an incompatibility issue. Did we try to update

beats/metricbeat/docker-compose.yml

Line 40 in 2a84d7e

image: docker.elastic.co/integrations-ci/beats-kibana:${KIBANA_VERSION:-7.10.0}-1

and check locally if we can reproduce it.
I can hardly recall a similar situation in the past but cannot remember what exactly it was about 😞 , maybe starting with updating the images could be of help here.

[exekias]

Uhm, is this a new dashboard failing to load in an old Kibana or the other way around?

Kibana 7.x should keep backwards compatibility, so if this is an old dashboard failing to load in a new Kibana we should report it

[kaiyan-sheng]

Bumping stack version fixed this, closing this issue.