[AUTOCUT] Integration Test failed for alertingDashboards: 2.15.0

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: deb
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5935/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/x64/deb/test-results/5935/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: deb
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5936/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/arm64/deb/test-results/5936/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: rpm
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5937/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/x64/rpm/test-results/5937/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: rpm
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5938/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/arm64/rpm/test-results/5938/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5934/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/x64/tar/test-results/5934/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5940/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/arm64/tar/test-results/5940/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5941/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7729/linux/x64/tar/test-results/5941/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[AWSHurneyt]

The failure mentioned in #975 (comment) calls out that the tests failed with security.

2024-06-12 20:01:10 ERROR    | alertingDashboards   | with-security        | FAIL  |

2024-06-12 20:01:10 INFO     | alertingDashboards   | without-security     | PASS  |

Ran the tests locally using a security-enabled docker image, and they passed; suggesting it's flaky.

Also, the tests all passed in the most recent commit to the plugin 2.15 branch.
https://github.com/opensearch-project/alerting-dashboards-plugin/pull/974/checks

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5942/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/linux/x64/tar/test-results/5942/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: zip
Architecture: x64
Platform: windows

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5948/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[AWSHurneyt]

#975 (comment) shows the following alertingDashboards test as failing.

- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/linux/x64/tar/test-results/5942/integ-test/alertingDashboards/with-security/cypress-screenshots/plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.js/AcknowledgeAlertsModal+--+Acknowledge+button+disabled+when+more+than+1+trigger+selected+--+before+each+hook+%28failed%29.png

This is different from the test that failed in the previous execution cycle (see #975 (comment)); suggesting those tests are flaky when executed in the jenkins environment.

The test report in #975 (comment) shows the status as Not Available; not PASS or FAIL. @peterzhuamazon do you happen to know why that might be?

- name: alertingDashboards
    command: ./test.sh integ-test manifests/2.15.0/opensearch-dashboards-2.15.0-test.yml
      --paths opensearch=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/2.15.0/9970/windows/x64/zip
      opensearch-dashboards=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/2.15.0/7731/windows/x64/zip
      --component alertingDashboards
    configs:
      - name: with-security
        status: Not Available
        yml: URL not available
        cluster_stdout:
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/with-security/local-cluster-logs/id-0/stdout.txt
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/with-security/local-cluster-logs/id-1/stdout.txt
        cluster_stderr:
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/with-security/local-cluster-logs/id-0/stderr.txt
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/with-security/local-cluster-logs/id-1/stderr.txt
      - name: without-security
        status: Not Available
        yml: URL not available
        cluster_stdout:
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/without-security/local-cluster-logs/id-2/stdout.txt
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/without-security/local-cluster-logs/id-3/stdout.txt
        cluster_stderr:
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/without-security/local-cluster-logs/id-2/stderr.txt
          - https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7731/windows/x64/zip/test-results/5948/integ-test/alertingDashboards/without-security/local-cluster-logs/id-3/stderr.txt

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5951/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7735/linux/arm64/tar/test-results/5951/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: rpm
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5955/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7735/linux/arm64/rpm/test-results/5955/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[AWSHurneyt]

These are the tests failing in #975 (comment). They only failed with security-enabled.

Finished: Uploading to ****/integ-test-opensearch-dashboards/2.15.0/7735/linux/arm64/tar/test-results/5951/integ-test/alertingDashboards/with-security/cypress-screenshots/plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.js/AcknowledgeAlertsModal -- Acknowledge button disabled when more than 1 trigger selected -- before each hook (failed).png
Finished: Uploading to ****/integ-test-opensearch-dashboards/2.15.0/7735/linux/arm64/tar/test-results/5951/integ-test/alertingDashboards/with-security/cypress-screenshots/plugins/alerting-dashboards-plugin/composite_level_monitor_spec.js/CompositeLevelMonitor -- can be edited -- by visual editor (failed).png

The AcknowledgeAlertsModal test failed in #975 (comment), but the CompositeLevelMonitor test passed.

And the CompositeLevelMonitor test failed in #975 (comment), but the AcknowledgeAlertsModal test passed.

This suggests these tests are flaky in when security is enabled.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: zip
Architecture: x64
Platform: windows

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5969/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7742/windows/x64/zip/test-results/5969/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5963/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7742/linux/arm64/tar/test-results/5963/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: deb
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5966/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7742/linux/x64/deb/test-results/5966/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5971/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7749/linux/arm64/tar/test-results/5971/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

[opensearch-ci-bot]

The integration test failed at distribution level for component alertingDashboards
Version: 2.15.0
Distribution: rpm
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/5975/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7749/linux/arm64/rpm/test-results/5975/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.