-
Notifications
You must be signed in to change notification settings - Fork 165
[1LP][RFR] Add sidebar accordion to Compute Infrastructure pages AND automate test: test_infrastructure_provider_left_panel_titles #9266
Conversation
60f94bf
to
0f9118f
Compare
0f9118f
to
97a0c56
Compare
ebbd7b5
to
f402e2f
Compare
f402e2f
to
6e5f23c
Compare
These tests passed locally, but PRT keeps resulting into |
@valaparthvi looks like |
@jawatts So I figured what went wrong, I guess I'll have to open another PR to wt.patternfly 😩 Edit: |
cfme/tests/webui/test_general_ui.py
Outdated
test_view = provider.create_view(ALL_OPTIONS[option][panel], wait="60s") | ||
soft_assert(test_view.is_displayed, f"{test_view} not displayed.") | ||
else: | ||
logger.info(f"'{panel}' was not tested, it did not enable.") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this should be a pytest.skip or pytest.fail - the item was expected to enable why wouldn't that be a failure?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are a few items that get enabled once the provider receives data, but there are items such as Timelines
that take some 15-20 minutes to enable itself, so I decided to just log it, I don't want to fail/skip the test in this case. Is there a way to quickly enable Timelines?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not aware of a way to quickly enable timelines in this case.
I still am not comfortable with this result for the test though. There will be no indication in the results or artifactor report that this occurred - you would have to inspect the cfme.log file on every test execution to check for this message and to know whether or not timelines was actually tested.
A pytest xfail may be your best option here - that its more or less and expected failure state. We need some indication in results that there was missing coverage for this test case.
That or test timelines separately, putting more investigation into how to enable the option quickly.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So John helped me trigger Timelines, activities like creating/deleting/reconfiguring VMs create an event and triggers Timelines. So I did that, I create VM as a part of setup.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great - just 1 comment about the silent test failure with a log message.
I'm also going to merge/release the wt.pf PR that adds parents to the partial match element lookups, which is causing the PRT failures. You should update the requirements files to the newest wt.pf version.
616aa2f
to
4d7faa9
Compare
Moving to RFR. 511 PRT failures are unrelated to these changes. |
cfme/tests/webui/test_general_ui.py
Outdated
) | ||
if not accordion.tree.is_disabled(partial_match(panel)): | ||
accordion.tree.select(partial_match(panel)) | ||
test_view = provider.create_view(ALL_OPTIONS[option][panel], wait="60s") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since you passed wait
parameter, this will raise an exception before your soft assert if the view isn't displayed.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Test failure modes need to be revised.
4d7faa9
to
d702bc8
Compare
d702bc8
to
32cd546
Compare
I detected some fixture changes in commit 32cd546 The local fixture
Please, consider creating a PRT run to make sure your fixture changes do not break existing usage 😃 |
…automate test: test_infrastructure_provider_left_panel_titles (ManageIQ#9266) * Add sidebar accordion to provider detail and cluster details view * Add sidebar for infra hosts * Add sidebar for infra resource pools * Requested changes * Update wt.pf requirements * Fix failing test
Purpose or Intent
test_infrastructure_provider_left_panel_titles
test_run_host_analysis
which uses host details sidebar.Note: Dependent on : RedHatQE/widgetastic.patternfly#114
PRT Run
{{ pytest : cfme/tests/webui/test_general_ui.py::test_infrastructure_provider_left_panel_titles cfme/tests/infrastructure/test_host_analysis.py::test_run_host_analysis -vvv }}