You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When I supply 2 Cucumber json report files to CluecumberEngine with CluecumberCore.Builder.setGroupPreviousScenarioRuns(true)
it doesn't merge the same test scenarios (rerun) which have test steps with different outputs. In my case, each test step has a log attached so, obviously, it will be different when I rerun, for example, a failed test scenario.
To Reproduce
Steps to reproduce the behavior:
Have 2 Cucumber json reports for the same features but run different time and where test steps have different output
Set the flag CluecumberCore.Builder.setGroupPreviousScenarioRuns(true)
Call CluecumberEngine.generateReports
Open html report and see it treats same test scenarios as different
Expected behavior
Rerun test scenarios with same name of the same features and same test data should be displayed as test scenarios which were rerun (in Rerun Scenarios page)
Attachments
Nothing is displayed in page Rerun Scenarios of the Cluecumber html report
Additional context
Based on the code, I see that ElementMultipleRunsPreProcessor.generateCombinedId method uses this:
if (step.getOutput() != null) {
outputs.add(step.getOutput());
}
which, to my mind, should not be in the resulted ID generation, as you may have the same test scenarios but different log outputs after rerun.
Can we change this logic please?
Possible options:
Remove this piece of code
Wrap it around a configuration, supplied from the CluecumberEngine and its Builder
What do you think?
The text was updated successfully, but these errors were encountered:
Describe the bug
When I supply 2 Cucumber json report files to
CluecumberEngine
withCluecumberCore.Builder.setGroupPreviousScenarioRuns(true)
it doesn't merge the same test scenarios (rerun) which have test steps with different outputs. In my case, each test step has a log attached so, obviously, it will be different when I rerun, for example, a failed test scenario.
To Reproduce
Steps to reproduce the behavior:
CluecumberEngine.generateReports
Expected behavior
Rerun test scenarios with same name of the same features and same test data should be displayed as test scenarios which were rerun (in
Rerun Scenarios
page)Attachments
Nothing is displayed in page
Rerun Scenarios
of the Cluecumber html reportAdditional context
Based on the code, I see that
ElementMultipleRunsPreProcessor.generateCombinedId
method uses this:which, to my mind, should not be in the resulted ID generation, as you may have the same test scenarios but different log outputs after rerun.
Can we change this logic please?
Possible options:
CluecumberEngine
and its BuilderWhat do you think?
The text was updated successfully, but these errors were encountered: