Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to see failed retries in html-report (using gauge native retries) #259

Closed
gadgadskiy opened this issue Mar 17, 2020 · 6 comments · Fixed by #258 or getgauge/gauge#1625
Closed
Assignees

Comments

@gadgadskiy
Copy link

Please add ability to attach failed steps or logs in html-report if test was passed after 2nd/3rd try using native gauge retrying mechanism. Currently we can see fails only in build log, but in report there's showing only last (successful) result. And it isn’t obvious that test is flaky.

Steps to reproduce

  1. Run test with retrying (gauge run --max-retries-count=2 or gauge:execute -Dflags=--max-retries-count=2 on TeamCity)
  2. One of steps in test should fail first time and pass second time.

Expected behavior

There's some mark or logs in html report that step was failed one time.

Actual behavior

Nothing in report shows that there was failed tries.

Gauge version

1.0.6+

@BugDiver BugDiver self-assigned this Apr 22, 2020
BugDiver referenced this issue in getgauge/gauge Apr 22, 2020
@BugDiver BugDiver transferred this issue from getgauge/gauge Apr 22, 2020
BugDiver pushed a commit that referenced this issue Apr 22, 2020
@BugDiver BugDiver reopened this Apr 23, 2020
@BugDiver
Copy link
Member

The PRs have been raised to address the issue. The feature will be available in next release

Here are some screenshots showing how this would look like

  • When a scenario passes after few retries

Screenshot 2020-04-23 at 1 11 27 PM

  • When a scenario fails even after max retries

Screenshot 2020-04-23 at 1 13 32 PM

@olejkavn
Copy link

Will we have some options to add some data about failed attempts to html-report?
like some logs/screenshots etc?

@zabil
Copy link
Member

zabil commented Apr 23, 2020

Can you please raise another issue for that?

For now it will be a simple marker. Adding more info about previously failed tests will require more thinking and effort.

@olejkavn
Copy link

@zabil sure #260

@zabil zabil closed this as completed in #258 May 6, 2020
zabil pushed a commit that referenced this issue May 6, 2020
@dibyaranjan-pg
Copy link

dibyaranjan-pg commented May 17, 2020

Can someone please confirm if this feature added to the json-report as well? A property to identify "Retried times" in JSON report

@zabil
Copy link
Member

zabil commented May 18, 2020

This feature is not available in JSON report. Please create and issue (or PR) at https://github.com/getgauge-contrib/json-report/issues

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
5 participants