-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Json plugin reports are not consistently same #14
Comments
@sriv @mahendrakariya @renjithgr @nehashri @apoorvam @shubhamsc @BugDiver |
@manavghaigithub - do you have a sample project for us to check? Also, do you see any difference in other reports (console output/html-report/xml-report) ? |
@sriv I am in the network so cannot share project but i did share actual Json reports (from project execution) when i opened ticket. In the reports you can see that one report has detailed information upto Step level and another report has details only until Spec level. This behavior is intermittent and we are trying to understand what is causing it. We did not make any changes before executing project when these reports were generated. Also, i do not see any difference in HTML reports. I dont use XML so i dont look at it. |
Yes, I noticed those too. But in order to find a cause (and confirm a fix), we'll need a way to reproduce the issue.
Oh boy, that's never good. I request that you keep an eye for any pattern that can give us some hint on what could be the source for this problem. Both Gauge and JSON-report plugin are involved in generating this output. Gauge gives out the raw output, whereas the plugin transforms it to JSON. I am trying to narrow the problem to one of these, hence the request for a sample project to reproduce the issue. I hope this is reasonable. |
Json plugin, for the same test, sometimes shows steps details and sometime shows details only at spec level.
I ran my test twice and both the times the report is different. In one report i see that all the step details are present but the second report does not has any step detail. The behavior is inconsistent.
It is happening for both 0.3.0 and 0.3.2
Attached are the files for your reference.
Json Results.zip
gauge -v
Gauge version: 1.0.4
Commit Hash: 3a9a647
Plugins
dotnet (0.1.2.nightly-2019-02-14)
html-report (4.0.7)
json-report (0.3.2)
screenshot (0.0.1)
xml-report (0.2.1)
The text was updated successfully, but these errors were encountered: