Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Json plugin reports are not consistently same #14

Open
manavghaigithub opened this issue Dec 17, 2019 · 4 comments
Open

Json plugin reports are not consistently same #14

manavghaigithub opened this issue Dec 17, 2019 · 4 comments

Comments

@manavghaigithub
Copy link

manavghaigithub commented Dec 17, 2019

Json plugin, for the same test, sometimes shows steps details and sometime shows details only at spec level.

I ran my test twice and both the times the report is different. In one report i see that all the step details are present but the second report does not has any step detail. The behavior is inconsistent.

It is happening for both 0.3.0 and 0.3.2

Attached are the files for your reference.
Json Results.zip


gauge -v
Gauge version: 1.0.4
Commit Hash: 3a9a647

Plugins

dotnet (0.1.2.nightly-2019-02-14)
html-report (4.0.7)
json-report (0.3.2)
screenshot (0.0.1)
xml-report (0.2.1)

@manavghaigithub
Copy link
Author

@sriv @mahendrakariya @renjithgr @nehashri @apoorvam @shubhamsc @BugDiver
Hello - Can somebody please look into this and advise? Thanks in advance !!!
Thanks Manav

@sriv
Copy link
Collaborator

sriv commented Dec 26, 2019

@manavghaigithub - do you have a sample project for us to check?

Also, do you see any difference in other reports (console output/html-report/xml-report) ?

@manavghaigithub
Copy link
Author

manavghaigithub commented Dec 26, 2019

@sriv I am in the network so cannot share project but i did share actual Json reports (from project execution) when i opened ticket. In the reports you can see that one report has detailed information upto Step level and another report has details only until Spec level.

This behavior is intermittent and we are trying to understand what is causing it. We did not make any changes before executing project when these reports were generated.

Also, i do not see any difference in HTML reports. I dont use XML so i dont look at it.

@sriv
Copy link
Collaborator

sriv commented Dec 27, 2019

I am in the network so cannot share project but i did share actual Json reports

Yes, I noticed those too. But in order to find a cause (and confirm a fix), we'll need a way to reproduce the issue.

This behavior is intermittent and we are trying to understand what is causing it.

Oh boy, that's never good. I request that you keep an eye for any pattern that can give us some hint on what could be the source for this problem.

Both Gauge and JSON-report plugin are involved in generating this output. Gauge gives out the raw output, whereas the plugin transforms it to JSON. I am trying to narrow the problem to one of these, hence the request for a sample project to reproduce the issue. I hope this is reasonable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants