Gradle listener is throwing nullpointer exceptions #395
Labels
Milestone
Comments
|
This is because gradle internal listener assumes exception on test failure. The efficient implementation should taken care of null values :). In case of verification falilure(s) there will not any exception and still the test status will be failed. To deal with it you can check if there is a way to disable gradle reporting. As alternate work around you can add testng listener to add exception in failed test's test result object. For example: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Overview
I currently use QAF 3.0.0 with Gradle 7.0.2. [ but i have tested this issue on 3.1.0b, 3.0.0 & gradle 4.x ,5.x, 6.4.2, 7.0.2, 7.2] I have started to notice that when I fail out a test with
Reporter.log("fail", MessageTypes.Fail);. I get a Null Pointer Exception from gradle and it fails the gradle build. However if I fail the test through TestNG (Assert.assertTrue(false);). I do not get the null pointer exception and the build is successful.The null pointer does not happen when all tests pass.
QAF Version
Steps To Reproduce
[see test case example section]
>gradlew clean testExpected behavior
Gradle Build is successful and indicates failures
Gradle Console
Actual behavior
Two null pointers are generated and the gradle build failed.
Gradle Console
Is the issue reproducible on runner?
More Details
This is not happening in Maven because, i believe, maven did not create a test report after a run unless a plugin is used. The Qmetry report is still generated successfully but gradle reports a build failure.
It seems like it needs to be a valid failure using the Reporter or QAF framework failure. If the test throws exceptions that doesn’t count as a failure by the framework but is counted by TestNG (from my understanding). Any failures handled by TestNG have no issues reporting back to gradle properly.
It is as if there is a test listener that nulls out the test objects when it is done with it. So when the gradle listener tries to listen at the end for the test results so that it can report on the results with it's own reports the values it is looking for are null.
Test case sample
build.gradle
dependencies { implementation 'com.qmetry:qaf:3.0.0' }Test Class
Gradle Debug Output
gradlew clean test --stacktraceStacktrace Dump
gradlew clean test --debugGradle Debug Dump
The text was updated successfully, but these errors were encountered: