[BUG]: SurveyProgressControllerTest is approximately 1% flaky #5338
Labels
bug
End user-perceivable behaviors which are not desirable.
Impact: Low
Low perceived user impact (e.g. edge cases).
Work: Medium
The means to find the solution is clear, but it isn't at good-first-issue level yet.
Milestone
Describe the bug
I found in #5335 that
SurveyProgressControllerTest
has a rare chance of flaking. I encountered 11 failures out of 1000 runs, with the following results:6/11 failures:
2/11 failures:
1/11 failures:
1/11 failures:
1/11 failures:
Steps To Reproduce
Check out the latest develop (018e9c9) and run the following:
bazel test --runs_per_test=1000 //domain/src/test/java/org/oppia/android/domain/survey:SurveyProgressControllerTest
Expected Behavior
No tests should flake.
Screenshots/Videos
N/A
What device/emulator are you using?
N/A
Which Android version is your device/emulator running?
N/A
Which version of the Oppia Android app are you using?
N/A
Additional Context
From the stack traces, this appears to be a timing issue. Upon inspecting the controller and its tests, I don't see an obvious reason as to why there are some syncing problems; more investigation is needed to determine a possible root cause (since finding a deterministic repro is probably going to be even harder to do).
The text was updated successfully, but these errors were encountered: