patrol test - assume FLAK tests to PASS

[bartekpacia]

Requested by @fylyppo.

The tests in the project he works on are flaky.

He suggests adding a flag to patrol_cli to make FLAK tests become PASS:

The tentative name for the flag: --ignore-flakes.

[bartekpacia]

@fylyppo can't just use patrol test || true, because then the exit code would be 0 even if all tests failed.

[fylyppo]

Maybe we can stay with FLAK output from test target (it gives me more info in tests summary) but let's change exit code for situation like:

PASS first_test.dart on emulator-5554
PASS second_test.dart on emulator-5554
PASS third_test.dart on emulator-5554
FLAK fourth_test.dart on emulator-5554
FLAK fifth_test.dart on emulator-5554

to be 0.

Reason: I have some listener for exit code and the goal is to know only about critical errors from test (only if test target fail every time).

[bartekpacia]

Good idea - I like it.

[bartekpacia]

The table summary with PASS/FLAK/FAIL is no longer available 2.0.
We might add it back later on - see #1028 for more.

Action item for @bartekpacia: Check how Gradle-generated and Xcode-generated reports look like with repeated tests: https://stackoverflow.com/questions/39193268/run-espresso-test-multiple-times
Action item for @fylyppo : Check if repeating tests N times works on Firebase Test Lab

[bartekpacia]

This UI doesn't exist anymore since Patrol 2.0

[github-actions]

This issue has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar problem, please file a new issue. Make sure to follow the template and provide all the information necessary to reproduce the issue.