From 0a6edc1bec7f7942b0e4de5912900dc68afb0def Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Janek=20G=C3=B3ral?= Date: Thu, 5 Aug 2021 16:22:02 +0200 Subject: [PATCH] Update documentation --- .../flank/corellium/cli/TestAndroidCommand.kt | 1 + docs/flank_corellium.md | 17 +++++++++++++++-- 2 files changed, 16 insertions(+), 2 deletions(-) diff --git a/corellium/cli/src/main/kotlin/flank/corellium/cli/TestAndroidCommand.kt b/corellium/cli/src/main/kotlin/flank/corellium/cli/TestAndroidCommand.kt index 7b59b67b3d..add785bdd1 100644 --- a/corellium/cli/src/main/kotlin/flank/corellium/cli/TestAndroidCommand.kt +++ b/corellium/cli/src/main/kotlin/flank/corellium/cli/TestAndroidCommand.kt @@ -161,6 +161,7 @@ class TestAndroidCommand : "A map of name suffixes related to set of result types required to include in custom junit report. " + "As results, this option will generate additional amount of junit reports named `JUnitReport-\$suffix.xml`." + "Available result types to include are: [Skipped, Passed, Failed, Flaky]." + + "For example the default configuration will generate JUnitReport-failures.xml." + "Default value is `--junit-report-config=failures=Failed,Flaky;`" ] ) diff --git a/docs/flank_corellium.md b/docs/flank_corellium.md index 198526ab62..b61f39d3bb 100644 --- a/docs/flank_corellium.md +++ b/docs/flank_corellium.md @@ -135,6 +135,17 @@ apks: ## This option is hiding sensitive details about tests. ## default: false # obfuscate: true + +### Configure JUnit reports +## A map of name suffixes related to set of result types required to include in custom junit report. +## Available result types to include are: [Skipped, Passed, Failed, Flaky] (values are not case-sensitive). +## As results, this option will generate additional amount of junit reports named `JUnitReport-$suffix.xml`. +## For example the default configuration will generate JUnitReport-failures.xml. +## default: failures: [Failed, Flaky] +# junit-report-config: +# skipped: [Skipped] +# passed: [PASSED] +# failures: [failed, flaky] ``` ### Command-line arguments @@ -168,7 +179,9 @@ The process during its runtime is printing detailed information about execution The successful run should generate the following files: -* JUnitReport.xml +* JUnitReport.xml - raw report with reruns. + * JUnitReport_failures.xml - only failed and flaky tests. + * or any report files generated according to `junit-report-config` option. * android_shards.json * adb_log * Directory that contains dumped log from `am instrument` commands. @@ -207,6 +220,7 @@ To see the source of the problem check the log file referenced in the error mess * Creating or reusing instances (devices). * Installing APKs on remote devices. * Running android tests. +* Flaky test detection. * Dumping shards to file. * Parsing `adb am instrument` logs. * Generating JUnit report. @@ -214,6 +228,5 @@ To see the source of the problem check the log file referenced in the error mess # Roadmap * Cleaning devices after test execution. -* Flaky test detection. * iOS support. * and much more...