Skip to content

Commit

Permalink
add weblinks to all test output
Browse files Browse the repository at this point in the history
  • Loading branch information
RainNapper committed Jun 24, 2020
1 parent 1dff550 commit 31fb08c
Show file tree
Hide file tree
Showing 6 changed files with 23 additions and 17 deletions.
6 changes: 3 additions & 3 deletions test_runner/docs/ascii/flank.jar_-android-run.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -224,12 +224,12 @@ You can guide the Robo test to perform specific actions by recording a Robo Scri
+
Learn more at https://firebase.google.com/docs/test-lab/robo-ux-test#scripting.

*--legacy-junit-result*::
Fallback for legacy xml junit results parsing.

*--additional-app-test-apks*=_<String=String>_[,_<String=String>_...]::
A list of app & test apks to include in the run. Useful for running multiple module tests within a single Flank run.

*--legacy-junit-result*::
Fallback for legacy xml junit results parsing.

*--dump-shards*::
Measures test shards from given test apks and writes them into android_shards.json file instead of executing.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -236,12 +236,12 @@ You can guide the Robo test to perform specific actions by recording a Robo Scri
+
Learn more at https://firebase.google.com/docs/test-lab/robo-ux-test#scripting.

*--legacy-junit-result*::
Fallback for legacy xml junit results parsing.

*--additional-app-test-apks*=_<String=String>_[,_<String=String>_...]::
A list of app & test apks to include in the run. Useful for running multiple module tests within a single Flank run.

*--legacy-junit-result*::
Fallback for legacy xml junit results parsing.

*--dump-shards*::
Measures test shards from given test apks and writes them into android_shards.json file instead of executing.

Expand Down
6 changes: 3 additions & 3 deletions test_runner/docs/ascii/flank.jar_-firebase-test-ios-run.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -151,15 +151,15 @@ Configuration is read from flank.yml
*--output-style*=_<outputStyle>_::
Output style of execution status. May be one of [verbose, multi, single]. For runs with only one test execution the default value is 'verbose', in other cases 'multi' is used as the default. The output style 'multi' is not displayed correctly on consoles which don't support ansi codes, to avoid corrupted output use `single` or `verbose`.

*--test*=_<test>_::
The path to the test package (a zip file containing the iOS app and XCTest files). The given path may be in the local filesystem or in Google Cloud Storage using a URL beginning with gs://. Note: any .xctestrun file in this zip file will be ignored if --xctestrun-file is specified.

*--xctestrun-file*=_<xctestrunFile>_::
The path to an .xctestrun file that will override any .xctestrun file contained in the --test package. Because the .xctestrun file contains environment variables along with test methods to run and/or ignore, this can be useful for customizing or sharding test suites. The given path may be in the local filesystem or in Google Cloud Storage using a URL beginning with gs://.

*--xcode-version*=_<xcodeVersion>_::
The version of Xcode that should be used to run an XCTest. Defaults to the latest Xcode version supported in Firebase Test Lab. This Xcode version must be supported by all iOS versions selected in the test matrix.

*--test*=_<test>_::
The path to the test package (a zip file containing the iOS app and XCTest files). The given path may be in the local filesystem or in Google Cloud Storage using a URL beginning with gs://. Note: any .xctestrun file in this zip file will be ignored if --xctestrun-file is specified.

*--test-targets*=_<testTargets>_[,_<testTargets>_...]::
A list of one or more test method names to run (default: run all test targets).

Expand Down
6 changes: 3 additions & 3 deletions test_runner/docs/ascii/flank.jar_-ios-run.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -142,15 +142,15 @@ Configuration is read from flank.yml
*--output-style*=_<outputStyle>_::
Output style of execution status. May be one of [verbose, multi, single]. For runs with only one test execution the default value is 'verbose', in other cases 'multi' is used as the default. The output style 'multi' is not displayed correctly on consoles which don't support ansi codes, to avoid corrupted output use `single` or `verbose`.

*--test*=_<test>_::
The path to the test package (a zip file containing the iOS app and XCTest files). The given path may be in the local filesystem or in Google Cloud Storage using a URL beginning with gs://. Note: any .xctestrun file in this zip file will be ignored if --xctestrun-file is specified.

*--xctestrun-file*=_<xctestrunFile>_::
The path to an .xctestrun file that will override any .xctestrun file contained in the --test package. Because the .xctestrun file contains environment variables along with test methods to run and/or ignore, this can be useful for customizing or sharding test suites. The given path may be in the local filesystem or in Google Cloud Storage using a URL beginning with gs://.

*--xcode-version*=_<xcodeVersion>_::
The version of Xcode that should be used to run an XCTest. Defaults to the latest Xcode version supported in Firebase Test Lab. This Xcode version must be supported by all iOS versions selected in the test matrix.

*--test*=_<test>_::
The path to the test package (a zip file containing the iOS app and XCTest files). The given path may be in the local filesystem or in Google Cloud Storage using a URL beginning with gs://. Note: any .xctestrun file in this zip file will be ignored if --xctestrun-file is specified.

*--test-targets*=_<testTargets>_[,_<testTargets>_...]::
A list of one or more test method names to run (default: run all test targets).

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ private fun createJUnitTestCase(
// skipped = true is represented by null. skipped = false is "absent"
skipped = if (testCase.status == "skipped") null else "absent"
).apply {
if (errors != null || failures != null) {
if (!skipped()) {
webLink = getWebLink(toolResultsStep, testCase.testCaseId)
}
if (testCase.flaky) {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,10 @@ class CreateJUnitTestCaseKtTest {
name = "test1",
classname = "TestClassName",
time = "2.200"
),
).apply {
webLink =
"https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test1"
},
JUnitTestCase(
name = "test2",
classname = "TestClassName",
Expand All @@ -62,23 +65,26 @@ class CreateJUnitTestCaseKtTest {
time = "2.200",
errors = listOf("exception")
).apply {
webLink = "https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test3"
webLink =
"https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test3"
},
JUnitTestCase(
name = "test4",
classname = "TestClassName",
time = "2.200",
failures = listOf("exception")
).apply {
webLink = "https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test4"
webLink =
"https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test4"
},
JUnitTestCase(
name = "test5",
classname = "TestClassName",
time = "2.200",
failures = listOf("exception")
).apply {
webLink = "https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test5"
webLink =
"https://console.firebase.google.com/project/projectId/testlab/histories/historyId/matrices/executionId/executions/stepId/testcases/test5"
flaky = true
}
)
Expand Down

0 comments on commit 31fb08c

Please sign in to comment.