ios-run-test-groups-in-parallel.md

(iOS) Run test groups in parallel

Description

This example uses the sample-swift-project-with-parallel-ui-test iOS Open Source sample app, which has some example Unit and UI tests and uses Test Plans to group the tests.

Note: Xcode Test Plans provide a way to run a collection of tests with different test configurations. raywenderlich.com has a great tutorial on how to get started with Xcode Test Plans.

The example Pipeline config showcases how to run different test groups in parallel.

build_and_run_tests pipeline's Workflows can be split into two logical groups:

1. Build tests: The xcode_build_for_test Workflow git clones the sample project and runs the xcode-build-for-test Step to build the target and associated tests. The built test bundle is shared with the following Workflows via the deploy-to-bitrise-io Step.
2. Run tests: Then two Workflows run in parallel: run_ui_tests and run_unit_tests. Both of these Workflows use the new xcode-test-without-building Step, which executes the tests based on the previous Workflow built test bundle. The pre-built test bundle is pulled by the _pull_test_bundle utility Workflow.

Instructions

1. Visit the Create New App page to create a new App.
2. When prompted to select a git repository, choose Other/Manual and paste the sample project repository URL (https://github.com/bitrise-io/sample-swift-project-with-parallel-ui-test) in the Git repository (clone) URL field.
3. Confirm that this is a public repository in the resulting pop-up.
4. Select the master branch to scan.
5. Wait for the project scanner to complete.
6. Select any of the offered Distribution methods (for example development, it does not really matter as now we are focusing on testing).
7. Confirm the offered stack, skip choosing the app icon and the webhook registration and kick off the first build.
8. Open the new Bitrise project’s Workflow Editor.
9. Go to the bitrise.yml tab and replace the existing bitrise.yml with the contents of the example bitrise.yml below.
10. Click the Start/Schedule a Build button, and select the build_and_run_tests Pipeline option in the Workflow, Pipeline dropdown menu at the bottom of the popup.

bitrise.yml

---
format_version: '17'
default_step_lib_source: https://github.com/bitrise-io/bitrise-steplib.git
project_type: ios

app:
  envs:
  - BITRISE_PROJECT_PATH: BullsEye.xcworkspace
  - BITRISE_SCHEME: BullsEye

meta:
  bitrise.io:
    stack: osx-xcode-16.0.x
    machine_type_id: g2.mac.medium

pipelines:
  build_and_run_tests:
    workflows:
      xcode_build_for_test: {}
      run_ui_tests:
        depends_on: [xcode_build_for_test]
      run_unit_tests:
        depends_on: [xcode_build_for_test]

workflows:
  xcode_build_for_test:
    steps:
    - git-clone@8: {}
    - xcode-build-for-test@3:
        inputs:
        - destination: generic/platform=iOS Simulator
    - deploy-to-bitrise-io@2:
        inputs:
        - pipeline_intermediate_files: "$BITRISE_TEST_BUNDLE_PATH:BITRISE_TEST_BUNDLE_PATH"

  run_ui_tests:
    before_run:
    - _pull_test_bundle
    steps:
    - xcode-test-without-building@0:
        inputs:
        - xctestrun: "$BITRISE_TEST_BUNDLE_PATH/BullsEye_UITests_iphonesimulator15.2-arm64-x86_64.xctestrun"
        - destination: platform=iOS Simulator,name=iPhone 12 Pro Max

  run_unit_tests:
    before_run:
    - _pull_test_bundle
    steps:
    - xcode-test-without-building@0:
        inputs:
        - xctestrun: "$BITRISE_TEST_BUNDLE_PATH/BullsEye_UnitTests_iphonesimulator15.2-arm64-x86_64.xctestrun"
        - destination: platform=iOS Simulator,name=iPhone 12 Pro Max

  _pull_test_bundle:
    steps:
    - pull-intermediate-files@1:
        inputs:
        - artifact_sources: xcode_build_for_test