Skip to content

Commit

Permalink
Fix the tests.yaml to run the execution script for running python tes…
Browse files Browse the repository at this point in the history
…t scripts (project-chip#34853)

* Fix the script execution link to run test scripts

* Fixed the CI arguments design pattern for TC_EWATERHTR scripts

* Excluded the scripts still under fixes

* Removed TC_SEAR tests which were still undecided on the CI arguments

* Removed TC_OCC_3_1 and TC_OCC_3_2 since there are CI issues to be followed up for the test cases below that implements manually controlling sensor device for the occupancy state ON/OFF change
  • Loading branch information
vatsalghelani-csa authored and austina-csa committed Aug 12, 2024
1 parent 7dd127e commit bf7b30c
Show file tree
Hide file tree
Showing 5 changed files with 17 additions and 3 deletions.
1 change: 1 addition & 0 deletions .github/workflows/tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -506,6 +506,7 @@ jobs:
run: |
mkdir -p out/trace_data
scripts/run_in_python_env.sh out/venv './scripts/tests/run_python_test.py --load-from-env /tmp/test_env.yaml --script src/controller/python/test/test_scripts/mobile-device-test.py'
scripts/run_in_python_env.sh out/venv 'python3 ./src/python_testing/execute_python_tests.py --env-file /tmp/test_env.yaml --search-directory src/python_testing'
scripts/run_in_python_env.sh out/venv './scripts/tests/run_python_test.py --script "src/python_testing/TestMatterTestingSupport.py" --script-args "--trace-to json:out/trace_data/test-{SCRIPT_BASE_NAME}.json --trace-to perfetto:out/trace_data/test-{SCRIPT_BASE_NAME}.perfetto"'
scripts/run_in_python_env.sh out/venv './scripts/tests/run_python_test.py --script "src/python_testing/TestSpecParsingSupport.py" --script-args "--trace-to json:out/trace_data/test-{SCRIPT_BASE_NAME}.json --trace-to perfetto:out/trace_data/test-{SCRIPT_BASE_NAME}.perfetto"'
scripts/run_in_python_env.sh out/venv './scripts/tests/TestTimeSyncTrustedTimeSourceRunner.py'
Expand Down
3 changes: 2 additions & 1 deletion src/python_testing/TC_EWATERHTR_2_1.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,8 @@
# See https://github.com/project-chip/connectedhomeip/blob/master/docs/testing/python.md#defining-the-ci-test-arguments
# for details about the block below.
#
# === BEGIN CI TEST ARGUMENTS ===# test-runner-runs: run1
# === BEGIN CI TEST ARGUMENTS ===
# test-runner-runs: run1
# test-runner-run/run1/app: ${ALL_CLUSTERS_APP}
# test-runner-run/run1/factoryreset: True
# test-runner-run/run1/quiet: True
Expand Down
3 changes: 2 additions & 1 deletion src/python_testing/TC_EWATERHTR_2_2.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,8 @@
# See https://github.com/project-chip/connectedhomeip/blob/master/docs/testing/python.md#defining-the-ci-test-arguments
# for details about the block below.
#
# === BEGIN CI TEST ARGUMENTS ===# test-runner-runs: run1
# === BEGIN CI TEST ARGUMENTS ===
# test-runner-runs: run1
# test-runner-run/run1/app: ${ALL_CLUSTERS_APP}
# test-runner-run/run1/factoryreset: True
# test-runner-run/run1/quiet: True
Expand Down
3 changes: 2 additions & 1 deletion src/python_testing/TC_EWATERHTR_2_3.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,8 @@
# See https://github.com/project-chip/connectedhomeip/blob/master/docs/testing/python.md#defining-the-ci-test-arguments
# for details about the block below.
#
# === BEGIN CI TEST ARGUMENTS ===# test-runner-runs: run1
# === BEGIN CI TEST ARGUMENTS ===
# test-runner-runs: run1
# test-runner-run/run1/app: ${ALL_CLUSTERS_APP}
# test-runner-run/run1/factoryreset: True
# test-runner-run/run1/quiet: True
Expand Down
10 changes: 10 additions & 0 deletions src/python_testing/execute_python_tests.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,14 +64,24 @@ def main(search_directory, env_file):
"TC_ECOINFO_2_1.py",
"TC_ECOINFO_2_2.py",
"TC_EWATERHTRBase.py",
"TC_EWATERHTR_2_1.py",
"TC_EWATERHTR_2_2.py",
"TC_EWATERHTR_2_3.py",
"TC_EnergyReporting_Utils.py",
"TC_OpstateCommon.py",
"TC_pics_checker.py",
"TC_TMP_2_1.py",
"TC_MCORE_FS_1_1.py",
"TC_MCORE_FS_1_2.py",
"TC_MCORE_FS_1_3.py",
"TC_OCC_3_1.py",
"TC_OCC_3_2.py",
"TC_BRBINFO_4_1.py",
"TC_SEAR_1_2.py",
"TC_SEAR_1_3.py",
"TC_SEAR_1_4.py",
"TC_SEAR_1_5.py",
"TC_SEAR_1_6.py",
"TestCommissioningTimeSync.py",
"TestConformanceSupport.py",
"TestChoiceConformanceSupport.py",
Expand Down

0 comments on commit bf7b30c

Please sign in to comment.