Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[repl tests] Allow the ability to run all tests in the test suite (including manual) #24707

Merged
merged 5 commits into from
Jan 28, 2023
Merged

[repl tests] Allow the ability to run all tests in the test suite (including manual) #24707

merged 5 commits into from
Jan 28, 2023

Conversation

andy31415
Copy link
Contributor

@andy31415 andy31415 commented Jan 27, 2023 •
edited
Loading

While we are developing things, it seems very convenient to just run all tests even if they fail, to see what passes/fails.
This is faster than running 1 by 1 as startup of network namespaces takes a while.

Usage is like:

export BUILD_VARIANT=no-ble-tsan-clang
export PYTHONPATH=$PW_PROJECT_ROOT/scripts/py_matter_idl/:$PW_PROJECT_ROOT/scripts/py_matter_yamltests

./scripts/tests/run_test_suite.py \
    --run-yamltests-with-chip-repl \
    --manual include \
    run \
    --iterations 1 \
    --test-timeout-seconds 120 \
    --all-clusters-app ./out/linux-x64-all-clusters-${BUILD_VARIANT}/chip-all-clusters-app \
    --lock-app ./out/linux-x64-lock-${BUILD_VARIANT}/chip-lock-app \
    --ota-provider-app ./out/linux-x64-ota-provider-${BUILD_VARIANT}/chip-ota-provider-app \
    --ota-requestor-app ./out/linux-x64-ota-requestor-${BUILD_VARIANT}/chip-ota-requestor-app \
    --tv-app ./out/linux-x64-tv-app-${BUILD_VARIANT}/chip-tv-app \
    --bridge-app ./out/linux-x64-bridge-${BUILD_VARIANT}/chip-bridge-app \
    --keep-going

And this gives me a full list of what tests pass and fail (assuming I only grep success/pass lines). It looks like:

2023-01-27 15:41:22.494 ERROR   Config_Example                 - FAILED in 1.47 seconds
2023-01-27 15:41:23.908 ERROR   Config_Variables_Example       - FAILED in 1.41 seconds
2023-01-27 15:41:25.549 ERROR   DL_LockUnlock                  - FAILED in 1.64 seconds
2023-01-27 15:41:27.980 INFO    DL_Schedules                   - Completed in 2.43 seconds
2023-01-27 15:41:30.863 INFO    DL_UsersAndCredentials         - Completed in 2.88 seconds
2023-01-27 15:41:32.326 ERROR   OTA_SuccessfulTransfer         - FAILED in 1.46 seconds
2023-01-27 15:41:33.740 ERROR   PICS_Example                   - FAILED in 1.41 seconds
2023-01-27 15:41:35.156 ERROR   Response_Example               - FAILED in 1.41 seconds
2023-01-27 15:41:36.591 INFO    TV_AccountLoginCluster         - Completed in 1.43 seconds
2023-01-27 15:41:38.069 INFO    TV_ApplicationBasicCluster     - Completed in 1.48 seconds
2023-01-27 15:41:39.547 INFO    TV_ApplicationLauncherCluster  - Completed in 1.48 seconds
2023-01-27 15:41:41.126 INFO    TV_AudioOutputCluster          - Completed in 1.58 seconds
2023-01-27 15:41:42.654 INFO    TV_ChannelCluster              - Completed in 1.53 seconds
2023-01-27 15:41:44.132 INFO    TV_ContentLauncherCluster      - Completed in 1.48 seconds
2023-01-27 15:41:45.610 INFO    TV_KeypadInputCluster          - Completed in 1.48 seconds
2023-01-27 15:41:47.038 INFO    TV_LowPowerCluster             - Completed in 1.43 seconds
2023-01-27 15:41:48.515 INFO    TV_MediaInputCluster           - Completed in 1.48 seconds
2023-01-27 15:41:50.144 INFO    TV_MediaPlaybackCluster        - Completed in 1.63 seconds
2023-01-27 15:41:51.622 INFO    TV_TargetNavigatorCluster      - Completed in 1.48 seconds
2023-01-27 15:41:53.050 INFO    TV_WakeOnLanCluster            - Completed in 1.43 seconds
2023-01-27 15:41:54.778 INFO    TestAccessControlCluster       - Completed in 1.73 seconds
2023-01-27 15:41:56.356 INFO    TestAccessControlConstraints   - Completed in 1.58 seconds
2023-01-27 15:41:57.820 ERROR   TestArmFailSafe                - FAILED in 1.46 seconds
2023-01-27 15:41:59.341 ERROR   TestBasicInformation           - FAILED in 1.52 seconds
2023-01-27 15:42:00.819 INFO    TestBinding                    - Completed in 1.48 seconds
2023-01-27 15:42:02.282 ERROR   TestCASERecovery               - FAILED in 1.46 seconds
2023-01-27 15:42:03.759 INFO    TestClientMonitoringCluster    - Completed in 1.48 seconds
...

@andy31415 andy31415 mentioned this pull request Jan 27, 2023
Merged
@github-actions
Copy link

github-actions bot commented Jan 27, 2023 •
edited
Loading

PR #24707: Size comparison from 42d0ac8 to 47df7aa

Increases (9 builds for bl602, bl702, esp32, nrfconnect, psoc6, qpg, telink)
platform target config section 42d0ac8 47df7aa change % change
bl602 lighting-app bl602 (read/write) 1345482 1345490 8 0.0
.text 1022520 1022522 2 0.0
bl602+rpc .text 1053454 1053456 2 0.0
bl702 lighting-app bl702+rpc .debug_info 44594412 44594413 1 0.0
.text 1029342 1029344 2 0.0
esp32 all-clusters-app c3devkit (read only) 1042094 1042096 2 0.0
.flash.text 1042094 1042096 2 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 text 804468 804472 4 0.0
psoc6 lock cy8ckit_062s2_43012 .debug_info 22711757 22711759 2 0.0
qpg lighting-app qpg6105+debug (read/write) 1148344 1148352 8 0.0
.text 595444 595452 8 0.0
telink all-clusters-minimal-app tlsr9518adk80d text 648510 648512 2 0.0
lighting-app tlsr9518adk80d text 659010 659012 2 0.0
Decreases (1 build for psoc6)
platform target config section 42d0ac8 47df7aa change % change
psoc6 all-clusters-minimal cy8ckit_062s2_43012 .debug_info 27063670 27063669 -1 -0.0
Full report (54 builds for bl602, bl702, cc13x2_26x2, cyw30739, efr32, esp32, k32w, linux, mbed, nrfconnect, psoc6, qpg, telink)
platform target config section 42d0ac8 47df7aa change % change
bl602 lighting-app bl602 (read/write) 1345482 1345490 8 0.0
.bss 94858 94858 0 0.0
.data 9736 9736 0 0.0
.text 1022520 1022522 2 0.0
bl602+rpc (read/write) 1390930 1390930 0 0.0
.bss 102906 102906 0 0.0
.data 10128 10128 0 0.0
.text 1053454 1053456 2 0.0
bl702 lighting-app bl702 (read only) 3358 3358 0 0.0
(read/write) 1184951 1184951 0 0.0
.bleromro 6342 6342 0 0.0
.bleromrw 124 124 0 0.0
.boot2 292 292 0 0.0
.bss 70701 70701 0 0.0
.bss_psram 30048 30048 0 0.0
.comment 48 48 0 0.0
.data 4056 4056 0 0.0
.debug_abbrev 1549986 1549986 0 0.0
.debug_aranges 134056 134056 0 0.0
.debug_frame 490996 490996 0 0.0
.debug_info 40198120 40198120 0 0.0
.debug_line 5267150 5267150 0 0.0
.debug_loc 3401859 3401859 0 0.0
.debug_ranges 371928 371928 0 0.0
.debug_str 3535090 3535090 0 0.0
.hbn 536 536 0 0.0
.hbn_noinit 260 260 0 0.0
.init 342 342 0 0.0
.init_array 144 144 0 0.0
.psram 0 0 0 0.0
.riscv.attributes 47 47 0 0.0
.rodata 106704 106704 0 0.0
.rsvd 2960 2960 0 0.0
.sha_ocram 72 72 0 0.0
.shstrtab 304 304 0 0.0
.stack 2048 2048 0 0.0
.strtab 571692 571692 0 0.0
.symtab 173184 173184 0 0.0
.tcm_data 36 36 0 0.0
.tcmcode 3358 3358 0 0.0
.text 0 0 0 0.0
952354 952354 0 0.0
bl702+rpc (read only) 3358 3358 0 0.0
(read/write) 1277579 1277579 0 0.0
.bleromro 6342 6342 0 0.0
.bleromrw 124 124 0 0.0
.boot2 292 292 0 0.0
.bss 78749 78749 0 0.0
.bss_psram 30304 30304 0 0.0
.comment 48 48 0 0.0
.data 4608 4608 0 0.0
.debug_abbrev 1698382 1698382 0 0.0
.debug_aranges 142280 142280 0 0.0
.debug_frame 518700 518700 0 0.0
.debug_info 44594412 44594413 1 0.0
.debug_line 5665475 5665475 0 0.0
.debug_loc 3597998 3597998 0 0.0
.debug_ranges 395632 395632 0 0.0
.debug_str 3938399 3938399 0 0.0
.hbn 536 536 0 0.0
.hbn_noinit 260 260 0 0.0
.init 342 342 0 0.0
.init_array 160 160 0 0.0
.psram 0 0 0 0.0
.riscv.attributes 47 47 0 0.0
.rodata 121232 121232 0 0.0
.rsvd 2960 2960 0 0.0
.sha_ocram 72 72 0 0.0
.shstrtab 304 304 0 0.0
.stack 2048 2048 0 0.0
.strtab 632289 632289 0 0.0
.symtab 191536 191536 0 0.0
.tcm_data 36 36 0 0.0
.tcmcode 3358 3358 0 0.0
.text 0 0 0 0.0
1029342 1029344 2 0.0
cc13x2_26x2 all-clusters-app LP_CC2652R7 (read only) 677311 677311 0 0.0
(read/write) 174672 174672 0 0.0
.bss 81676 81676 0 0.0
.data 3384 3384 0 0.0
.rodata 87471 87471 0 0.0
.text 589524 589524 0 0.0
all-clusters-minimal-app LP_CC2652R7 (read only) 641391 641391 0 0.0
(read/write) 158368 158368 0 0.0
.bss 80868 80868 0 0.0
.data 3384 3384 0 0.0
.rodata 77423 77423 0 0.0
.text 563648 563648 0 0.0
lock-ftd LP_CC2652R7 (read only) 674379 674379 0 0.0
(read/write) 174948 174948 0 0.0
.bss 79108 79108 0 0.0
.data 3312 3312 0 0.0
.rodata 76267 76267 0 0.0
.text 597632 597632 0 0.0
lock-mtd LP_CC2652R7 (read only) 660727 660727 0 0.0
(read/write) 183864 183864 0 0.0
.bss 74372 74372 0 0.0
.data 3312 3312 0 0.0
.rodata 102735 102735 0 0.0
.text 557512 557512 0 0.0
pump-app LP_CC2652R7 (read only) 687443 687443 0 0.0
(read/write) 162612 162612 0 0.0
.bss 79068 79068 0 0.0
.data 3276 3276 0 0.0
.rodata 90395 90395 0 0.0
.text 596568 596568 0 0.0
pump-controller-app LP_CC2652R7 (read only) 672875 672875 0 0.0
(read/write) 177292 177292 0 0.0
.bss 79180 79180 0 0.0
.data 3300 3300 0 0.0
.rodata 86475 86475 0 0.0
.text 585920 585920 0 0.0
shell LP_CC2652R7 (read only) 668558 668558 0 0.0
(read/write) 185496 185496 0 0.0
.bss 83748 83748 0 0.0
.data 3380 3380 0 0.0
.rodata 84206 84206 0 0.0
.text 584040 584040 0 0.0
cyw30739 light cyw930739m2evb_01 (read/write) 585458 585458 0 0.0
.app_xip_area 461476 461476 0 0.0
.bss 66432 66432 0 0.0
.data 736 736 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
lock cyw930739m2evb_01 (read/write) 589182 589182 0 0.0
.app_xip_area 459904 459904 0 0.0
.bss 71720 71720 0 0.0
.data 744 744 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
ota-requestor-no-progress-logging cyw930739m2evb_01 (read/write) 550822 550822 0 0.0
.app_xip_area 432328 432328 0 0.0
.bss 60984 60984 0 0.0
.data 692 692 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
efr32 lighting-app BRD4161A+rpc (read/write) 974160 974160 0 0.0
.bss 147152 147152 0 0.0
.data 2196 2196 0 0.0
.text 824792 824792 0 0.0
BRD4161A+rs911x (read/write) 1037212 1037212 0 0.0
.bss 181632 181632 0 0.0
.data 2040 2040 0 0.0
.text 853520 853520 0 0.0
BRD4187C (read/write) 1151328 1151328 0 0.0
.bss 133652 133652 0 0.0
.data 2544 2544 0 0.0
.text 990536 990536 0 0.0
lock-app BRD4161A+wf200 (read/write) 1064836 1064836 0 0.0
.bss 153152 153152 0 0.0
.data 2048 2048 0 0.0
.text 909616 909616 0 0.0
window-app BRD4187C (read/write) 1146240 1146240 0 0.0
.bss 135164 135164 0 0.0
.data 2572 2572 0 0.0
.text 983908 983908 0 0.0
esp32 all-clusters-app c3devkit (read only) 1042094 1042096 2 0.0
(read/write) 1516178 1516178 0 0.0
.dram0.bss 76032 76032 0 0.0
.dram0.data 13792 13792 0 0.0
.flash.rodata 220136 220136 0 0.0
.flash.text 1042094 1042096 2 0.0
.iram0.text 72896 72896 0 0.0
m5stack (read only) 1094279 1094279 0 0.0
(read/write) 497827 497827 0 0.0
.dram0.bss 81080 81080 0 0.0
.dram0.data 34072 34072 0 0.0
.flash.rodata 248904 248904 0 0.0
.flash.text 1088895 1088895 0 0.0
.iram0.text 124855 124855 0 0.0
k32w contact k32w0+release (read/write) 660940 660940 0 0.0
.bss 77360 77360 0 0.0
.data 2112 2112 0 0.0
.text 562356 562356 0 0.0
light k32w0+release (read/write) 672884 672884 0 0.0
.bss 75144 75144 0 0.0
.data 2064 2064 0 0.0
.text 592948 592948 0 0.0
lock k32w0+release (read/write) 632320 632320 0 0.0
.bss 75912 75912 0 0.0
.data 2084 2084 0 0.0
.text 551596 551596 0 0.0
linux all-clusters-app debug (read only) 3154921 3154921 0 0.0
(read/write) 154864 154864 0 0.0
.bss 63744 63744 0 0.0
.data 2272 2272 0 0.0
.data.rel.ro 82248 82248 0 0.0
.dynamic 608 608 0 0.0
.got 4776 4776 0 0.0
.init 27 27 0 0.0
.init_array 1192 1192 0 0.0
.rodata 283659 283659 0 0.0
.text 2685842 2685842 0 0.0
all-clusters-minimal-app debug (read only) 2971193 2971193 0 0.0
(read/write) 148080 148080 0 0.0
.bss 62880 62880 0 0.0
.data 2240 2240 0 0.0
.data.rel.ro 76472 76472 0 0.0
.dynamic 608 608 0 0.0
.got 4688 4688 0 0.0
.init 27 27 0 0.0
.init_array 1160 1160 0 0.0
.rodata 282379 282379 0 0.0
.text 2506722 2506722 0 0.0
bridge-app debug (read only) 2524809 2524809 0 0.0
(read/write) 132320 132320 0 0.0
.bss 53632 53632 0 0.0
.data 3632 3632 0 0.0
.data.rel.ro 68952 68952 0 0.0
.dynamic 608 608 0 0.0
.got 4616 4616 0 0.0
.init 27 27 0 0.0
.init_array 856 856 0 0.0
.rodata 213920 213920 0 0.0
.text 2138498 2138498 0 0.0
chip-tool debug (read only) 11666961 11666961 0 0.0
(read/write) 648720 648720 0 0.0
.bss 26264 26264 0 0.0
.data 3042 3042 0 0.0
.data.rel.ro 612656 612656 0 0.0
.dynamic 608 608 0 0.0
.got 5352 5352 0 0.0
.init 27 27 0 0.0
.init_array 752 752 0 0.0
.rodata 650117 650117 0 0.0
.text 9514084 9514084 0 0.0
chip-tool-ipv6only arm64 (read only) 11041532 11041532 0 0.0
(read/write) 698024 698024 0 0.0
.bss 34248 34248 0 0.0
.data 3008 3008 0 0.0
.data.rel.ro 641448 641448 0 0.0
.dynamic 560 560 0 0.0
.got 14120 14120 0 0.0
.init 24 24 0 0.0
.init_array 208 208 0 0.0
.rodata 576188 576188 0 0.0
.text 8812644 8812644 0 0.0
lighting-app debug+rpc (read only) 2692241 2692241 0 0.0
(read/write) 131688 131688 0 0.0
.bss 51104 51104 0 0.0
.data 2288 2288 0 0.0
.data.rel.ro 72088 72088 0 0.0
.dynamic 608 608 0 0.0
.got 4648 4648 0 0.0
.init 27 27 0 0.0
.init_array 928 928 0 0.0
.rodata 229856 229856 0 0.0
.text 2285026 2285026 0 0.0
lock-app debug (read only) 2655033 2655033 0 0.0
(read/write) 126736 126736 0 0.0
.bss 49536 49536 0 0.0
.data 1904 1904 0 0.0
.data.rel.ro 69064 69064 0 0.0
.dynamic 608 608 0 0.0
.got 4680 4680 0 0.0
.init 27 27 0 0.0
.init_array 904 904 0 0.0
.rodata 246088 246088 0 0.0
.text 2236434 2236434 0 0.0
ota-provider-app debug (read only) 2225041 2225041 0 0.0
(read/write) 106480 106480 0 0.0
.bss 47712 47712 0 0.0
.data 2080 2080 0 0.0
.data.rel.ro 51560 51560 0 0.0
.dynamic 608 608 0 0.0
.got 3744 3744 0 0.0
.init 27 27 0 0.0
.init_array 744 744 0 0.0
.rodata 197416 197416 0 0.0
.text 1887106 1887106 0 0.0
ota-requestor-app debug (read only) 2386553 2386553 0 0.0
(read/write) 114208 114208 0 0.0
.bss 50176 50176 0 0.0
.data 2480 2480 0 0.0
.data.rel.ro 56328 56328 0 0.0
.dynamic 608 608 0 0.0
.got 3744 3744 0 0.0
.init 27 27 0 0.0
.init_array 824 824 0 0.0
.rodata 204400 204400 0 0.0
.text 2032610 2032610 0 0.0
shell debug (read only) 2684385 2684385 0 0.0
(read/write) 139360 139360 0 0.0
.bss 59144 59144 0 0.0
.data 1264 1264 0 0.0
.data.rel.ro 73128 73128 0 0.0
.dynamic 608 608 0 0.0
.got 4136 4136 0 0.0
.init 27 27 0 0.0
.init_array 1040 1040 0 0.0
.rodata 241746 241746 0 0.0
.text 2282194 2282194 0 0.0
thermostat-no-ble arm64 (read only) 2506604 2506604 0 0.0
(read/write) 144680 144680 0 0.0
.bss 56456 56456 0 0.0
.data 1824 1824 0 0.0
.data.rel.ro 76968 76968 0 0.0
.dynamic 560 560 0 0.0
.got 5392 5392 0 0.0
.init 24 24 0 0.0
.init_array 432 432 0 0.0
.rodata 150856 150856 0 0.0
.text 2093920 2093920 0 0.0
tv-app debug (read only) 3314609 3314609 0 0.0
(read/write) 259568 259568 0 0.0
.bss 170872 170872 0 0.0
.data 3904 3904 0 0.0
.data.rel.ro 78096 78096 0 0.0
.dynamic 608 608 0 0.0
.got 5008 5008 0 0.0
.init 27 27 0 0.0
.init_array 1072 1072 0 0.0
.rodata 270520 270520 0 0.0
.text 2849362 2849362 0 0.0
tv-casting-app debug (read only) 5692681 5692681 0 0.0
(read/write) 162264 162264 0 0.0
.bss 53496 53496 0 0.0
.data 1936 1936 0 0.0
.data.rel.ro 100216 100216 0 0.0
.dynamic 608 608 0 0.0
.got 4928 4928 0 0.0
.init 27 27 0 0.0
.init_array 1048 1048 0 0.0
.rodata 365332 365332 0 0.0
.text 5048690 5048690 0 0.0
mbed lock-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2463256 2463256 0 0.0
.bss 215956 215956 0 0.0
.data 5880 5880 0 0.0
.text 1425900 1425900 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 (read only) 4 4 0 0.0
(read/write) 1165296 1165296 0 0.0
bss 147246 147246 0 0.0
rodata 133352 133352 0 0.0
text 804468 804472 4 0.0
nrf7002dk_nrf5340_cpuapp (read only) 4 4 0 0.0
(read/write) 1366864 1366864 0 0.0
bss 106546 106546 0 0.0
rodata 210832 210832 0 0.0
text 763636 763636 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 (read only) 4 4 0 0.0
(read/write) 1111544 1111544 0 0.0
bss 146402 146402 0 0.0
rodata 110496 110496 0 0.0
text 774544 774544 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 (read only) 840808 840808 0 0.0
(read/write) 1755764 1755764 0 0.0
.ARM.attributes 46 46 0 0.0
.ARM.exidx 8 8 0 0.0
.bss 189864 189864 0 0.0
.comment 200 200 0 0.0
.copy.table 24 24 0 0.0
.cy_m0p_image 6216 6216 0 0.0
.cy_sharedmem 8 8 0 0.0
.data 2672 2672 0 0.0
.debug_abbrev 1251453 1251453 0 0.0
.debug_aranges 111280 111280 0 0.0
.debug_frame 373636 373636 0 0.0
.debug_info 27505917 27505917 0 0.0
.debug_line 3778983 3778983 0 0.0
.debug_loc 3673163 3673163 0 0.0
.debug_ranges 362248 362248 0 0.0
.debug_str 3485010 3485010 0 0.0
.heap 840808 840808 0 0.0
.noinit 148 148 0 0.0
.ramVectors 736 736 0 0.0
.shstrtab 288 288 0 0.0
.stab 156 156 0 0.0
.stabstr 335 335 0 0.0
.stack_dummy 4096 4096 0 0.0
.strtab 577246 577246 0 0.0
.symtab 424288 424288 0 0.0
.text 1554840 1554840 0 0.0
.zero.table 8 8 0 0.0
text 0 0 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 (read only) 841624 841624 0 0.0
(read/write) 1697644 1697644 0 0.0
.ARM.attributes 46 46 0 0.0
.ARM.exidx 8 8 0 0.0
.bss 189056 189056 0 0.0
.comment 200 200 0 0.0
.copy.table 24 24 0 0.0
.cy_m0p_image 6216 6216 0 0.0
.cy_sharedmem 8 8 0 0.0
.data 2664 2664 0 0.0
.debug_abbrev 1237164 1237164 0 0.0
.debug_aranges 110544 110544 0 0.0
.debug_frame 376080 376080 0 0.0
.debug_info 27063670 27063669 -1 -0.0
.debug_line 3787349 3787349 0 0.0
.debug_loc 3656893 3656893 0 0.0
.debug_ranges 360216 360216 0 0.0
.debug_str 3470763 3470763 0 0.0
.heap 841624 841624 0 0.0
.noinit 148 148 0 0.0
.ramVectors 736 736 0 0.0
.shstrtab 288 288 0 0.0
.stab 156 156 0 0.0
.stabstr 335 335 0 0.0
.stack_dummy 4096 4096 0 0.0
.strtab 538662 538662 0 0.0
.symtab 409728 409728 0 0.0
.text 1497536 1497536 0 0.0
.zero.table 0 0 0 0.0
8 8 0 0.0
light cy8ckit_062s2_43012 (read only) 849944 849944 0 0.0
(read/write) 1611196 1611196 0 0.0
.ARM.attributes 46 46 0 0.0
.ARM.exidx 8 8 0 0.0
.bss 180936 180936 0 0.0
.comment 200 200 0 0.0
.copy.table 24 24 0 0.0
.cy_m0p_image 6216 6216 0 0.0
.cy_sharedmem 8 8 0 0.0
.data 2464 2464 0 0.0
.debug_abbrev 1072030 1072030 0 0.0
.debug_aranges 102800 102800 0 0.0
.debug_frame 346624 346624 0 0.0
.debug_info 22491101 22491101 0 0.0
.debug_line 3340154 3340154 0 0.0
.debug_loc 3336443 3336443 0 0.0
.debug_ranges 319440 319440 0 0.0
.debug_str 3274787 3274787 0 0.0
.heap 849944 849944 0 0.0
.noinit 148 148 0 0.0
.ramVectors 736 736 0 0.0
.shstrtab 288 288 0 0.0
.stab 156 156 0 0.0
.stabstr 335 335 0 0.0
.stack_dummy 4096 4096 0 0.0
.strtab 474072 474072 0 0.0
.symtab 377632 377632 0 0.0
.text 1419408 1419408 0 0.0
.zero.table 0 0 0 0.0
8 8 0 0.0
lock cy8ckit_062s2_43012 (read only) 844960 844960 0 0.0
(read/write) 1645260 1645260 0 0.0
.ARM.attributes 46 46 0 0.0
.ARM.exidx 8 8 0 0.0
.bss 185912 185912 0 0.0
.comment 200 200 0 0.0
.copy.table 24 24 0 0.0
.cy_m0p_image 6216 6216 0 0.0
.cy_sharedmem 8 8 0 0.0
.data 2472 2472 0 0.0
.debug_abbrev 1073378 1073378 0 0.0
.debug_aranges 103184 103184 0 0.0
.debug_frame 348424 348424 0 0.0
.debug_info 22711757 22711759 2 0.0
.debug_line 3341884 3341884 0 0.0
.debug_loc 3358062 3358062 0 0.0
.debug_ranges 321296 321296 0 0.0
.debug_str 3291194 3291194 0 0.0
.heap 844960 844960 0 0.0
.noinit 148 148 0 0.0
.ramVectors 736 736 0 0.0
.shstrtab 288 288 0 0.0
.stab 156 156 0 0.0
.stabstr 335 335 0 0.0
.stack_dummy 4096 4096 0 0.0
.strtab 477007 477007 0 0.0
.symtab 379456 379456 0 0.0
.text 1448488 1448488 0 0.0
.zero.table 0 0 0 0.0
8 8 0 0.0
qpg lighting-app qpg6105+debug (read/write) 1148344 1148352 8 0.0
.bss 100668 100668 0 0.0
.data 848 848 0 0.0
.text 595444 595452 8 0.0
lock-app qpg6105+debug (read/write) 1116056 1116056 0 0.0
.bss 97188 97188 0 0.0
.data 860 860 0 0.0
.text 563152 563152 0 0.0
telink all-clusters-app tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 1016676 1016676 0 0.0
bss 98776 98776 0 0.0
text 686128 686128 0 0.0
all-clusters-minimal-app tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 953344 953344 0 0.0
bss 97824 97824 0 0.0
text 648510 648512 2 0.0
contact-sensor-app tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 858792 858792 0 0.0
bss 89948 89948 0 0.0
text 579488 579488 0 0.0
light-switch-app tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 874572 874572 0 0.0
bss 90036 90036 0 0.0
text 593614 593614 0 0.0
lighting-app tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 951888 951888 0 0.0
bss 98184 98184 0 0.0
text 659010 659012 2 0.0
ota-requestor-app tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 888732 888732 0 0.0
bss 90984 90984 0 0.0
text 604982 604982 0 0.0
thermostat tlsr9518adk80d (read only) 4 4 0 0.0
(read/write) 878780 878780 0 0.0
bss 91424 91424 0 0.0
text 595190 595190 0 0.0

@andy31415 andy31415 enabled auto-merge (squash) January 28, 2023 03:41
@andy31415 andy31415 merged commit fe24ee2 into project-chip:master Jan 28, 2023
shchen-Lab added a commit to bouffalolab/connectedhomeip-1 that referenced this pull request Feb 6, 2023
@shchen-Lab
Merge tag 'TE_23_02/rc2' into bl702l_matter
1514ed3 
* tag 'TE_23_02/rc2': (374 commits)
  Fix placeholder app shutdown to actually do a clean stack shutdown. (project-chip#24714)
  [chip-repl tests] Update tests that can pass (project-chip#24708)
  [repl tests] Allow the ability to run all tests in the test suite (including manual) (project-chip#24707)
  Rename silabs/types.xml to silabs/types-silabs.xml to prevent it to be loaded before chip/chip-types.xml since zcl-loader-silabs.js::parseZclFiles reorder the files if it match types.xml (project-chip#24710)
  Replace more arm64 nodeps-clang variants with just nodeps as they are mutually exclusive (project-chip#24704)
  Fix cloudbuild targets: It is "all-clusters" and not "all-clusters-app" (project-chip#24703)
  [Telink] Improve the Identify Implementation & Update every image to 0.6.35 (project-chip#24690)
  Add ability to list all YAML tests and manually run them from the test runner (project-chip#24629)
  silabs_fix_lighting_app_lcd (project-chip#24661)
  TC-ACE-1.4 automation (project-chip#24157)
  Update TC_RR_1_1.py to match test spec changes. (project-chip#24664)
  [nrfconnect] Fixed window covering compilation failure (project-chip#24700)
  [Telink] Logs optimization (project-chip#24693)
  [tv-app + YAML tests] Update the yaml tests to use the correct formatting for the responses since CurrentChannel is a struct (project-chip#24696)
  [YAML tests] Add PICS code to Color Control WaitForDelay steps (project-chip#24699)
  chip-repl tests: xml parsing to report location of where unrecognized handlers reside (project-chip#24674)
  Remove Basic SWBuildId extension from zll.xml since there is no cluster with this code (0x0000) (project-chip#24689)
  [Thermostat Cluster] Move related bitmaps/enums from silabs/types.xml to chip/thermostat-cluster.xml (project-chip#24694)
  [darwin] Add [WiFi/Ethernet]NetworkDiagnosticsFeature bitmaps and their values to darwin availability register (project-chip#24692)
  Less XML parsing, resulting in less errors (project-chip#24667)
  ...
lecndav pushed a commit to lecndav/connectedhomeip that referenced this pull request Mar 22, 2023
@andy31415 @andreilitvin
[repl tests] Allow the ability to run all tests in the test suite (in…
6224301 
…cluding manual) (project-chip#24707)

* Allow the ability to run all tests in the test suite (including manual)

* Even better logic for tests - allow full control on what to do with manual tests (skip, keep as is, only manual)

* Update flags a bit to make it clearer what manual flag does

* Typo fix

* Restyle

---------

Co-authored-by: Andrei Litvin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@amitnj amitnj Awaiting requested review from amitnj

@anush-apple anush-apple Awaiting requested review from anush-apple

@arkq arkq Awaiting requested review from arkq

@Byungjoo-Lee Byungjoo-Lee Awaiting requested review from Byungjoo-Lee

@carol-apple carol-apple Awaiting requested review from carol-apple

@chrisdecenzo chrisdecenzo Awaiting requested review from chrisdecenzo

@chshu chshu Awaiting requested review from chshu

@chulspro chulspro Awaiting requested review from chulspro

@CodeChronos928 CodeChronos928 Awaiting requested review from CodeChronos928

@dhrishi dhrishi Awaiting requested review from dhrishi

@electrocucaracha electrocucaracha Awaiting requested review from electrocucaracha

@emargolis emargolis Awaiting requested review from emargolis

@franck-apple franck-apple Awaiting requested review from franck-apple

@gjc13 gjc13 Awaiting requested review from gjc13

@harsha-rajendran harsha-rajendran Awaiting requested review from harsha-rajendran

@hawk248 hawk248 Awaiting requested review from hawk248

@jelderton jelderton Awaiting requested review from jelderton

@jepenven-silabs jepenven-silabs Awaiting requested review from jepenven-silabs

@jmartinez-silabs jmartinez-silabs Awaiting requested review from jmartinez-silabs

@jmeg-sfy jmeg-sfy Awaiting requested review from jmeg-sfy

@jtung-apple jtung-apple Awaiting requested review from jtung-apple

@ksperling-apple ksperling-apple Awaiting requested review from ksperling-apple

@lazarkov lazarkov Awaiting requested review from lazarkov

@lpbeliveau-silabs lpbeliveau-silabs Awaiting requested review from lpbeliveau-silabs

@LuDuda LuDuda Awaiting requested review from LuDuda

@mlepage-google mlepage-google Awaiting requested review from mlepage-google

@mrjerryjohns mrjerryjohns Awaiting requested review from mrjerryjohns

@msandstedt msandstedt Awaiting requested review from msandstedt

@mspang mspang Awaiting requested review from mspang

@pjzander-signify pjzander-signify Awaiting requested review from pjzander-signify

@robszewczyk robszewczyk Awaiting requested review from robszewczyk

@saurabhst saurabhst Awaiting requested review from saurabhst

@selissia selissia Awaiting requested review from selissia

@tcarmelveilleux tcarmelveilleux Awaiting requested review from tcarmelveilleux

@tecimovic tecimovic Awaiting requested review from tecimovic

@tehampson tehampson Awaiting requested review from tehampson

@vijs vijs Awaiting requested review from vijs

@vivien-apple vivien-apple Awaiting requested review from vivien-apple

@woody-apple woody-apple Awaiting requested review from woody-apple

@xylophone21 xylophone21 Awaiting requested review from xylophone21

@yufengwangca yufengwangca Awaiting requested review from yufengwangca

@yunhanw-google yunhanw-google Awaiting requested review from yunhanw-google

@bzbarsky-apple bzbarsky-apple Awaiting requested review from bzbarsky-apple

@Damian-Nordic Damian-Nordic Awaiting requested review from Damian-Nordic

Assignees
No one assigned
Labels
review - approved scripts
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@andy31415 @bzbarsky-apple @Damian-Nordic @andreilitvin