Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement TC-SC-3.6 as a Python test #21719

Merged
merged 3 commits into from
Aug 10, 2022

Conversation

tcarmelveilleux
Copy link
Contributor

@tcarmelveilleux tcarmelveilleux commented Aug 8, 2022

Problem

  • Test TC-SC-3.6 was not feasible with chip-tool and manual
    intervention due to the complexity of validating that the
    correct sessions were established, establishing all of them,
    and ensuring all subscriptions fire as intended.

Issue #21009

Change overview

  • Adds a version of TC-SC-3.6 in Python
  • Updates the Python code with minor improvements needed during
    the development of the test
  • Touches no C++ SDK code

Testing

  • Ran the test as it could be done by an end-user, passed on Linux
    and on ESP32 (after some changes to resources in the examples, not
    included in this PR)

To run:

  • Build all-clusters app Linux:
    • scripts/examples/gn_build_example.sh examples/all-clusters-app/linux out/debug/standalone chip_config_network_layer_ble=false
    • In a shell, run: clear && rm -f kvs1 && out/debug/standalone/chip-all-clusters-app --discriminator 2118 --KVS kvs1
  • Build the Python environment, activate it, then run the test
    • ./scripts/build_python.sh -m platform -i separate
    • . ./out/python_env/bin/activate
    • Run the test: rm -f admin_storage.json && python src/python_testing/TC_SC_3_6.py -m on-network -d 2118 -p 20202021

@github-actions
Copy link

github-actions bot commented Aug 8, 2022

PR #21719: Size comparison from 34a8570 to 79c05c2

Increases (5 builds for bl602, cc13x2_26x2, k32w, telink)
platform target config section 34a8570 79c05c2 change % change
bl602 lighting-app bl602+rpc .text 1079400 1079404 4 0.0
cc13x2_26x2 all-clusters-app LP_CC2652R7 (read only) 670767 670775 8 0.0
.text 581980 581988 8 0.0
k32w light k32w0+release (read/write) 643356 643372 16 0.0
.text 568872 568888 16 0.0
telink light-switch-app tlsr9518adk80d text 569662 569666 4 0.0
lighting-app tlsr9518adk80d (read/write) 827712 827720 8 0.0
text 587636 587640 4 0.0
Decreases (2 builds for cc13x2_26x2, esp32)
platform target config section 34a8570 79c05c2 change % change
cc13x2_26x2 all-clusters-app LP_CC2652R7 (read/write) 180616 180608 -8 -0.0
esp32 all-clusters-app c3devkit (read only) 1025872 1025870 -2 -0.0
.flash.text 1025872 1025870 -2 -0.0
Full report (43 builds for bl602, cc13x2_26x2, cyw30739, efr32, esp32, k32w, linux, mbed, nrfconnect, p6, telink)
platform target config section 34a8570 79c05c2 change % change
bl602 lighting-app bl602 (read/write) 1379714 1379714 0 0.0
.bss 119746 119746 0 0.0
.data 4480 4480 0 0.0
.text 1047900 1047900 0 0.0
bl602+rpc (read/write) 1424970 1424970 0 0.0
.bss 127186 127186 0 0.0
.data 4600 4600 0 0.0
.text 1079400 1079404 4 0.0
cc13x2_26x2 all-clusters-app LP_CC2652R7 (read only) 670767 670775 8 0.0
(read/write) 180616 180608 -8 -0.0
.bss 74276 74276 0 0.0
.data 3372 3372 0 0.0
.rodata 88471 88471 0 0.0
.text 581980 581988 8 0.0
all-clusters-minimal-app LP_CC2652R7 (read only) 636311 636311 0 0.0
(read/write) 157844 157844 0 0.0
.bss 73556 73556 0 0.0
.data 3372 3372 0 0.0
.rodata 77727 77727 0 0.0
.text 558260 558260 0 0.0
lock-ftd LP_CC2652R7 (read only) 672619 672619 0 0.0
(read/write) 168948 168948 0 0.0
.bss 71348 71348 0 0.0
.data 3296 3296 0 0.0
.rodata 76411 76411 0 0.0
.text 595728 595728 0 0.0
lock-mtd LP_CC2652R7 (read only) 655171 655171 0 0.0
(read/write) 182084 182084 0 0.0
.bss 67036 67036 0 0.0
.data 3296 3296 0 0.0
.rodata 101355 101355 0 0.0
.text 553336 553336 0 0.0
pump-app LP_CC2652R7 (read only) 682855 682855 0 0.0
(read/write) 159520 159520 0 0.0
.bss 71388 71388 0 0.0
.data 3296 3296 0 0.0
.rodata 89295 89295 0 0.0
.text 593076 593076 0 0.0
pump-controller-app LP_CC2652R7 (read only) 667319 667319 0 0.0
(read/write) 175192 175192 0 0.0
.bss 71524 71524 0 0.0
.data 3292 3292 0 0.0
.rodata 84839 84839 0 0.0
.text 582000 582000 0 0.0
shell LP_CC2652R7 (read only) 663450 663450 0 0.0
(read/write) 183452 183452 0 0.0
.bss 76596 76596 0 0.0
.data 3376 3376 0 0.0
.rodata 85418 85418 0 0.0
.text 577716 577716 0 0.0
cyw30739 light cyw930739m2evb_01 (read/write) 584390 584390 0 0.0
.app_xip_area 461192 461192 0 0.0
.bss 65640 65640 0 0.0
.data 744 744 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
lock cyw930739m2evb_01 (read/write) 590310 590310 0 0.0
.app_xip_area 462328 462328 0 0.0
.bss 70424 70424 0 0.0
.data 748 748 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
ota-requestor-no-progress-logging cyw930739m2evb_01 (read/write) 589378 589378 0 0.0
.app_xip_area 466996 466996 0 0.0
.bss 64880 64880 0 0.0
.data 688 688 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
efr32 lighting-app BRD4161A (read/write) 1096068 1096068 0 0.0
.bss 132844 132844 0 0.0
.data 2068 2068 0 0.0
.text 961132 961132 0 0.0
BRD4161A+rpc (read/write) 1150332 1150332 0 0.0
.bss 149532 149532 0 0.0
.data 2280 2280 0 0.0
.text 998500 998500 0 0.0
BRD4161A+rs911x (read/write) 985356 985356 0 0.0
.bss 162184 162184 0 0.0
.data 2056 2056 0 0.0
.text 821096 821096 0 0.0
lock-app BRD4161A+wf200 (read/write) 1136024 1136024 0 0.0
.bss 144824 144824 0 0.0
.data 2064 2064 0 0.0
.text 989116 989116 0 0.0
window-app BRD4161A (read/write) 1087808 1087808 0 0.0
.bss 134292 134292 0 0.0
.data 2096 2096 0 0.0
.text 951400 951400 0 0.0
esp32 all-clusters-app c3devkit (read only) 1025872 1025870 -2 -0.0
(read/write) 1487282 1487282 0 0.0
.dram0.bss 70336 70336 0 0.0
.dram0.data 14600 14600 0 0.0
.flash.rodata 216912 216912 0 0.0
.flash.text 1025872 1025870 -2 -0.0
.iram0.text 62902 62902 0 0.0
m5stack (read only) 1079171 1079171 0 0.0
(read/write) 489288 489288 0 0.0
.dram0.bss 75840 75840 0 0.0
.dram0.data 34144 34144 0 0.0
.flash.rodata 247308 247308 0 0.0
.flash.text 1073787 1073787 0 0.0
.iram0.text 123267 123267 0 0.0
k32w light k32w0+release (read/write) 643356 643372 16 0.0
.bss 69712 69712 0 0.0
.data 2044 2044 0 0.0
.text 568872 568888 16 0.0
lock k32w0+release (read/write) 700764 700764 0 0.0
.bss 70184 70184 0 0.0
.data 2052 2052 0 0.0
.text 625800 625800 0 0.0
linux all-clusters-app debug (read only) 3022857 3022857 0 0.0
(read/write) 155720 155720 0 0.0
.bss 61888 61888 0 0.0
.data 2096 2096 0 0.0
.data.rel.ro 85384 85384 0 0.0
.dynamic 608 608 0 0.0
.got 4568 4568 0 0.0
.init 27 27 0 0.0
.init_array 1152 1152 0 0.0
.rodata 272843 272843 0 0.0
.text 2571154 2571154 0 0.0
all-clusters-minimal-app debug (read only) 2864721 2864721 0 0.0
(read/write) 147488 147488 0 0.0
.bss 61152 61152 0 0.0
.data 2064 2064 0 0.0
.data.rel.ro 78008 78008 0 0.0
.dynamic 608 608 0 0.0
.got 4488 4488 0 0.0
.init 27 27 0 0.0
.init_array 1144 1144 0 0.0
.rodata 272939 272939 0 0.0
.text 2415554 2415554 0 0.0
bridge-app debug+rpc (read only) 2363993 2363993 0 0.0
(read/write) 127416 127416 0 0.0
.bss 50592 50592 0 0.0
.data 3600 3600 0 0.0
.data.rel.ro 67368 67368 0 0.0
.dynamic 608 608 0 0.0
.got 4392 4392 0 0.0
.init 27 27 0 0.0
.init_array 816 816 0 0.0
.rodata 202088 202088 0 0.0
.text 1999426 1999426 0 0.0
chip-tool debug (read only) 10445041 10445041 0 0.0
(read/write) 646464 646464 0 0.0
.bss 24856 24856 0 0.0
.data 3266 3266 0 0.0
.data.rel.ro 611800 611800 0 0.0
.dynamic 608 608 0 0.0
.got 5104 5104 0 0.0
.init 27 27 0 0.0
.init_array 768 768 0 0.0
.rodata 533269 533269 0 0.0
.text 8415412 8415412 0 0.0
chip-tool-ipv6only arm64 (read only) 9859644 9859644 0 0.0
(read/write) 694145 694145 0 0.0
.bss 32897 32897 0 0.0
.data 3272 3272 0 0.0
.data.rel.ro 639360 639360 0 0.0
.dynamic 560 560 0 0.0
.got 13640 13640 0 0.0
.init 24 24 0 0.0
.init_array 192 192 0 0.0
.rodata 464636 464636 0 0.0
.text 7767716 7767716 0 0.0
lighting-app debug+rpc (read only) 2587625 2587625 0 0.0
(read/write) 130008 130008 0 0.0
.bss 49728 49728 0 0.0
.data 2096 2096 0 0.0
.data.rel.ro 72248 72248 0 0.0
.dynamic 608 608 0 0.0
.got 4392 4392 0 0.0
.init 27 27 0 0.0
.init_array 912 912 0 0.0
.rodata 218736 218736 0 0.0
.text 2198322 2198322 0 0.0
lock-app debug (read only) 2571825 2571825 0 0.0
(read/write) 125376 125376 0 0.0
.bss 48256 48256 0 0.0
.data 1712 1712 0 0.0
.data.rel.ro 69416 69416 0 0.0
.dynamic 608 608 0 0.0
.got 4464 4464 0 0.0
.init 27 27 0 0.0
.init_array 888 888 0 0.0
.rodata 235696 235696 0 0.0
.text 2169618 2169618 0 0.0
ota-provider-app debug (read only) 2349409 2349409 0 0.0
(read/write) 118848 118848 0 0.0
.bss 47808 47808 0 0.0
.data 1936 1936 0 0.0
.data.rel.ro 63224 63224 0 0.0
.dynamic 608 608 0 0.0
.got 4488 4488 0 0.0
.init 27 27 0 0.0
.init_array 760 760 0 0.0
.rodata 207896 207896 0 0.0
.text 1978162 1978162 0 0.0
ota-requestor-app debug (read only) 2473449 2473449 0 0.0
(read/write) 126248 126248 0 0.0
.bss 50176 50176 0 0.0
.data 2240 2240 0 0.0
.data.rel.ro 67896 67896 0 0.0
.dynamic 608 608 0 0.0
.got 4480 4480 0 0.0
.init 27 27 0 0.0
.init_array 832 832 0 0.0
.rodata 212448 212448 0 0.0
.text 2089010 2089010 0 0.0
shell debug (read only) 2593457 2593457 0 0.0
(read/write) 141904 141904 0 0.0
.bss 57800 57800 0 0.0
.data 1264 1264 0 0.0
.data.rel.ro 77024 77024 0 0.0
.dynamic 608 608 0 0.0
.got 4136 4136 0 0.0
.init 27 27 0 0.0
.init_array 1024 1024 0 0.0
.rodata 233330 233330 0 0.0
.text 2201922 2201922 0 0.0
thermostat-no-ble arm64 (read only) 2349772 2349772 0 0.0
(read/write) 141649 141649 0 0.0
.bss 55313 55313 0 0.0
.data 1672 1672 0 0.0
.data.rel.ro 75856 75856 0 0.0
.dynamic 560 560 0 0.0
.got 5040 5040 0 0.0
.init 24 24 0 0.0
.init_array 408 408 0 0.0
.rodata 139668 139668 0 0.0
.text 1972592 1972592 0 0.0
tv-app debug (read only) 3167265 3167265 0 0.0
(read/write) 257864 257864 0 0.0
.bss 167480 167480 0 0.0
.data 4736 4736 0 0.0
.data.rel.ro 79096 79096 0 0.0
.dynamic 608 608 0 0.0
.got 4864 4864 0 0.0
.init 27 27 0 0.0
.init_array 1064 1064 0 0.0
.rodata 257608 257608 0 0.0
.text 2719890 2719890 0 0.0
tv-casting-app debug (read only) 5402625 5402625 0 0.0
(read/write) 158856 158856 0 0.0
.bss 51384 51384 0 0.0
.data 2432 2432 0 0.0
.data.rel.ro 98608 98608 0 0.0
.dynamic 608 608 0 0.0
.got 4776 4776 0 0.0
.init 27 27 0 0.0
.init_array 1032 1032 0 0.0
.rodata 340529 340529 0 0.0
.text 4794130 4794130 0 0.0
mbed lock-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2452504 2452504 0 0.0
.bss 214556 214556 0 0.0
.data 5872 5872 0 0.0
.text 1415148 1415148 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 (read/write) 1177763 1177763 0 0.0
bss 143222 143222 0 0.0
rodata 142756 142756 0 0.0
text 812932 812932 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 (read/write) 1157819 1157819 0 0.0
bss 142460 142460 0 0.0
rodata 134452 134452 0 0.0
text 802084 802084 0 0.0
p6 all-clusters-app default (read only) 881528 881528 0 0.0
(read/write) 1690828 1690828 0 0.0
.bss 149168 149168 0 0.0
.data 2648 2648 0 0.0
.text 1530624 1530624 0 0.0
all-clusters-minimal-app default (read only) 882248 882248 0 0.0
(read/write) 1635020 1635020 0 0.0
.bss 148448 148448 0 0.0
.data 2648 2648 0 0.0
.text 1475536 1475536 0 0.0
light-app default (read only) 890568 890568 0 0.0
(read/write) 1553740 1553740 0 0.0
.bss 140336 140336 0 0.0
.data 2440 2440 0 0.0
.text 1402576 1402576 0 0.0
lock-app default (read only) 886072 886072 0 0.0
(read/write) 1591028 1591028 0 0.0
.bss 144816 144816 0 0.0
.data 2456 2456 0 0.0
.text 1435368 1435368 0 0.0
telink light-switch-app tlsr9518adk80d (read/write) 805912 805912 0 0.0
bss 70976 70976 0 0.0
noinit 43488 43488 0 0.0
text 569662 569666 4 0.0
lighting-app tlsr9518adk80d (read/write) 827712 827720 8 0.0
bss 71820 71820 0 0.0
noinit 43488 43488 0 0.0
text 587636 587640 4 0.0

Copy link
Contributor

@mrjerryjohns mrjerryjohns left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Requesting changes just so that I can get a chance to review this and auto-merge doesn't just merge it.

@mrjerryjohns mrjerryjohns dismissed their stale review August 9, 2022 00:26

Leaving comment instead.

Copy link
Contributor

@mrjerryjohns mrjerryjohns left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

src/controller/python/chip/ChipDeviceCtrl.py Outdated Show resolved Hide resolved
src/controller/python/chip/ChipDeviceCtrl.py Show resolved Hide resolved
src/python_testing/TC_SC_3_6.py Show resolved Hide resolved
src/python_testing/TC_SC_3_6.py Outdated Show resolved Hide resolved
src/python_testing/TC_SC_3_6.py Outdated Show resolved Hide resolved
src/python_testing/TC_SC_3_6.py Outdated Show resolved Hide resolved
src/python_testing/TC_SC_3_6.py Outdated Show resolved Hide resolved
src/python_testing/TC_SC_3_6.py Outdated Show resolved Hide resolved
@woody-apple woody-apple enabled auto-merge (squash) August 9, 2022 17:04
- Test TC-SC-3.6 was not feasible with chip-tool and manual
  intervention due to the complexity of validating that the
  correct sessions were established, establishing all of them,
  and ensuring all subscriptions fire as intended.

This PR:
- Adds a version of TC-SC-3.6 in Python
- Updates the Python code with minor improvements needed during
  the development of the test
- **Touches no C++ SDK code**

Testing done:

- Ran the test as it could be done by an end-user, passed on Linux
  and on ESP32 (after some changes to resources in the examples, not
  included in this PR)

To run:

- Build all-clusters app Linux:
  - `scripts/examples/gn_build_example.sh examples/all-clusters-app/linux out/debug/standalone chip_config_network_layer_ble=false`
  - In a shell, run: `clear && rm -f kvs1 && out/debug/standalone/chip-all-clusters-app --discriminator 2118 --KVS kvs1`
- Build the Python environment, activate it, then run the test
  - `./scripts/build_python.sh -m platform -i separate`
  - `. ./out/python_env/bin/activate`
  - Run the test: `rm -f admin_storage.json && python src/python_testing/TC_SC_3_6.py -m on-network -d 2118 -p 20202021`
@github-actions
Copy link

github-actions bot commented Aug 10, 2022

PR #21719: Size comparison from 397d642 to 0de5681

Increases (1 build for cc13x2_26x2)
platform target config section 397d642 0de5681 change % change
cc13x2_26x2 pump-app LP_CC2652R7 (read only) 683155 683163 8 0.0
.text 593356 593364 8 0.0
Decreases (5 builds for bl602, cc13x2_26x2, telink)
platform target config section 397d642 0de5681 change % change
bl602 lighting-app bl602 .text 1048348 1048344 -4 -0.0
bl602+rpc (read/write) 1425426 1425418 -8 -0.0
.text 1079848 1079844 -4 -0.0
cc13x2_26x2 pump-app LP_CC2652R7 (read/write) 159220 159212 -8 -0.0
telink light-switch-app tlsr9518adk80d text 569992 569990 -2 -0.0
lighting-app tlsr9518adk80d (read/write) 828096 828088 -8 -0.0
text 587968 587964 -4 -0.0
Full report (43 builds for bl602, cc13x2_26x2, cyw30739, efr32, esp32, k32w, linux, mbed, nrfconnect, p6, telink)
platform target config section 397d642 0de5681 change % change
bl602 lighting-app bl602 (read/write) 1380170 1380170 0 0.0
.bss 119746 119746 0 0.0
.data 4480 4480 0 0.0
.text 1048348 1048344 -4 -0.0
bl602+rpc (read/write) 1425426 1425418 -8 -0.0
.bss 127186 127186 0 0.0
.data 4600 4600 0 0.0
.text 1079848 1079844 -4 -0.0
cc13x2_26x2 all-clusters-app LP_CC2652R7 (read only) 671071 671071 0 0.0
(read/write) 180312 180312 0 0.0
.bss 74276 74276 0 0.0
.data 3372 3372 0 0.0
.rodata 88471 88471 0 0.0
.text 582284 582284 0 0.0
all-clusters-minimal-app LP_CC2652R7 (read only) 636599 636599 0 0.0
(read/write) 157844 157844 0 0.0
.bss 73556 73556 0 0.0
.data 3372 3372 0 0.0
.rodata 77727 77727 0 0.0
.text 558548 558548 0 0.0
lock-ftd LP_CC2652R7 (read only) 672907 672907 0 0.0
(read/write) 168660 168660 0 0.0
.bss 71348 71348 0 0.0
.data 3296 3296 0 0.0
.rodata 76411 76411 0 0.0
.text 596016 596016 0 0.0
lock-mtd LP_CC2652R7 (read only) 655515 655515 0 0.0
(read/write) 181740 181740 0 0.0
.bss 67036 67036 0 0.0
.data 3296 3296 0 0.0
.rodata 101363 101363 0 0.0
.text 553672 553672 0 0.0
pump-app LP_CC2652R7 (read only) 683155 683163 8 0.0
(read/write) 159220 159212 -8 -0.0
.bss 71388 71388 0 0.0
.data 3296 3296 0 0.0
.rodata 89315 89315 0 0.0
.text 593356 593364 8 0.0
pump-controller-app LP_CC2652R7 (read only) 667615 667615 0 0.0
(read/write) 174896 174896 0 0.0
.bss 71524 71524 0 0.0
.data 3292 3292 0 0.0
.rodata 84863 84863 0 0.0
.text 582272 582272 0 0.0
shell LP_CC2652R7 (read only) 663746 663746 0 0.0
(read/write) 183156 183156 0 0.0
.bss 76596 76596 0 0.0
.data 3376 3376 0 0.0
.rodata 85418 85418 0 0.0
.text 578012 578012 0 0.0
cyw30739 light cyw930739m2evb_01 (read/write) 584774 584774 0 0.0
.app_xip_area 461576 461576 0 0.0
.bss 65640 65640 0 0.0
.data 744 744 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
lock cyw930739m2evb_01 (read/write) 590710 590710 0 0.0
.app_xip_area 462728 462728 0 0.0
.bss 70424 70424 0 0.0
.data 748 748 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
ota-requestor-no-progress-logging cyw930739m2evb_01 (read/write) 597098 597098 0 0.0
.app_xip_area 474620 474620 0 0.0
.bss 64952 64952 0 0.0
.data 716 716 0 0.0
.rodata 0 0 0 0.0
.text 112 112 0 0.0
efr32 lighting-app BRD4161A (read/write) 1096596 1096596 0 0.0
.bss 132844 132844 0 0.0
.data 2068 2068 0 0.0
.text 961660 961660 0 0.0
BRD4161A+rpc (read/write) 1150860 1150860 0 0.0
.bss 149532 149532 0 0.0
.data 2280 2280 0 0.0
.text 999028 999028 0 0.0
BRD4161A+rs911x (read/write) 986116 986116 0 0.0
.bss 162184 162184 0 0.0
.data 2056 2056 0 0.0
.text 821856 821856 0 0.0
lock-app BRD4161A+wf200 (read/write) 1136692 1136692 0 0.0
.bss 144824 144824 0 0.0
.data 2064 2064 0 0.0
.text 989784 989784 0 0.0
window-app BRD4161A (read/write) 1088328 1088328 0 0.0
.bss 134292 134292 0 0.0
.data 2096 2096 0 0.0
.text 951920 951920 0 0.0
esp32 all-clusters-app c3devkit (read only) 1026246 1026246 0 0.0
(read/write) 1487426 1487426 0 0.0
.dram0.bss 70336 70336 0 0.0
.dram0.data 14600 14600 0 0.0
.flash.rodata 217056 217056 0 0.0
.flash.text 1026246 1026246 0 0.0
.iram0.text 62902 62902 0 0.0
m5stack (read only) 1079499 1079499 0 0.0
(read/write) 489392 489392 0 0.0
.dram0.bss 75840 75840 0 0.0
.dram0.data 34144 34144 0 0.0
.flash.rodata 247412 247412 0 0.0
.flash.text 1074115 1074115 0 0.0
.iram0.text 123267 123267 0 0.0
k32w light k32w0+release (read/write) 643772 643772 0 0.0
.bss 69712 69712 0 0.0
.data 2044 2044 0 0.0
.text 569288 569288 0 0.0
lock k32w0+release (read/write) 701204 701204 0 0.0
.bss 70184 70184 0 0.0
.data 2052 2052 0 0.0
.text 626240 626240 0 0.0
linux all-clusters-app debug (read only) 3026897 3026897 0 0.0
(read/write) 155752 155752 0 0.0
.bss 61888 61888 0 0.0
.data 2096 2096 0 0.0
.data.rel.ro 85416 85416 0 0.0
.dynamic 608 608 0 0.0
.got 4568 4568 0 0.0
.init 27 27 0 0.0
.init_array 1152 1152 0 0.0
.rodata 273419 273419 0 0.0
.text 2574546 2574546 0 0.0
all-clusters-minimal-app debug (read only) 2867169 2867169 0 0.0
(read/write) 147488 147488 0 0.0
.bss 61152 61152 0 0.0
.data 2064 2064 0 0.0
.data.rel.ro 78008 78008 0 0.0
.dynamic 608 608 0 0.0
.got 4488 4488 0 0.0
.init 27 27 0 0.0
.init_array 1144 1144 0 0.0
.rodata 273547 273547 0 0.0
.text 2417394 2417394 0 0.0
bridge-app debug+rpc (read only) 2366345 2366345 0 0.0
(read/write) 127416 127416 0 0.0
.bss 50592 50592 0 0.0
.data 3600 3600 0 0.0
.data.rel.ro 67368 67368 0 0.0
.dynamic 608 608 0 0.0
.got 4392 4392 0 0.0
.init 27 27 0 0.0
.init_array 816 816 0 0.0
.rodata 202504 202504 0 0.0
.text 2001362 2001362 0 0.0
chip-tool debug (read only) 10600785 10600785 0 0.0
(read/write) 647520 647520 0 0.0
.bss 24856 24856 0 0.0
.data 3266 3266 0 0.0
.data.rel.ro 612856 612856 0 0.0
.dynamic 608 608 0 0.0
.got 5104 5104 0 0.0
.init 27 27 0 0.0
.init_array 768 768 0 0.0
.rodata 543861 543861 0 0.0
.text 8558068 8558068 0 0.0
chip-tool-ipv6only arm64 (read only) 10009948 10009948 0 0.0
(read/write) 695217 695217 0 0.0
.bss 32897 32897 0 0.0
.data 3272 3272 0 0.0
.data.rel.ro 640416 640416 0 0.0
.dynamic 560 560 0 0.0
.got 13664 13664 0 0.0
.init 24 24 0 0.0
.init_array 192 192 0 0.0
.rodata 474396 474396 0 0.0
.text 7905684 7905684 0 0.0
lighting-app debug+rpc (read only) 2589785 2589785 0 0.0
(read/write) 130008 130008 0 0.0
.bss 49728 49728 0 0.0
.data 2096 2096 0 0.0
.data.rel.ro 72248 72248 0 0.0
.dynamic 608 608 0 0.0
.got 4392 4392 0 0.0
.init 27 27 0 0.0
.init_array 912 912 0 0.0
.rodata 219184 219184 0 0.0
.text 2200034 2200034 0 0.0
lock-app debug (read only) 2574225 2574225 0 0.0
(read/write) 125376 125376 0 0.0
.bss 48256 48256 0 0.0
.data 1712 1712 0 0.0
.data.rel.ro 69416 69416 0 0.0
.dynamic 608 608 0 0.0
.got 4464 4464 0 0.0
.init 27 27 0 0.0
.init_array 888 888 0 0.0
.rodata 236272 236272 0 0.0
.text 2171442 2171442 0 0.0
ota-provider-app debug (read only) 2351537 2351537 0 0.0
(read/write) 118848 118848 0 0.0
.bss 47808 47808 0 0.0
.data 1936 1936 0 0.0
.data.rel.ro 63224 63224 0 0.0
.dynamic 608 608 0 0.0
.got 4488 4488 0 0.0
.init 27 27 0 0.0
.init_array 760 760 0 0.0
.rodata 208344 208344 0 0.0
.text 1979842 1979842 0 0.0
ota-requestor-app debug (read only) 2516361 2516361 0 0.0
(read/write) 127152 127152 0 0.0
.bss 50272 50272 0 0.0
.data 2304 2304 0 0.0
.data.rel.ro 68632 68632 0 0.0
.dynamic 608 608 0 0.0
.got 4480 4480 0 0.0
.init 27 27 0 0.0
.init_array 840 840 0 0.0
.rodata 214944 214944 0 0.0
.text 2128994 2128994 0 0.0
shell debug (read only) 2595281 2595281 0 0.0
(read/write) 141904 141904 0 0.0
.bss 57800 57800 0 0.0
.data 1264 1264 0 0.0
.data.rel.ro 77024 77024 0 0.0
.dynamic 608 608 0 0.0
.got 4136 4136 0 0.0
.init 27 27 0 0.0
.init_array 1024 1024 0 0.0
.rodata 233554 233554 0 0.0
.text 2203522 2203522 0 0.0
thermostat-no-ble arm64 (read only) 2351468 2351468 0 0.0
(read/write) 141681 141681 0 0.0
.bss 55313 55313 0 0.0
.data 1672 1672 0 0.0
.data.rel.ro 75880 75880 0 0.0
.dynamic 560 560 0 0.0
.got 5040 5040 0 0.0
.init 24 24 0 0.0
.init_array 408 408 0 0.0
.rodata 139716 139716 0 0.0
.text 1974224 1974224 0 0.0
tv-app debug (read only) 3169617 3169617 0 0.0
(read/write) 257864 257864 0 0.0
.bss 167480 167480 0 0.0
.data 4736 4736 0 0.0
.data.rel.ro 79096 79096 0 0.0
.dynamic 608 608 0 0.0
.got 4864 4864 0 0.0
.init 27 27 0 0.0
.init_array 1064 1064 0 0.0
.rodata 258152 258152 0 0.0
.text 2721698 2721698 0 0.0
tv-casting-app debug (read only) 5410321 5410321 0 0.0
(read/write) 158984 158984 0 0.0
.bss 51448 51448 0 0.0
.data 2432 2432 0 0.0
.data.rel.ro 98672 98672 0 0.0
.dynamic 608 608 0 0.0
.got 4784 4784 0 0.0
.init 27 27 0 0.0
.init_array 1032 1032 0 0.0
.rodata 341425 341425 0 0.0
.text 4800594 4800594 0 0.0
mbed lock-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2452848 2452848 0 0.0
.bss 214556 214556 0 0.0
.data 5872 5872 0 0.0
.text 1415492 1415492 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 (read/write) 1178087 1178087 0 0.0
bss 143222 143222 0 0.0
rodata 142776 142776 0 0.0
text 813240 813240 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 (read/write) 1158111 1158111 0 0.0
bss 142460 142460 0 0.0
rodata 134472 134472 0 0.0
text 802360 802360 0 0.0
p6 all-clusters-app default (read only) 881520 881520 0 0.0
(read/write) 1694084 1694084 0 0.0
.bss 149168 149168 0 0.0
.data 2656 2656 0 0.0
.text 1533872 1533872 0 0.0
all-clusters-minimal-app default (read only) 882240 882240 0 0.0
(read/write) 1638268 1638268 0 0.0
.bss 148448 148448 0 0.0
.data 2656 2656 0 0.0
.text 1478776 1478776 0 0.0
light-app default (read only) 890560 890560 0 0.0
(read/write) 1556956 1556956 0 0.0
.bss 140336 140336 0 0.0
.data 2448 2448 0 0.0
.text 1405784 1405784 0 0.0
lock-app default (read only) 886064 886064 0 0.0
(read/write) 1594268 1594268 0 0.0
.bss 144816 144816 0 0.0
.data 2464 2464 0 0.0
.text 1438600 1438600 0 0.0
telink light-switch-app tlsr9518adk80d (read/write) 806288 806288 0 0.0
bss 70976 70976 0 0.0
noinit 43488 43488 0 0.0
text 569992 569990 -2 -0.0
lighting-app tlsr9518adk80d (read/write) 828096 828088 -8 -0.0
bss 71820 71820 0 0.0
noinit 43488 43488 0 0.0
text 587968 587964 -4 -0.0

@woody-apple woody-apple merged commit a985e18 into project-chip:master Aug 10, 2022
isiu-apple pushed a commit to isiu-apple/connectedhomeip that referenced this pull request Sep 16, 2022
* Implement TC-SC-3.6 as a Python test

- Test TC-SC-3.6 was not feasible with chip-tool and manual
  intervention due to the complexity of validating that the
  correct sessions were established, establishing all of them,
  and ensuring all subscriptions fire as intended.

This PR:
- Adds a version of TC-SC-3.6 in Python
- Updates the Python code with minor improvements needed during
  the development of the test
- **Touches no C++ SDK code**

Testing done:

- Ran the test as it could be done by an end-user, passed on Linux
  and on ESP32 (after some changes to resources in the examples, not
  included in this PR)

To run:

- Build all-clusters app Linux:
  - `scripts/examples/gn_build_example.sh examples/all-clusters-app/linux out/debug/standalone chip_config_network_layer_ble=false`
  - In a shell, run: `clear && rm -f kvs1 && out/debug/standalone/chip-all-clusters-app --discriminator 2118 --KVS kvs1`
- Build the Python environment, activate it, then run the test
  - `./scripts/build_python.sh -m platform -i separate`
  - `. ./out/python_env/bin/activate`
  - Run the test: `rm -f admin_storage.json && python src/python_testing/TC_SC_3_6.py -m on-network -d 2118 -p 20202021`

* Apply review comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants