Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TC-ACE-2.3: Add (test for command access and presence) #36808

Draft
wants to merge 15 commits into
base: master
Choose a base branch
from
Draft

TC-ACE-2.3: Add (test for command access and presence) #36808

wants to merge 15 commits into from

Conversation

cecille
Copy link
Contributor

@cecille cecille commented Dec 11, 2024

Please see #36716 for why the OTA requestor command is skipped in CI. The goal of this PR is not to fix the OTA requestor issue, but to catch it in cert.

https://github.com/CHIP-Specifications/chip-test-plans/pull/4798 for test plan

@semanticdiff-com SemanticDiff.com
Copy link

semanticdiff-com bot commented Dec 11, 2024 •
edited
Loading

Review changes with  SemanticDiff

Changed Files
File Status
  src/python_testing/matter_testing_infrastructure/chip/testing/spec_parsing.py  47% smaller
  src/python_testing/TC_AccessChecker.py  9% smaller
  src/python_testing/TestSpecParsingSupport.py  3% smaller
  examples/air-purifier-app/air-purifier-common/air-purifier-app.matter Unsupported file format
  examples/air-quality-sensor-app/air-quality-sensor-common/air-quality-sensor-app.matter Unsupported file format
  examples/all-clusters-app/all-clusters-common/all-clusters-app.matter Unsupported file format
  examples/all-clusters-minimal-app/all-clusters-common/all-clusters-minimal-app.matter Unsupported file format
  examples/bridge-app/bridge-common/bridge-app.matter Unsupported file format
  examples/chef/devices/noip_rootnode_dimmablelight_bCwGYSDpoe.matter Unsupported file format
  examples/chef/devices/rootnode_airpurifier_73a6fe2651.matter Unsupported file format
  examples/chef/devices/rootnode_airpurifier_airqualitysensor_temperaturesensor_humiditysensor_thermostat_56de3d5f45.matter Unsupported file format
  examples/chef/devices/rootnode_airqualitysensor_e63187f6c9.matter Unsupported file format
  examples/chef/devices/rootnode_basicvideoplayer_0ff86e943b.matter Unsupported file format
  examples/chef/devices/rootnode_colortemperaturelight_hbUnzYVeyn.matter Unsupported file format
  examples/chef/devices/rootnode_contactsensor_27f76aeaf5.matter Unsupported file format
  examples/chef/devices/rootnode_contactsensor_lFAGG1bfRO.matter Unsupported file format
  examples/chef/devices/rootnode_contactsensor_lightsensor_occupancysensor_temperaturesensor_pressuresensor_flowsensor_humiditysensor_airqualitysensor_powersource_367e7cea91.matter Unsupported file format
  examples/chef/devices/rootnode_dimmablelight_bCwGYSDpoe.matter Unsupported file format
  examples/chef/devices/rootnode_dimmablepluginunit_f8a9a0b9d4.matter Unsupported file format
  examples/chef/devices/rootnode_dishwasher_cc105034fe.matter Unsupported file format
  examples/chef/devices/rootnode_doorlock_aNKYAreMXE.matter Unsupported file format
  examples/chef/devices/rootnode_extendedcolorlight_8lcaaYJVAa.matter Unsupported file format
  examples/chef/devices/rootnode_fan_7N2TobIlOX.matter Unsupported file format
  examples/chef/devices/rootnode_flowsensor_1zVxHedlaV.matter Unsupported file format
  examples/chef/devices/rootnode_genericswitch_2dfff6e516.matter Unsupported file format
  examples/chef/devices/rootnode_genericswitch_9866e35d0b.matter Unsupported file format
  examples/chef/devices/rootnode_heatingcoolingunit_ncdGai1E5a.matter Unsupported file format
  examples/chef/devices/rootnode_humiditysensor_Xyj4gda6Hb.matter Unsupported file format
  examples/chef/devices/rootnode_laundrydryer_01796fe396.matter Unsupported file format
  examples/chef/devices/rootnode_laundrywasher_fb10d238c8.matter Unsupported file format
  examples/chef/devices/rootnode_lightsensor_lZQycTFcJK.matter Unsupported file format
  examples/chef/devices/rootnode_occupancysensor_iHyVgifZuo.matter Unsupported file format
  examples/chef/devices/rootnode_onofflight_bbs1b7IaOV.matter Unsupported file format
  examples/chef/devices/rootnode_onofflight_samplemei.matter Unsupported file format
  examples/chef/devices/rootnode_onofflightswitch_FsPlMr090Q.matter Unsupported file format
  examples/chef/devices/rootnode_onoffpluginunit_Wtf8ss5EBY.matter Unsupported file format
  examples/chef/devices/rootnode_pressuresensor_s0qC9wLH4k.matter Unsupported file format
  examples/chef/devices/rootnode_pump_5f904818cc.matter Unsupported file format
  examples/chef/devices/rootnode_pump_a811bb33a0.matter Unsupported file format
  examples/chef/devices/rootnode_refrigerator_temperaturecontrolledcabinet_temperaturecontrolledcabinet_ffdb696680.matter Unsupported file format
  examples/chef/devices/rootnode_roboticvacuumcleaner_1807ff0c49.matter Unsupported file format
  examples/chef/devices/rootnode_roomairconditioner_9cf3607804.matter Unsupported file format
  examples/chef/devices/rootnode_smokecoalarm_686fe0dcb8.matter Unsupported file format
  examples/chef/devices/rootnode_speaker_RpzeXdimqA.matter Unsupported file format
  examples/chef/devices/rootnode_temperaturesensor_Qy1zkNW7c3.matter Unsupported file format
  examples/chef/devices/rootnode_thermostat_bm3fb8dhYi.matter Unsupported file format
  examples/chef/devices/rootnode_waterleakdetector_0b067acfa3.matter Unsupported file format
  examples/chef/devices/rootnode_watervalve_6bb39f1f67.matter Unsupported file format
  examples/chef/devices/rootnode_windowcovering_RLCxaGi9Yx.matter Unsupported file format
  examples/contact-sensor-app/contact-sensor-common/contact-sensor-app.matter Unsupported file format
  examples/contact-sensor-app/nxp/zap-lit/contact-sensor-app.matter Unsupported file format
  examples/contact-sensor-app/nxp/zap-sit/contact-sensor-app.matter Unsupported file format
  examples/dishwasher-app/dishwasher-common/dishwasher-app.matter Unsupported file format
  examples/dishwasher-app/silabs/data_model/dishwasher-thread-app.matter Unsupported file format
  examples/dishwasher-app/silabs/data_model/dishwasher-wifi-app.matter Unsupported file format
  examples/energy-management-app/energy-management-common/energy-management-app.matter Unsupported file format
  examples/fabric-bridge-app/fabric-bridge-common/fabric-bridge-app.matter Unsupported file format
  examples/fabric-sync/bridge/fabric-bridge.matter Unsupported file format
  examples/laundry-washer-app/nxp/zap/laundry-washer-app.matter Unsupported file format
  examples/light-switch-app/light-switch-common/icd-lit-light-switch-app.matter Unsupported file format
  examples/light-switch-app/light-switch-common/light-switch-app.matter Unsupported file format
  examples/light-switch-app/qpg/zap/switch.matter Unsupported file format
  examples/lighting-app-data-mode-no-unique-id/lighting-common/lighting-app.matter Unsupported file format
  examples/lighting-app/bouffalolab/data_model/lighting-app-ethernet.matter Unsupported file format
  examples/lighting-app/bouffalolab/data_model/lighting-app-thread.matter Unsupported file format
  examples/lighting-app/bouffalolab/data_model/lighting-app-wifi.matter Unsupported file format
  examples/lighting-app/lighting-common/lighting-app.matter Unsupported file format
  examples/lighting-app/nxp/zap/lighting-on-off.matter Unsupported file format
  examples/lighting-app/qpg/zap/light.matter Unsupported file format
  examples/lighting-app/silabs/data_model/lighting-thread-app.matter Unsupported file format
  examples/lighting-app/silabs/data_model/lighting-wifi-app.matter Unsupported file format
  examples/lit-icd-app/lit-icd-common/lit-icd-server-app.matter Unsupported file format
  examples/lock-app/lock-common/lock-app.matter Unsupported file format
  examples/lock-app/nxp/zap/lock-app.matter Unsupported file format
  examples/lock-app/qpg/zap/lock.matter Unsupported file format
  examples/lock-app/silabs/data_model/lock-app.matter Unsupported file format
  examples/microwave-oven-app/microwave-oven-common/microwave-oven-app.matter Unsupported file format
  examples/network-manager-app/network-manager-common/network-manager-app.matter Unsupported file format
  examples/ota-provider-app/ota-provider-common/ota-provider-app.matter Unsupported file format
  examples/ota-requestor-app/ota-requestor-common/ota-requestor-app.matter Unsupported file format
  examples/placeholder/linux/apps/app1/config.matter Unsupported file format
  examples/placeholder/linux/apps/app2/config.matter Unsupported file format
  examples/pump-app/pump-common/pump-app.matter Unsupported file format
  examples/pump-app/silabs/data_model/pump-thread-app.matter Unsupported file format
  examples/pump-app/silabs/data_model/pump-wifi-app.matter Unsupported file format
  examples/pump-controller-app/pump-controller-common/pump-controller-app.matter Unsupported file format
  examples/refrigerator-app/refrigerator-common/refrigerator-app.matter Unsupported file format
  examples/refrigerator-app/silabs/data_model/refrigerator-thread-app.matter Unsupported file format
  examples/refrigerator-app/silabs/data_model/refrigerator-wifi-app.matter Unsupported file format
  examples/rvc-app/rvc-common/rvc-app.matter Unsupported file format
  examples/smoke-co-alarm-app/smoke-co-alarm-common/smoke-co-alarm-app.matter Unsupported file format
  examples/temperature-measurement-app/temperature-measurement-common/temperature-measurement.matter Unsupported file format
  examples/thermostat/nxp/zap/thermostat_matter_br.matter Unsupported file format
  examples/thermostat/nxp/zap/thermostat_matter_thread.matter Unsupported file format
  examples/thermostat/nxp/zap/thermostat_matter_wifi.matter Unsupported file format
  examples/thermostat/qpg/zap/thermostaticRadiatorValve.matter Unsupported file format
  examples/thermostat/thermostat-common/thermostat.matter Unsupported file format
  examples/thread-br-app/thread-br-common/thread-br-app.matter Unsupported file format
  examples/tv-app/tv-common/tv-app.matter Unsupported file format
  examples/tv-casting-app/tv-casting-common/tv-casting-app.matter Unsupported file format
  examples/virtual-device-app/virtual-device-common/virtual-device-app.matter Unsupported file format
  examples/water-leak-detector-app/water-leak-detector-common/water-leak-detector-app.matter Unsupported file format
  examples/window-app/common/window-app.matter Unsupported file format
  scripts/tools/zap/tests/outputs/all-clusters-app/app-templates/access.h Unsupported file format
  scripts/tools/zap/tests/outputs/lighting-app/app-templates/access.h Unsupported file format
  src/app/zap-templates/zcl/data-model/chip/general-diagnostics-cluster.xml Unsupported file format
  src/app/zap-templates/zcl/data-model/chip/scene.xml Unsupported file format
  src/controller/data_model/controller-clusters.matter Unsupported file format

@github-actions github-actions bot added tests matter-1.4-te2-script-change Script changes before end of Matter 1.4 TE2 labels Dec 11, 2024
@github-actions GitHub Actions
Copy link

PR #36808: Size comparison from 41a9dea to c84bffa

Full report (3 builds for cc32xx, stm32)
platform target config section 41a9dea c84bffa change % change
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 631050 631050 0 0.0
RAM 205824 205824 0 0.0
lock CC3235SF_LAUNCHXL FLASH 669646 669646 0 0.0
RAM 205968 205968 0 0.0
stm32 light STM32WB5MM-DK FLASH 484720 484720 0 0.0
RAM 144880 144880 0 0.0

@github-actions GitHub Actions
Copy link

github-actions bot commented Dec 13, 2024 •
edited
Loading

PR #36808: Size comparison from 41a9dea to 39ca7ea

Full report (69 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 41a9dea 39ca7ea change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1353340 1353340 0 0.0
RAM 104112 104112 0 0.0
bl702 lighting-app bl702+eth FLASH 651826 651826 0 0.0
RAM 25353 25353 0 0.0
bl702+wifi FLASH 829154 829154 0 0.0
RAM 14093 14093 0 0.0
bl706+mfd+rpc+littlefs FLASH 1057626 1057626 0 0.0
RAM 23933 23933 0 0.0
bl702l lighting-app bl702l+mfd+littlefs FLASH 979000 979000 0 0.0
RAM 16596 16596 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 839760 839760 0 0.0
RAM 123664 123664 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 825308 825308 0 0.0
RAM 125552 125552 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 772096 772096 0 0.0
RAM 114020 114020 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 756284 756300 16 0.0
RAM 114228 114228 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 631050 539605 -91445 -14.5
RAM 205824 205760 -64 -0.0
lock CC3235SF_LAUNCHXL FLASH 669646 573885 -95761 -14.3
RAM 205968 205904 -64 -0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 681505 681513 8 0.0
RAM 78724 78724 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 701349 701357 8 0.0
RAM 81364 81364 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 701349 701357 8 0.0
RAM 81364 81364 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 658293 658301 8 0.0
RAM 73792 73792 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 618065 618073 8 0.0
RAM 71708 71708 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 637693 637701 8 0.0
RAM 74252 74252 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 637693 637701 8 0.0
RAM 74252 74252 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 637465 637473 8 0.0
RAM 74724 74724 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 657173 657181 8 0.0
RAM 77268 77268 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 657173 657181 8 0.0
RAM 77268 77268 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 613925 613933 8 0.0
RAM 68812 68812 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 633777 633785 8 0.0
RAM 71444 71444 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 633777 633785 8 0.0
RAM 71444 71444 0 0.0
efr32 lock-app BRD4187C FLASH 932340 932340 0 0.0
RAM 160192 160192 0 0.0
BRD4338a FLASH 746144 746248 104 0.0
RAM 233320 233320 0 0.0
window-app BRD4187C FLASH 1024784 1024912 128 0.0
RAM 128296 128296 0 0.0
esp32 all-clusters-app c3devkit DRAM 95360 95360 0 0.0
FLASH 1543480 1543078 -402 -0.0
IRAM 82542 82542 0 0.0
m5stack DRAM 116312 116312 0 0.0
FLASH 1550134 1549678 -456 -0.0
IRAM 117039 117039 0 0.0
linux air-purifier-app debug unknown 4720 4720 0 0.0
FLASH 2715063 2715629 566 0.0
RAM 129800 129800 0 0.0
all-clusters-app debug unknown 5560 5560 0 0.0
FLASH 6007064 6007630 566 0.0
RAM 523544 523544 0 0.0
all-clusters-minimal-app debug unknown 5456 5456 0 0.0
FLASH 5344804 5345370 566 0.0
RAM 242600 242600 0 0.0
bridge-app debug unknown 5440 5440 0 0.0
FLASH 4684372 4684938 566 0.0
RAM 218416 218416 0 0.0
chip-tool debug unknown 5992 5992 0 0.0
FLASH 12847832 12849310 1478 0.0
RAM 582474 582506 32 0.0
chip-tool-ipv6only arm64 unknown 21352 21352 0 0.0
FLASH 10982560 10983936 1376 0.0
RAM 633392 633424 32 0.0
fabric-admin debug unknown 5816 5816 0 0.0
FLASH 11255157 11255859 702 0.0
RAM 582850 582850 0 0.0
fabric-bridge-app debug unknown 4696 4696 0 0.0
FLASH 4509948 4510514 566 0.0
RAM 205600 205600 0 0.0
fabric-sync debug unknown 4936 4936 0 0.0
FLASH 5608837 5610629 1792 0.0
RAM 472584 472584 0 0.0
lighting-app debug+rpc+ui unknown 6104 6104 0 0.0
FLASH 5621073 5621633 560 0.0
RAM 228792 228792 0 0.0
lock-app debug unknown 5376 5376 0 0.0
FLASH 4733612 4734178 566 0.0
RAM 204776 204776 0 0.0
ota-provider-app debug unknown 4752 4752 0 0.0
FLASH 4359350 4359916 566 0.0
RAM 198448 198448 0 0.0
ota-requestor-app debug unknown 4688 4688 0 0.0
FLASH 4498342 4498908 566 0.0
RAM 203032 203032 0 0.0
shell debug unknown 4248 4248 0 0.0
FLASH 3030077 3030653 576 0.0
RAM 160424 160424 0 0.0
thermostat-no-ble arm64 unknown 9536 9536 0 0.0
FLASH 4103472 4104176 704 0.0
RAM 243040 243040 0 0.0
tv-app debug unknown 5704 5704 0 0.0
FLASH 5958773 5959461 688 0.0
RAM 596016 596016 0 0.0
tv-casting-app debug unknown 5288 5288 0 0.0
FLASH 11054589 11055165 576 0.0
RAM 692184 692184 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 917616 917624 8 0.0
RAM 143292 143292 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 890104 890104 0 0.0
RAM 141487 141487 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 851760 851772 12 0.0
RAM 142200 142200 0 0.0
nxp contact k32w0+release FLASH 585440 585440 0 0.0
RAM 71080 71080 0 0.0
mcxw71+release FLASH 600048 600048 0 0.0
RAM 63176 63176 0 0.0
light k32w0+release FLASH 612396 612412 16 0.0
RAM 70472 70472 0 0.0
k32w1+release FLASH 686576 686592 16 0.0
RAM 48808 48808 0 0.0
lock mcxw71+release FLASH 762928 762928 0 0.0
RAM 70844 70844 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1646364 1646492 128 0.0
RAM 212104 212104 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1554108 1554236 128 0.0
RAM 208904 208904 0 0.0
light cy8ckit_062s2_43012 FLASH 1469436 1469564 128 0.0
RAM 200880 200880 0 0.0
lock cy8ckit_062s2_43012 FLASH 1467164 1467292 128 0.0
RAM 225240 225240 0 0.0
qpg lighting-app qpg6105+debug FLASH 664008 664024 16 0.0
RAM 105424 105424 0 0.0
lock-app qpg6105+debug FLASH 621796 621812 16 0.0
RAM 99868 99868 0 0.0
stm32 light STM32WB5MM-DK FLASH 484720 484728 8 0.0
RAM 144880 144880 0 0.0
telink bridge-app tlsr9258a FLASH 682920 682916 -4 -0.0
RAM 91208 91208 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 623350 623346 -4 -0.0
RAM 31440 31440 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 772180 772176 -4 -0.0
RAM 49300 49300 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 710774 710770 -4 -0.0
RAM 73504 73504 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 627794 627790 -4 -0.0
RAM 142140 142140 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 813808 813804 -4 -0.0
RAM 99684 99684 0 0.0
tizen all-clusters-app arm unknown 4988 4988 0 0.0
FLASH 1732528 1732944 416 0.0
RAM 90744 90744 0 0.0
chip-tool-ubsan arm unknown 10804 10804 0 0.0
FLASH 17969958 17973406 3448 0.0
RAM 7840924 7842608 1684 0.0

This was referenced Dec 16, 2024
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
app controller examples matter-1.4-te2-script-change Script changes before end of Matter 1.4 TE2 scripts tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@cecille @restyled-commits