Skip to content

Commit

Permalink
Modified scripts Aug 30 (project-chip#22284)
Browse files Browse the repository at this point in the history
* Modified automation script:
TC-CC-*
TC-CHANNEL-1.6
TC-DGGEN-1.1
TC-DGTHREAD-1.1
TC-DRLK-1.1
TC-DRLK-2.4
TC-DRLK-2.9
TC-PRS-1.1
TC-PS-1.1
TC-TSTAT-1.1
TC-SWTCH-1.1
TC-WNCV-1.1
TC-WNCV-2.1
TC-WNCV-2.1
TC-WNCV-3.*
Modified Manual tests
TC-IDM-*
TC-ACl-2.5
TC-ACT-2.1
TC-OO-3.1

* Added auto generated files

* Restyled by whitespace

* Modified CC and WNCV script
Added Manual scripts

* Added auto generated files

* Restyled by whitespace

* Modified CC-4.4 and CC-5.3 script

* Added auto generated files

* Modified Zap_template.yaml increased timeout by 5s

* Modified Zap_template.yaml timeout increased by 10s

Co-authored-by: Restyled.io <[email protected]>
  • Loading branch information
2 people authored and isiu-apple committed Sep 16, 2022
1 parent 2342167 commit 3a0ba5b
Show file tree
Hide file tree
Showing 75 changed files with 6,301 additions and 3,482 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/zap_templates.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ jobs:
npm rebuild canvas --update-binary
npm run build-spa
- name: Generate all
timeout-minutes: 30
timeout-minutes: 45
run: scripts/tools/zap_regen_all.py
- name: Check for uncommited changes
run: |
Expand Down
17 changes: 14 additions & 3 deletions src/app/tests/suites/certification/PICS.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1673,6 +1673,12 @@ PICS:
- label: "Does the DUT support Vendor specific OTA implementation?"
id: MCORE.OTA.VendorSpecific

- label:
"Does the Requestor DUT support querying a different Provider in its
OTA Provider List when it hits error conditions in invoking the
QueryImage command?"
id: MCORE.OTA.Retry

- label:
"Does the DUT have Administer privilege over the Access Control of
another node?"
Expand Down Expand Up @@ -1813,13 +1819,13 @@ PICS:
id: LUNIT.S.Afffd

- label: "Does the DUT (Server) support Fahrenheit TemperatureUnit?"
id: LUNIT.S.A0000.Fahrenheit
id: LUNIT.TempUnit.Fahrenheit

- label: "Does the DUT (Server) support Celsius TemperatureUnit?"
id: LUNIT.S.A0000.Celsius
id: LUNIT.TempUnit.Celsius

- label: "Does the DUT (Server) support Kelvin TemperatureUnit?"
id: LUNIT.S.A0000.Kelvin
id: LUNIT.TempUnit.Kelvin

- label: "Does the DUT (Client) support TemperatureUnit attribute?"
id: LUNIT.C.A0000
Expand Down Expand Up @@ -1998,6 +2004,11 @@ PICS:
feature?"
id: MEDIAINPUT.S.NU

- label:
"Does the DUT support the Audio Ouput server cluster, Name Updates
feature?"
id: AUDIOOUTPUT.S.NU

- label:
"Does the DUT support the Channel server cluster Channel List feature?"
id: CHANNEL.S.CL
Expand Down
10 changes: 5 additions & 5 deletions src/app/tests/suites/certification/Test_TC_ACL_2_5.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ tests:
"TH1 writes DUT Endpoint 0 AccessControl cluster Extension attribute,
value is list of AccessControlExtensionStruct containing 1 element
1.struct Data field: D_OK_EMPTY : 1718"
PICS: ACL.S.E01
PICS: ACL.S.A0001
verification: |
./chip-tool accesscontrol write extension "[{"data":"1718"}]" 1 0
On TH1(Chiptool), Verify AccessControl cluster Extension attribute, value is list of AccessControlExtensionStruct containing 1 element
Expand Down Expand Up @@ -168,7 +168,7 @@ tests:
value is list of AccessControlExtensionStruct containing 1 element
1.struct Data field: D_OK_SINGLE
17D00000F1FF01003D48656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E74206C6976696E6720617320612063686172737472696E670018"
PICS: ACL.S.E01
PICS: ACL.S.A0001
verification: |
./chip-tool accesscontrol write extension "[{"data":"17D00000F1FF01003D48656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E74206C6976696E6720617320612063686172737472696E670018"}]" 1 0
On TH1(Chiptool) , Verify Successfully extension attribute list containing one element
Expand Down Expand Up @@ -249,7 +249,7 @@ tests:
value is list of AccessControlExtensionStruct containing 1 element
1.struct Data field: D_BAD_LENGTH
17D00000F1FF01003D48656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E74206C6976696E6720617320612063686172737472696E6700D00000F1FF02003248656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E7420616761696E2E2E2E2E2E2E0018"
PICS: ACL.S.E01
PICS: ACL.S.A0001
verification: |
./chip-tool accesscontrol write extension "[{"data":"17D00000F1FF01003D48656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E74206C6976696E6720617320612063686172737472696E6700D00000F1FF02003248656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E7420616761696E2E2E2E2E2E2E0018"}]" 1 0
Expand Down Expand Up @@ -303,7 +303,7 @@ tests:
value is list of AccessControlExtensionStruct containing 2 elements 1.
struct Data field: D_OK_EMPTY :1718 2.struct Data field: D_OK_SINGLE
:17D00000F1FF01003D48656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E74206C6976696E6720617320612063686172737472696E670018"
PICS: ACL.S.E01
PICS: ACL.S.A0001
verification: |
./chip-tool accesscontrol write extension "[{"data":"1718"},{"data":"17D00000F1FF01003D48656C6C6F20576F726C642E205468697320697320612073696E676C6520656C656D656E74206C6976696E6720617320612063686172737472696E670018"}]" 1 0
Expand Down Expand Up @@ -356,7 +356,7 @@ tests:
- label:
"TH1 writes DUT Endpoint 0 AccessControl cluster Extension attribute,
value is an empty list"
PICS: ACL.S.E01
PICS: ACL.S.A0001
verification: |
./chip-tool accesscontrol write extension "[]" 1 0
On TH1(Chiptool) , Verify AccessControl cluster Extension attribute, value is an empty list
Expand Down
35 changes: 17 additions & 18 deletions src/app/tests/suites/certification/Test_TC_ACT_2_1.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -58,24 +58,23 @@ tests:
verification: |
./chip-tool descriptor read parts-list 1 0
On TH(chip-tool), verify the PartsList value as 13 entries (number may vary by DUT capabilities)
[1658393733.358450][13576:13581] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_001D Attribute 0x0000_0003 DataVersion: 3528858866
[1658393733.358548][13576:13581] CHIP:TOO: parts list: 13 entries
[1658393733.358579][13576:13581] CHIP:TOO: [1]: 1
[1658393733.358615][13576:13581] CHIP:TOO: [2]: 2
[1658393733.358640][13576:13581] CHIP:TOO: [3]: 3
[1658393733.358665][13576:13581] CHIP:TOO: [4]: 4
[1658393733.358699][13576:13581] CHIP:TOO: [5]: 5
[1658393733.358724][13576:13581] CHIP:TOO: [6]: 6
[1658393733.358756][13576:13581] CHIP:TOO: [7]: 7
[1658393733.358781][13576:13581] CHIP:TOO: [8]: 8
[1658393733.358804][13576:13581] CHIP:TOO: [9]: 9
[1658393733.358838][13576:13581] CHIP:TOO: [10]: 10
[1658393733.358863][13576:13581] CHIP:TOO: [11]: 11
[1658393733.358895][13576:13581] CHIP:TOO: [12]: 12
[1658393733.358921][13576:13581] CHIP:TOO: [13]: 13
[1658393733.359051][13576:13581] CHIP:EM: Sending Standalone Ack for MessageCounter:3177509 on exchange 11364i
On TH(chip-tool), verify the PartsList value as 12 entries (number may vary by DUT capabilities)
[1661775581.434024][11909:11914] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_001D Attribute 0x0000_0003 DataVersion: 2309949467
[1661775581.434098][11909:11914] CHIP:TOO: parts list: 12 entries
[1661775581.434129][11909:11914] CHIP:TOO: [1]: 1
[1661775581.434155][11909:11914] CHIP:TOO: [2]: 3
[1661775581.434180][11909:11914] CHIP:TOO: [3]: 4
[1661775581.434205][11909:11914] CHIP:TOO: [4]: 5
[1661775581.434230][11909:11914] CHIP:TOO: [5]: 6
[1661775581.434255][11909:11914] CHIP:TOO: [6]: 7
[1661775581.434280][11909:11914] CHIP:TOO: [7]: 8
[1661775581.434304][11909:11914] CHIP:TOO: [8]: 9
[1661775581.434383][11909:11914] CHIP:TOO: [9]: 10
[1661775581.434408][11909:11914] CHIP:TOO: [10]: 11
[1661775581.434434][11909:11914] CHIP:TOO: [11]: 12
[1661775581.434459][11909:11914] CHIP:TOO: [12]: 13
[1661775581.434597][11909:11914] CHIP:EM: Sending Standalone Ack for MessageCounter:142298497 on exchange 3054i
disabled: true

- label: "Read EndpointLists attribute of Actions server"
Expand Down
4 changes: 2 additions & 2 deletions src/app/tests/suites/certification/Test_TC_ACT_3_1.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ tests:
verification: |
./chip-tool actions read action-list 1 1
Verify read command is received on TH(all-clusters-app)
Verify read command is received on TH(bridge-app)
[1658848323.188336][28392:28392] CHIP:IM: Received Read request
[1658848323.188433][28392:28392] CHIP:DMG: ReadRequestMessage =
Expand Down Expand Up @@ -98,7 +98,7 @@ tests:
./chip-tool actions read setup-url 1 1
Verify read command is received on TH(all-clusters-app)
Verify read command is received on TH(bridge-app)
[1658848453.728775][28392:28392] CHIP:IM: Received Read request
[1658848453.728895][28392:28392] CHIP:DMG: ReadRequestMessage =
Expand Down
6 changes: 3 additions & 3 deletions src/app/tests/suites/certification/Test_TC_ACT_3_2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -46,9 +46,9 @@ tests:
- label: "DUT issues an InstantAction command to TH"
PICS: ACT.C.C00.Tx
verification: |
./chip-tool actions instant-action 0x1001 1 1
./chip-tool actions instant-action 0xA001 1 1
Verify command is successfully sent on TH(all-clusters-app)
Verify command is successfully sent on TH(bridge-app)
[1658848801.832452][10096:10101] CHIP:EM: Removed CHIP MessageCounter:163269462 from RetransTable on exchange 54295i
[1658848801.832487][10096:10101] CHIP:DMG: ICR moving to [ResponseRe]
Expand Down Expand Up @@ -161,7 +161,7 @@ tests:
- label: "DUT issues an DisableActionWithDuration command to TH"
PICS: ACT.C.C0b.Tx
verification: |
./chip-tool actions disable-action-with-duration 0 100 1 1
./chip-tool actions disable-action-with-duration 0x1001 100 1 1
Note: Message log similar as in step 1
disabled: true
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ tests:
contains: [0]

- label: "Read the global attribute: GeneratedCommandList"
PICS: MEDIAINPUT.S.NU
PICS: AUDIOOUTPUT.S.NU
command: "readAttribute"
attribute: "GeneratedCommandList"
response:
Expand All @@ -76,7 +76,7 @@ tests:
type: list

- label: "Read the global attribute: GeneratedCommandList"
PICS: " !MEDIAINPUT.S.NU "
PICS: " !AUDIOOUTPUT.S.NU "
command: "readAttribute"
attribute: "GeneratedCommandList"
response:
Expand Down
3 changes: 1 addition & 2 deletions src/app/tests/suites/certification/Test_TC_BINFO_2_2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -71,10 +71,9 @@ tests:
1. Launch chip-tool into interactive mode with the command
./chip-tool interactive start
basic subscribe-event shut-down 20 100 1 0
2. run below command in interactive mode shell and Turn down the DUT
basic subscribe-event shut-down 20 100 1 0
verify that ShutDown event as priority set has CRITICAL on TH(Chip-tool)
Expand Down
32 changes: 16 additions & 16 deletions src/app/tests/suites/certification/Test_TC_BRBINFO_2_3.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read vendor-name 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659966264.659547][3334:3334] CHIP:DMG: ReadRequestMessage =
Expand Down Expand Up @@ -68,7 +68,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read vendor-id 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659966317.983464][3334:3334] CHIP:DMG: ReadRequestMessage =
Expand Down Expand Up @@ -122,7 +122,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read product-name 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659966351.620979][3334:3334] CHIP:IM: Received Read request
Expand Down Expand Up @@ -152,7 +152,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read node-label 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659966481.748125][3334:3334] CHIP:IM: Received Read request
Expand Down Expand Up @@ -185,7 +185,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read location 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659966523.437542][3334:3334] CHIP:IM: Received Read request
Expand Down Expand Up @@ -218,7 +218,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read hardware-version 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659966609.655514][3334:3334] CHIP:IM: Received Read request
Expand Down Expand Up @@ -251,7 +251,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read hardware-version-string 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -285,7 +285,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read software-version 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -319,7 +319,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read software-version-string 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -353,7 +353,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read manufacturing-date 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -387,7 +387,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read part-number 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -421,7 +421,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read product-url 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -455,7 +455,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read product-label 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -489,7 +489,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read serial-number 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
Expand Down Expand Up @@ -523,7 +523,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read reachable 1 3
Verify ReadRequestMessage is displayed on TH(all-clusters-app) Log
Verify ReadRequestMessage is displayed on TH(bridge-app) Log
[1659966974.431316][3334:3334] CHIP:IM: Received Read request
[1659966974.431423][3334:3334] CHIP:DMG: ReadRequestMessage =
[1659966974.431461][3334:3334] CHIP:DMG: {
Expand Down Expand Up @@ -554,7 +554,7 @@ tests:
verification: |
./chip-tool bridgeddevicebasic read unique-id 1 3
Optional Attribute - If it is supported, then in TH(all-clusters-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Optional Attribute - If it is supported, then in TH(bridge-app) log it will results in displaying the ReportDataMessage , else it will display UNSUPPORTED_ATTRIBUTE
Example Log:
[1659967013.796500][3334:3334] CHIP:IM: Received Read request
Expand Down
Loading

0 comments on commit 3a0ba5b

Please sign in to comment.