Skip to content

Commit

Permalink
Test added sep2 (project-chip#22370)
Browse files Browse the repository at this point in the history
* Added Updated Scripts

* Added Auto genearted Files

* Restyled by clang-format

* Restyled by prettier-yaml

Co-authored-by: Restyled.io <[email protected]>
  • Loading branch information
2 people authored and isiu-apple committed Sep 16, 2022
1 parent b8b9215 commit add21bb
Show file tree
Hide file tree
Showing 29 changed files with 348 additions and 300 deletions.
3 changes: 0 additions & 3 deletions src/app/tests/suites/certification/PICS.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -30,9 +30,6 @@ PICS:
- label: "Does the device support manufacturing date"
id: MANF_DATE

- label: "Does the device support part number"
id: PART_NUM

- label: "Does the device support Intermediate CA Certificate"
id: DM_ICACERT

Expand Down
6 changes: 3 additions & 3 deletions src/app/tests/suites/certification/Test_TC_ACT_3_1.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ tests:
./chip-tool actions read endpoint-list 1 1
./chip-tool actions read endpoint-lists 1 1
Verify read command is received on TH(all-clusters-app
)
Expand Down Expand Up @@ -157,7 +157,7 @@ tests:
[1658393025.603258][13481:13486] CHIP:EM: Sending Standalone Ack for MessageCounter:114510707 on exchange 23501i
./chip-tool bridgedactions read action-list 1 1
./chip-tool actions read action-list 1 1
Verify read command is received on TH(all-clusters-minimal-app) Log
Expand All @@ -184,7 +184,7 @@ tests:
./chip-tool bridgedactions read endpoint-list 1 1
./chip-tool actions read endpoint-lists 1 1
Verify read command is received on TH(all-clusters-minimal-app)
Expand Down
87 changes: 47 additions & 40 deletions src/app/tests/suites/certification/Test_TC_ACT_3_2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,22 +31,49 @@ tests:

- label:
"Preparation: TH as server exposes an Actions server cluster on EP 1,
with one action (supporting all possible commands) and corresponding
ActionLists and EndpointLists attributes: ActionList: contains one
list element (ActionListStruct): ActionIO = 0x1001 Name = some
test Type = other EndpointListID = 0xE001 SupportedCommands =
0x0fff // suppports all commands State = Inactive EndpointLists:
contains one list element (EndpointListStruct): EndpointListID =
0xE001 Name = test room Type = room Endpoints =
[3] SetupURL: (empty string)"
with one action (supporting all possible commands) and corresponding
ActionLists and EndpointLists attributes: ActionList: contains one
list element (ActionListStruct): ActionIO = 0x1001 Name = some
test Type = other EndpointListID = 0xE001 SupportedCommands =
0x0fff // suppports all commands State = Inactive EndpointLists:
contains one list element (EndpointListStruct): EndpointListID =
0xE001 Name = test room Type = room Endpoints = [3]
SetupURL: (empty string)"
verification: |
verification step to be updated.
pre-condition :
Please use the below chip-tool commmands as example on how this TC can be performed using chip-tool. The DUT vendor to use commands per the DUT implemetnation
1. First read action-list by following command
./chip-tool actions read action-list 1 1
[1662053538.864044][37149:37154] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0025 Attribute 0x0000_0000 DataVersion: 3676955533
[1662053538.864116][37149:37154] CHIP:TOO: ActionList: 2 entries
[1662053538.864180][37149:37154] CHIP:TOO: [1]: {
[1662053538.864202][37149:37154] CHIP:TOO: ActionID: 4097
[1662053538.864221][37149:37154] CHIP:TOO: Name: Room 1 On
[1662053538.864240][37149:37154] CHIP:TOO: Type: 3
[1662053538.864259][37149:37154] CHIP:TOO: EndpointListID: 57345
[1662053538.864276][37149:37154] CHIP:TOO: SupportedCommands: 1
[1662053538.864295][37149:37154] CHIP:TOO: State: 0
[1662053538.864313][37149:37154] CHIP:TOO: }
[1662053538.864342][37149:37154] CHIP:TOO: [2]: {
[1662053538.864360][37149:37154] CHIP:TOO: ActionID: 4098
[1662053538.864377][37149:37154] CHIP:TOO: Name: Turn On Room 2
[1662053538.864395][37149:37154] CHIP:TOO: Type: 3
[1662053538.864413][37149:37154] CHIP:TOO: EndpointListID: 57346
[1662053538.864431][37149:37154] CHIP:TOO: SupportedCommands: 1
[1662053538.864449][37149:37154] CHIP:TOO: State: 0
[1662053538.864466][37149:37154] CHIP:TOO: }
2. Use the above obtained ActionID to verify the following commands
./chip-tool actions instant-action 4097 1 1
disabled: true

- label: "DUT issues an InstantAction command to TH"
PICS: ACT.C.C00.Tx
verification: |
./chip-tool actions instant-action 0xA001 1 1
./chip-tool actions instant-action 4097 1 1
Verify command is successfully sent on TH(bridge-app)
Expand Down Expand Up @@ -97,79 +124,59 @@ tests:
- label: "DUT issues an StopAction command to TH"
PICS: ACT.C.C04.Tx
verification: |
./chip-tool actions stop-action 0 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an PauseAction command to TH"
PICS: ACT.C.C05.Tx
verification: |
./chip-tool actions pause-action 0 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an ResumeAction command to TH"
PICS: ACT.C.C07.Tx
verification: |
./chip-tool actions resume-action 0 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an EnableAction command to TH"
PICS: ACT.C.C08.Tx
verification: |
./chip-tool actions enable-action 0 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an DisableAction command to TH"
PICS: ACT.C.C0a.Tx
verification: |
./chip-tool actions disable-action 0 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an StartActionWithDuration command to TH"
PICS: ACT.C.C03.Tx
verification: |
./chip-tool actions start-action-with-duration 0x1001 100 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an PauseActionWithDuration command to TH"
PICS: ACT.C.C06.Tx
verification: |
./chip-tool actions pause-action-with-duration 0x1001 200 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an EnableActionWithDuration command to TH"
PICS: ACT.C.C09.Tx
verification: |
./chip-tool actions enable-action-with-duration 0x1001 300 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an DisableActionWithDuration command to TH"
PICS: ACT.C.C0b.Tx
verification: |
./chip-tool actions disable-action-with-duration 0x1001 100 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an InstantActionWithTransition command to TH"
PICS: ACT.C.C01.Tx
verification: |
./chip-tool actions instant-action-with-transition 0x1001 400 1 1
Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true
71 changes: 71 additions & 0 deletions src/app/tests/suites/certification/Test_TC_BIND_2_2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,48 @@ tests:
Endpoint 0."
PICS: GRPKEY.C.C00.Tx
verification: |
Run this cmmd for [ nRF52840-DK ]Thread device in chip-tool:
./chip-tool groupkeymanagement key-set-write "{"groupKeySetID": 42,
"groupKeySecurityPolicy": 0, "epochKey0":
"d0d1d2d3d4d5d6d7d8d9dadbdcdddedf", "epochStartTime0": 2220000,"epochKey1":
"d1d1d2d3d4d5d6d7d8d9dadbdcdddedf", "epochStartTime1": 2220001,"epochKey2":
"d2d1d2d3d4d5d6d7d8d9dadbdcdddedf", "epochStartTime2": 2220002 }" 74 0
On TH1(Chip-tool), Verify the success response for KeySetWrite
[1657719041.075123][4541:4546] CHIP:DMG: ICR moving to [ResponseRe]
[1657719041.075174][4541:4546] CHIP:DMG: InvokeResponseMessage =
[1657719041.075200][4541:4546] CHIP:DMG: {
[1657719041.075224][4541:4546] CHIP:DMG: suppressResponse = false,
[1657719041.075255][4541:4546] CHIP:DMG: InvokeResponseIBs =
[1657719041.075287][4541:4546] CHIP:DMG: [
[1657719041.075311][4541:4546] CHIP:DMG: InvokeResponseIB =
[1657719041.075347][4541:4546] CHIP:DMG: {
[1657719041.075376][4541:4546] CHIP:DMG: CommandStatusIB =
[1657719041.075408][4541:4546] CHIP:DMG: {
[1657719041.075439][4541:4546] CHIP:DMG: CommandPathIB =
[1657719041.075473][4541:4546] CHIP:DMG: {
[1657719041.075507][4541:4546] CHIP:DMG: EndpointId = 0x0,
[1657719041.075542][4541:4546] CHIP:DMG: ClusterId = 0x3f,
[1657719041.075577][4541:4546] CHIP:DMG: CommandId = 0x0,
[1657719041.075609][4541:4546] CHIP:DMG: },
[1657719041.075646][4541:4546] CHIP:DMG:
[1657719041.075676][4541:4546] CHIP:DMG: StatusIB =
[1657719041.075709][4541:4546] CHIP:DMG: {
[1657719041.075743][4541:4546] CHIP:DMG: status = 0x00 (SUCCESS),
[1657719041.075775][4541:4546] CHIP:DMG: },
[1657719041.075809][4541:4546] CHIP:DMG:
[1657719041.075840][4541:4546] CHIP:DMG: },
[1657719041.075874][4541:4546] CHIP:DMG:
[1657719041.075902][4541:4546] CHIP:DMG: },
[1657719041.075935][4541:4546] CHIP:DMG:
[1657719041.075959][4541:4546] CHIP:DMG: ],
[1657719041.075988][4541:4546] CHIP:DMG:
[1657719041.076012][4541:4546] CHIP:DMG: InteractionModelRevision = 1
Run this cmmd for lighting app in chip-tool:
./chip-tool groupkeymanagement key-set-write "{"groupKeySetID": 42,
Expand Down Expand Up @@ -138,6 +180,19 @@ tests:
list on GroupKeyManagement cluster to TH2 on Endpoint 0"
PICS: GRPKEY.C.A0000
verification: |
Run this cmmd for [ nRF52840-DK ]Thread device in chip-tool:
./chip-tool groupkeymanagement write group-key-map "[{"groupId": 1, "groupKeySetID": 42, "fabricIndex": 1}]" 74 0
On TH1(Chip-tool), Verify the success response for GroupKeySetID
[1657719130.464175][4557:4562] CHIP:DMG: StatusIB =
[1657719130.464214][4557:4562] CHIP:DMG: {
[1657719130.464256][4557:4562] CHIP:DMG: status = 0x00 (SUCCESS),
[1657719130.464298][4557:4562] CHIP:DMG: },
[1657719130.464342][4557:4562] CHIP:DMG:
Run this cmmd for lighting app in chip-tool:
./chip-tool groupkeymanagement write group-key-map "[{"groupId": 1, "groupKeySetID": 42, "fabricIndex": 1}]" 2 0
Expand All @@ -155,6 +210,19 @@ tests:
Endpoint 1."
PICS: G.C.C00.Tx
verification: |
Run this cmmd for [ nRF52840-DK ]Thread device in chip-tool:
./chip-tool groups add-group 0x0001 grp1 74 1
On TH1(Chip-tool), Verify the success response for AddGroup
[1657719097.788236][4548:4554] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0004 Command 0x0000_0000
[1657719097.788325][4548:4554] CHIP:TOO: AddGroupResponse: {
[1657719097.788366][4548:4554] CHIP:TOO: status: 0
[1657719097.788393][4548:4554] CHIP:TOO: groupId: 1
[1657719097.788418][4548:4554] CHIP:TOO: }
Run this cmmd for lighting app in chip-tool:
./chip-tool groups add-group 0x0001 grp1 2 1
Expand All @@ -168,6 +236,9 @@ tests:
[1657717342.600054][3368:3373] CHIP:TOO: }
[1657717342.600130][3368:3373] CHIP:DMG: ICR moving
Run this commands for both Ligh-switch-app and Lighting-app:
./chip-tool groupsettings add-group grp1 0x0001
./chip-tool groupsettings add-keysets 0x0042 0 0x000000000021dfe0 hex:d0d1d2d3d4d5d6d7d8d9dadbdcdddedf
Expand Down
2 changes: 2 additions & 0 deletions src/app/tests/suites/certification/Test_TC_BIND_2_3.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -202,6 +202,8 @@ tests:
[1657719097.788418][4548:4554] CHIP:TOO: }
Run this commands for both Ligh-switch-app and Lighting-app:
./chip-tool groupsettings add-group grp1 0x0001
./chip-tool groupsettings add-keysets 0x0042 0 0x000000000021dfe0 hex:d0d1d2d3d4d5d6d7d8d9dadbdcdddedf
Expand Down
6 changes: 3 additions & 3 deletions src/app/tests/suites/certification/Test_TC_BINFO_2_1.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ tests:
- name: "nodeId"
value: nodeId

#not supported in YAML
#Saving the CountryCode during commissioning not supported in YAML
- label:
"During Commissioning, TH Saves the CountryCode Information from
SetRegulatoryConfig command"
Expand Down Expand Up @@ -441,7 +441,7 @@ tests:
value: ManufacturingDateValue

- label: "TH reads PartNumber from the DUT"
PICS: BINFO.S.A000c && PART_NUM
PICS: BINFO.S.A000c
command: "readAttribute"
attribute: "PartNumber"
response:
Expand All @@ -460,7 +460,7 @@ tests:
error: UNSUPPORTED_WRITE

- label: "TH reads PartNumber from the DUT"
PICS: BINFO.S.A000c && PART_NUM
PICS: BINFO.S.A000c
command: "readAttribute"
attribute: "PartNumber"
response:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -122,7 +122,7 @@ tests:
Verify CommissionedFabrics=SupportedFabrics-1 on TH_CR1(chip-tool) log
./chip-tool operationalcredentials read commissioned-fabrics 1 0
./chip-tool operationalcredentials read commissioned-fabrics 2 0 --commissioner-name beta
[1660907933.677983][33780:33785] CHIP:TOO: CommissionedFabrics: 15
disabled: true
4 changes: 2 additions & 2 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_20.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -140,9 +140,9 @@ tests:
CHIP:TOO: }
CHIP:DMG: ICR moving to [AwaitingDe]
Verify CommissionedFabrics=SupportedFabrics-1 on TH_CR1(chip-tool) log
Verify CommissionedFabrics=SupportedFabrics-1 on TH_CR2(chip-tool) log
./chip-tool operationalcredentials read commissioned-fabrics 1 0
./chip-tool operationalcredentials read commissioned-fabrics 2 0 --commissioner-name beta
[1660907933.677983][33780:33785] CHIP:TOO: CommissionedFabrics: 15
disabled: true
Loading

0 comments on commit add21bb

Please sign in to comment.