Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test added sep2 #22370

Merged
merged 4 commits into from
Sep 4, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 0 additions & 3 deletions src/app/tests/suites/certification/PICS.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -30,9 +30,6 @@ PICS:
- label: "Does the device support manufacturing date"
id: MANF_DATE

- label: "Does the device support part number"
id: PART_NUM

- label: "Does the device support Intermediate CA Certificate"
id: DM_ICACERT

Expand Down
6 changes: 3 additions & 3 deletions src/app/tests/suites/certification/Test_TC_ACT_3_1.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ tests:



./chip-tool actions read endpoint-list 1 1
./chip-tool actions read endpoint-lists 1 1

Verify read command is received on TH(all-clusters-app
)
Expand Down Expand Up @@ -157,7 +157,7 @@ tests:
[1658393025.603258][13481:13486] CHIP:EM: Sending Standalone Ack for MessageCounter:114510707 on exchange 23501i


./chip-tool bridgedactions read action-list 1 1
./chip-tool actions read action-list 1 1

Verify read command is received on TH(all-clusters-minimal-app) Log

Expand All @@ -184,7 +184,7 @@ tests:



./chip-tool bridgedactions read endpoint-list 1 1
./chip-tool actions read endpoint-lists 1 1

Verify read command is received on TH(all-clusters-minimal-app)

Expand Down
87 changes: 47 additions & 40 deletions src/app/tests/suites/certification/Test_TC_ACT_3_2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,22 +31,49 @@ tests:

- label:
"Preparation: TH as server exposes an Actions server cluster on EP 1,
with one action (supporting all possible commands) and corresponding
ActionLists and EndpointLists attributes: ActionList: contains one
list element (ActionListStruct): ActionIO = 0x1001 Name = some
test Type = other EndpointListID = 0xE001 SupportedCommands =
0x0fff // suppports all commands State = Inactive EndpointLists:
contains one list element (EndpointListStruct): EndpointListID =
0xE001 Name = test room Type = room Endpoints =
[3] SetupURL: (empty string)"
with one action (supporting all possible commands) and corresponding
ActionLists and EndpointLists attributes: ActionList: contains one
list element (ActionListStruct): ActionIO = 0x1001 Name = some
test Type = other EndpointListID = 0xE001 SupportedCommands =
0x0fff // suppports all commands State = Inactive EndpointLists:
contains one list element (EndpointListStruct): EndpointListID =
0xE001 Name = test room Type = room Endpoints = [3]
SetupURL: (empty string)"
verification: |
verification step to be updated.
pre-condition :
Please use the below chip-tool commmands as example on how this TC can be performed using chip-tool. The DUT vendor to use commands per the DUT implemetnation

1. First read action-list by following command

./chip-tool actions read action-list 1 1

[1662053538.864044][37149:37154] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0025 Attribute 0x0000_0000 DataVersion: 3676955533
[1662053538.864116][37149:37154] CHIP:TOO: ActionList: 2 entries
[1662053538.864180][37149:37154] CHIP:TOO: [1]: {
[1662053538.864202][37149:37154] CHIP:TOO: ActionID: 4097
[1662053538.864221][37149:37154] CHIP:TOO: Name: Room 1 On
[1662053538.864240][37149:37154] CHIP:TOO: Type: 3
[1662053538.864259][37149:37154] CHIP:TOO: EndpointListID: 57345
[1662053538.864276][37149:37154] CHIP:TOO: SupportedCommands: 1
[1662053538.864295][37149:37154] CHIP:TOO: State: 0
[1662053538.864313][37149:37154] CHIP:TOO: }
[1662053538.864342][37149:37154] CHIP:TOO: [2]: {
[1662053538.864360][37149:37154] CHIP:TOO: ActionID: 4098
[1662053538.864377][37149:37154] CHIP:TOO: Name: Turn On Room 2
[1662053538.864395][37149:37154] CHIP:TOO: Type: 3
[1662053538.864413][37149:37154] CHIP:TOO: EndpointListID: 57346
[1662053538.864431][37149:37154] CHIP:TOO: SupportedCommands: 1
[1662053538.864449][37149:37154] CHIP:TOO: State: 0
[1662053538.864466][37149:37154] CHIP:TOO: }

2. Use the above obtained ActionID to verify the following commands
./chip-tool actions instant-action 4097 1 1
disabled: true

- label: "DUT issues an InstantAction command to TH"
PICS: ACT.C.C00.Tx
verification: |
./chip-tool actions instant-action 0xA001 1 1
./chip-tool actions instant-action 4097 1 1

Verify command is successfully sent on TH(bridge-app)

Expand Down Expand Up @@ -97,79 +124,59 @@ tests:
- label: "DUT issues an StopAction command to TH"
PICS: ACT.C.C04.Tx
verification: |
./chip-tool actions stop-action 0 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an PauseAction command to TH"
PICS: ACT.C.C05.Tx
verification: |
./chip-tool actions pause-action 0 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an ResumeAction command to TH"
PICS: ACT.C.C07.Tx
verification: |
./chip-tool actions resume-action 0 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an EnableAction command to TH"
PICS: ACT.C.C08.Tx
verification: |
./chip-tool actions enable-action 0 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an DisableAction command to TH"
PICS: ACT.C.C0a.Tx
verification: |
./chip-tool actions disable-action 0 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an StartActionWithDuration command to TH"
PICS: ACT.C.C03.Tx
verification: |
./chip-tool actions start-action-with-duration 0x1001 100 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an PauseActionWithDuration command to TH"
PICS: ACT.C.C06.Tx
verification: |
./chip-tool actions pause-action-with-duration 0x1001 200 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an EnableActionWithDuration command to TH"
PICS: ACT.C.C09.Tx
verification: |
./chip-tool actions enable-action-with-duration 0x1001 300 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an DisableActionWithDuration command to TH"
PICS: ACT.C.C0b.Tx
verification: |
./chip-tool actions disable-action-with-duration 0x1001 100 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true

- label: "DUT issues an InstantActionWithTransition command to TH"
PICS: ACT.C.C01.Tx
verification: |
./chip-tool actions instant-action-with-transition 0x1001 400 1 1

Note: Message log similar as in step 1
Out of scope for V1.0, The reference app doesn"t have implementation for this command
disabled: true
71 changes: 71 additions & 0 deletions src/app/tests/suites/certification/Test_TC_BIND_2_2.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,48 @@ tests:
Endpoint 0."
PICS: GRPKEY.C.C00.Tx
verification: |
Run this cmmd for [ nRF52840-DK ]Thread device in chip-tool:


./chip-tool groupkeymanagement key-set-write "{"groupKeySetID": 42,
"groupKeySecurityPolicy": 0, "epochKey0":
"d0d1d2d3d4d5d6d7d8d9dadbdcdddedf", "epochStartTime0": 2220000,"epochKey1":
"d1d1d2d3d4d5d6d7d8d9dadbdcdddedf", "epochStartTime1": 2220001,"epochKey2":
"d2d1d2d3d4d5d6d7d8d9dadbdcdddedf", "epochStartTime2": 2220002 }" 74 0

On TH1(Chip-tool), Verify the success response for KeySetWrite

[1657719041.075123][4541:4546] CHIP:DMG: ICR moving to [ResponseRe]
[1657719041.075174][4541:4546] CHIP:DMG: InvokeResponseMessage =
[1657719041.075200][4541:4546] CHIP:DMG: {
[1657719041.075224][4541:4546] CHIP:DMG: suppressResponse = false,
[1657719041.075255][4541:4546] CHIP:DMG: InvokeResponseIBs =
[1657719041.075287][4541:4546] CHIP:DMG: [
[1657719041.075311][4541:4546] CHIP:DMG: InvokeResponseIB =
[1657719041.075347][4541:4546] CHIP:DMG: {
[1657719041.075376][4541:4546] CHIP:DMG: CommandStatusIB =
[1657719041.075408][4541:4546] CHIP:DMG: {
[1657719041.075439][4541:4546] CHIP:DMG: CommandPathIB =
[1657719041.075473][4541:4546] CHIP:DMG: {
[1657719041.075507][4541:4546] CHIP:DMG: EndpointId = 0x0,
[1657719041.075542][4541:4546] CHIP:DMG: ClusterId = 0x3f,
[1657719041.075577][4541:4546] CHIP:DMG: CommandId = 0x0,
[1657719041.075609][4541:4546] CHIP:DMG: },
[1657719041.075646][4541:4546] CHIP:DMG:
[1657719041.075676][4541:4546] CHIP:DMG: StatusIB =
[1657719041.075709][4541:4546] CHIP:DMG: {
[1657719041.075743][4541:4546] CHIP:DMG: status = 0x00 (SUCCESS),
[1657719041.075775][4541:4546] CHIP:DMG: },
[1657719041.075809][4541:4546] CHIP:DMG:
[1657719041.075840][4541:4546] CHIP:DMG: },
[1657719041.075874][4541:4546] CHIP:DMG:
[1657719041.075902][4541:4546] CHIP:DMG: },
[1657719041.075935][4541:4546] CHIP:DMG:
[1657719041.075959][4541:4546] CHIP:DMG: ],
[1657719041.075988][4541:4546] CHIP:DMG:
[1657719041.076012][4541:4546] CHIP:DMG: InteractionModelRevision = 1


Run this cmmd for lighting app in chip-tool:

./chip-tool groupkeymanagement key-set-write "{"groupKeySetID": 42,
Expand Down Expand Up @@ -138,6 +180,19 @@ tests:
list on GroupKeyManagement cluster to TH2 on Endpoint 0"
PICS: GRPKEY.C.A0000
verification: |
Run this cmmd for [ nRF52840-DK ]Thread device in chip-tool:

./chip-tool groupkeymanagement write group-key-map "[{"groupId": 1, "groupKeySetID": 42, "fabricIndex": 1}]" 74 0

On TH1(Chip-tool), Verify the success response for GroupKeySetID

[1657719130.464175][4557:4562] CHIP:DMG: StatusIB =
[1657719130.464214][4557:4562] CHIP:DMG: {
[1657719130.464256][4557:4562] CHIP:DMG: status = 0x00 (SUCCESS),
[1657719130.464298][4557:4562] CHIP:DMG: },
[1657719130.464342][4557:4562] CHIP:DMG:


Run this cmmd for lighting app in chip-tool:

./chip-tool groupkeymanagement write group-key-map "[{"groupId": 1, "groupKeySetID": 42, "fabricIndex": 1}]" 2 0
Expand All @@ -155,6 +210,19 @@ tests:
Endpoint 1."
PICS: G.C.C00.Tx
verification: |
Run this cmmd for [ nRF52840-DK ]Thread device in chip-tool:

./chip-tool groups add-group 0x0001 grp1 74 1

On TH1(Chip-tool), Verify the success response for AddGroup

[1657719097.788236][4548:4554] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0004 Command 0x0000_0000
[1657719097.788325][4548:4554] CHIP:TOO: AddGroupResponse: {
[1657719097.788366][4548:4554] CHIP:TOO: status: 0
[1657719097.788393][4548:4554] CHIP:TOO: groupId: 1
[1657719097.788418][4548:4554] CHIP:TOO: }


Run this cmmd for lighting app in chip-tool:

./chip-tool groups add-group 0x0001 grp1 2 1
Expand All @@ -168,6 +236,9 @@ tests:
[1657717342.600054][3368:3373] CHIP:TOO: }
[1657717342.600130][3368:3373] CHIP:DMG: ICR moving


Run this commands for both Ligh-switch-app and Lighting-app:

./chip-tool groupsettings add-group grp1 0x0001

./chip-tool groupsettings add-keysets 0x0042 0 0x000000000021dfe0 hex:d0d1d2d3d4d5d6d7d8d9dadbdcdddedf
Expand Down
2 changes: 2 additions & 0 deletions src/app/tests/suites/certification/Test_TC_BIND_2_3.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -202,6 +202,8 @@ tests:
[1657719097.788418][4548:4554] CHIP:TOO: }


Run this commands for both Ligh-switch-app and Lighting-app:

./chip-tool groupsettings add-group grp1 0x0001

./chip-tool groupsettings add-keysets 0x0042 0 0x000000000021dfe0 hex:d0d1d2d3d4d5d6d7d8d9dadbdcdddedf
Expand Down
6 changes: 3 additions & 3 deletions src/app/tests/suites/certification/Test_TC_BINFO_2_1.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ tests:
- name: "nodeId"
value: nodeId

#not supported in YAML
#Saving the CountryCode during commissioning not supported in YAML
- label:
"During Commissioning, TH Saves the CountryCode Information from
SetRegulatoryConfig command"
Expand Down Expand Up @@ -441,7 +441,7 @@ tests:
value: ManufacturingDateValue

- label: "TH reads PartNumber from the DUT"
PICS: BINFO.S.A000c && PART_NUM
PICS: BINFO.S.A000c
command: "readAttribute"
attribute: "PartNumber"
response:
Expand All @@ -460,7 +460,7 @@ tests:
error: UNSUPPORTED_WRITE

- label: "TH reads PartNumber from the DUT"
PICS: BINFO.S.A000c && PART_NUM
PICS: BINFO.S.A000c
command: "readAttribute"
attribute: "PartNumber"
response:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -122,7 +122,7 @@ tests:

Verify CommissionedFabrics=SupportedFabrics-1 on TH_CR1(chip-tool) log

./chip-tool operationalcredentials read commissioned-fabrics 1 0
./chip-tool operationalcredentials read commissioned-fabrics 2 0 --commissioner-name beta

[1660907933.677983][33780:33785] CHIP:TOO: CommissionedFabrics: 15
disabled: true
4 changes: 2 additions & 2 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_20.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -140,9 +140,9 @@ tests:
CHIP:TOO: }
CHIP:DMG: ICR moving to [AwaitingDe]

Verify CommissionedFabrics=SupportedFabrics-1 on TH_CR1(chip-tool) log
Verify CommissionedFabrics=SupportedFabrics-1 on TH_CR2(chip-tool) log

./chip-tool operationalcredentials read commissioned-fabrics 1 0
./chip-tool operationalcredentials read commissioned-fabrics 2 0 --commissioner-name beta

[1660907933.677983][33780:33785] CHIP:TOO: CommissionedFabrics: 15
disabled: true
Loading