Skip to content

Commit

Permalink
Modified tests Feb 22 (#25239)
Browse files Browse the repository at this point in the history
* Added discoverOnce argument:
TC-CADMIN-1.9
Added manual test:
TC-IDM-4.4
TC-OPCREDS-3.6

* Auto generated files

* Modified manualTests.json

* Restyled by whitespace

---------

Co-authored-by: Restyled.io <[email protected]>
  • Loading branch information
2 people authored and pull[bot] committed Apr 11, 2023
1 parent e81866b commit 425f3ce
Show file tree
Hide file tree
Showing 5 changed files with 448 additions and 0 deletions.
40 changes: 40 additions & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_9.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -137,6 +137,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -153,6 +155,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -169,6 +173,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -185,6 +191,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -201,6 +209,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -217,6 +227,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -233,6 +245,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -249,6 +263,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -265,6 +281,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -281,6 +299,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -297,6 +317,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -313,6 +335,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -329,6 +353,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -345,6 +371,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -361,6 +389,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -377,6 +407,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -393,6 +425,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -409,6 +443,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -425,6 +461,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -441,6 +479,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand Down
93 changes: 93 additions & 0 deletions src/app/tests/suites/certification/Test_TC_IDM_4_4.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
# Copyright (c) 2021 Project CHIP Authors
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name: 3.4.3.[TC-IDM-4.4] Persistent Subscription Test Cases. [DUT as Server]

PICS:
- MCORE.IDM.S

config:
nodeId: 0x12344321
cluster: "Basic Information"
endpoint: 0

tests:
- label:
"TH sends a subscription request action for an attribute to the DUT.
Activate the subscription between DUT and the TH."
verification: |
The cluster used in the below command is an example, User can use any supported chip cluster/attribute/command.
Please use Interactive mode to Verify subscription test cases
Here the command to enter interactive mode:-- ./chip-tool interactive start
./chip-tool interactive start
onoff subscribe on-time 10 100 1 1 --auto-resubscribe true
Verify on the TH(chip-tool) that the Report data messages are sent from the DUT(Reference app) for subscription request action to the TH(chip-tool) with the correct attribute values.
[1675085714.397242][208829:208831] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0006 Attribute 0x0000_4001 DataVersion: 4283808198
[1675085714.397263][208829:208831] CHIP:TOO: OnTime: 0
[1675085714.397279][208829:208831] CHIP:DMG: MoveToState ReadClient[0x7f474801d330]: Moving to [AwaitingSu]
[1675085714.397311][208829:208831] CHIP:EM: <<< [E:17188i M:22097192 (Ack:128343668)] (S) Msg TX to 1:0000000000000001 [9666] --- Type 0001:01 (IM:StatusResponse)
[1675085714.397323][208829:208831] CHIP:IN: (S) Sending msg 22097192 on secure session with LSID: 50803
[1675085714.397742][208829:208831] CHIP:EM: >>> [E:17188i M:128343669 (Ack:22097192)] (S) Msg RX from 1:0000000000000001 [9666] --- Type 0001:04 (IM:SubscribeResponse)
[1675085714.397753][208829:208831] CHIP:EM: Found matching exchange: 17188i, Delegate: 0x7f474801d340
[1675085714.397764][208829:208831] CHIP:EM: Rxd Ack; Removing MessageCounter:22097192 from Retrans Table on exchange 17188i
[1675085714.397774][208829:208831] CHIP:DMG: SubscribeResponse is received
[1675085714.397787][208829:208831] CHIP:DMG: SubscribeResponseMessage =
[1675085714.397794][208829:208831] CHIP:DMG: {
[1675085714.397802][208829:208831] CHIP:DMG: SubscriptionId = 0xa11efe71,
[1675085714.397810][208829:208831] CHIP:DMG: MaxInterval = 0x64,
[1675085714.397819][208829:208831] CHIP:DMG: InteractionModelRevision = 1
[1675085714.397825][208829:208831] CHIP:DMG: }
[1675085714.397832][208829:208831] CHIP:DMG: Subscription established with SubscriptionID = 0xa11efe71 MinInterval = 10s MaxInterval = 100s Peer = 01:0000000000000001
disabled: true

- label: "Power off the DUT. Power on the DUT immediately."
verification: |
Verify on the TH(chip-tool) that the subscription between the DUT(Reference-app) and TH(chip-tool) is restablished and DUT(Reference-app) is able to send report data messages for the attribute which was subscribed to in step 1 within the MaxInterval time.
[1675085816.147288][208829:208831] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0006 Attribute 0x0000_4001 DataVersion: 1956782965
[1675085816.147302][208829:208831] CHIP:TOO: OnTime: 0
[1675085816.147318][208829:208831] CHIP:DMG: MoveToState ReadClient[0x7f474801d330]: Moving to [AwaitingSu]
[1675085816.147360][208829:208831] CHIP:EM: <<< [E:17190i M:24372277 (Ack:66274424)] (S) Msg TX to 1:0000000000000001 [9666] --- Type 0001:01 (IM:StatusResponse)
[1675085816.147373][208829:208831] CHIP:IN: (S) Sending msg 24372277 on secure session with LSID: 50804
[1675085816.147908][208829:208831] CHIP:EM: >>> [E:17190i M:66274425 (Ack:24372277)] (S) Msg RX from 1:0000000000000001 [9666] --- Type 0001:04 (IM:SubscribeResponse)
[1675085816.147934][208829:208831] CHIP:EM: Found matching exchange: 17190i, Delegate: 0x7f474801d340
[1675085816.147950][208829:208831] CHIP:EM: Rxd Ack; Removing MessageCounter:24372277 from Retrans Table on exchange 17190i
[1675085816.147964][208829:208831] CHIP:DMG: SubscribeResponse is received
[1675085816.147980][208829:208831] CHIP:DMG: SubscribeResponseMessage =
[1675085816.147989][208829:208831] CHIP:DMG: {
[1675085816.147997][208829:208831] CHIP:DMG: SubscriptionId = 0x2b5276ad,
[1675085816.148006][208829:208831] CHIP:DMG: MaxInterval = 0x64,
[1675085816.148013][208829:208831] CHIP:DMG: InteractionModelRevision = 1
[1675085816.148019][208829:208831] CHIP:DMG: }
[1675085816.148029][208829:208831] CHIP:DMG: Subscription established with SubscriptionID = 0x2b5276ad MinInterval = 10s MaxInterval = 100s Peer = 01:0000000000000001
[1675085816.148041][208829:208831] CHIP:DMG: MoveToState ReadClient[0x7f474801d330]: Moving to [Subscripti]
[1675085816.148055][208829:208831] CHIP:DMG: Refresh LivenessCheckTime for 101500 milliseconds with SubscriptionId = 0x2b5276ad Peer = 01:0000000000000001
[1675085816.148084][208829:208831] CHIP:EM: <<< [E:17190i M:24372278 (Ack:66274425)] (S) Msg TX to 1:0000000000000001 [9666] --- Type 0000:10 (SecureChannel:StandaloneAck)
[1675085816.148097][208829:208831] CHIP:IN: (S) Sending msg 24372278 on secure session with LSID: 50804
[1675085816.148141][208829:208831] CHIP:EM: Flushed pending ack for MessageCounter:66274425 on exchange 17190i
[1675085916.246163][208829:208831] CHIP:EM: >>> [E:17698r M:66274426] (S) Msg RX from 1:0000000000000001 [9666] --- Type 0001:05 (IM:ReportData)
[1675085916.246182][208829:208831] CHIP:EM: Handling via exchange: 17698r, Delegate: 0x5572dfe7d328
[1675085916.246207][208829:208831] CHIP:DMG: ReportDataMessage =
[1675085916.246211][208829:208831] CHIP:DMG: {
[1675085916.246216][208829:208831] CHIP:DMG: SubscriptionId = 0x2b5276ad,
[1675085916.246220][208829:208831] CHIP:DMG: InteractionModelRevision = 1
[1675085916.246223][208829:208831] CHIP:DMG: }
[1675085916.246233][208829:208831] CHIP:DMG: Refresh LivenessCheckTime for 101500 milliseconds with SubscriptionId = 0x2b5276ad Peer = 01:0000000000000001
disabled: true
99 changes: 99 additions & 0 deletions src/app/tests/suites/certification/Test_TC_OPCREDS_3_6.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
# Copyright (c) 2021 Project CHIP Authors
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name: 12.3.6. [TC-OPCREDS-3.6] Last Fabric removal validation [DUT-Server]

PICS:
- OPCREDS.S

config:
nodeId: 0x12344321
cluster: "Basic Information"
endpoint: 0

tests:
- label: "TH1 fully commissions the DUT"
verification: |
"DUT side:
sudo ./chip-all-clusters-app --wifi
TH side:
./chip-tool pairing code 1 34970112332 --trace_decode 1
[1650455358.501816][4366:4371] CHIP:TOO: Device commissioning completed with success"
disabled: true

- label:
"TH1 sends RemoveFabric command with Fabric Index as FabricIndex_TH1
to DUT"
PICS: OPCREDS.S.C0a.Rsp
verification: |
./chip-tool operationalcredentials remove-fabric 1 1 0
[1674780232627] [8807:372926] CHIP: [DMG] InvokeResponseMessage =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] suppressResponse = false,
[1674780232627] [8807:372926] CHIP: [DMG] InvokeResponseIBs =
[1674780232627] [8807:372926] CHIP: [DMG] [
[1674780232627] [8807:372926] CHIP: [DMG] InvokeResponseIB =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] CommandDataIB =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] CommandPathIB =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] EndpointId = 0x0,
[1674780232627] [8807:372926] CHIP: [DMG] ClusterId = 0x3e,
[1674780232627] [8807:372926] CHIP: [DMG] CommandId = 0x8,
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] CommandFields =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] 0x0 = 11,
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] ],
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] InteractionModelRevision = 1
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG] Received Command Response Data, Endpoint=0 Cluster=0x0000_003E Command=0x0000_0008
[1674780232627] [8807:372926] CHIP: [TOO] Endpoint: 0 Cluster: 0x0000_003E Command 0x0000_0008
[1674780232627] [8807:372926] CHIP: [TOO] NOCResponse: {
[1674780232627] [8807:372926] CHIP: [TOO] statusCode: 11
[1674780232627] [8807:372926] CHIP: [TOO] }
[1674780232627] [8807:372926] CHIP: [DMG] ICR moving to [AwaitingDe]
[1674780232627] [8807:372926] CHIP: [EM] <<< [E:31626i M:201286751 (Ack:54014818)] (S) Msg TX to 1:0000000000000001 [1A5D] --- Type 0000:10 (SecureChannel:StandaloneAck)
[1674780232627] [8807:372926] CHIP: [IN] (S) Sending msg 201286751 on secure session with LSID: 14333
[1674780232627] [8807:372926] CHIP: [EM] Flushed pending ack for MessageCounter:54014818 on exchange 31626i
[1674780232627] [8807:372921] CHIP: [CTL] Shutting down the commissioner
[1674780232627] [8807:372921] CHIP: [CTL] Stopping commissioning discovery over DNS-SD
[1674780232627] [8807:372921] CHIP: [CTL] Shutting down the controller
[1674780232627] [8807:372921] CHIP: [IN] Expiring all sessions for fabric 0x1!!
[1674780232627] [8807:372921] CHIP: [IN] SecureSession[0x600001c041e0]: MarkForEviction Type:2 LSID:14333
[1674780232627] [8807:372921] CHIP: [SC] SecureSession[0x600001c041e0]: Moving from state "kActive" --> "kPendingEviction"
[1674780232627] [8807:372921] CHIP: [IN] SecureSession[0x600001c041e0]: Released - Type:2 LSID:14333
disabled: true

- label:
"DUT shouldnt be discoverable via both commissionable and operational
advertisements"
verification: |
Verify DUT is not discoverable over DNS-SD in both TCP and UDP
avahi-browse -rt _matter._tcp
avahi-browse -rt _matter._udp
disabled: true
3 changes: 3 additions & 0 deletions src/app/tests/suites/manualTests.json
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,8 @@
"Test_TC_OPCREDS_3_2",
"Test_TC_OPCREDS_3_3",
"Test_TC_OPCREDS_3_4",
"Test_TC_OPCREDS_3_5",
"Test_TC_OPCREDS_3_6",
"Test_TC_CNET_4_1",
"Test_TC_CNET_4_2",
"Test_TC_CNET_4_3",
Expand Down Expand Up @@ -116,6 +118,7 @@
"Test_TC_IDM_4_1",
"Test_TC_IDM_4_2",
"Test_TC_IDM_4_3",
"Test_TC_IDM_4_4",
"Test_TC_IDM_5_1",
"Test_TC_IDM_5_2",
"Test_TC_IDM_6_1",
Expand Down
Loading

0 comments on commit 425f3ce

Please sign in to comment.