Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modified tests Feb 22 #25239

Merged
merged 4 commits into from
Feb 23, 2023
Merged

Modified tests Feb 22 #25239

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
b8120da
Added discoverOnce argument:
manjunath-grl Feb 22, 2023
7e026bb
Auto generated files
manjunath-grl Feb 22, 2023
5c9561a
Modified manualTests.json
manjunath-grl Feb 22, 2023
1b919ad
Restyled by whitespace
restyled-commits Feb 22, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 40 additions & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_9.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -137,6 +137,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -153,6 +155,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -169,6 +173,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -185,6 +191,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -201,6 +209,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -217,6 +227,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -233,6 +245,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -249,6 +263,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -265,6 +281,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -281,6 +299,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -297,6 +317,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -313,6 +335,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -329,6 +353,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -345,6 +371,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -361,6 +389,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -377,6 +407,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -393,6 +425,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -409,6 +443,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -425,6 +461,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand All @@ -441,6 +479,8 @@ tests:
value: nodeId2
- name: "payload"
value: incorrectSetupCodePayload
- name: discoverOnce
value: true
response:
error: FAILURE

Expand Down
93 changes: 93 additions & 0 deletions src/app/tests/suites/certification/Test_TC_IDM_4_4.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
# Copyright (c) 2021 Project CHIP Authors
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name: 3.4.3.[TC-IDM-4.4] Persistent Subscription Test Cases. [DUT as Server]

PICS:
- MCORE.IDM.S

config:
nodeId: 0x12344321
cluster: "Basic Information"
endpoint: 0

tests:
- label:
"TH sends a subscription request action for an attribute to the DUT.
Activate the subscription between DUT and the TH."
verification: |
The cluster used in the below command is an example, User can use any supported chip cluster/attribute/command.

Please use Interactive mode to Verify subscription test cases
Here the command to enter interactive mode:-- ./chip-tool interactive start


./chip-tool interactive start
onoff subscribe on-time 10 100 1 1 --auto-resubscribe true
Verify on the TH(chip-tool) that the Report data messages are sent from the DUT(Reference app) for subscription request action to the TH(chip-tool) with the correct attribute values.

[1675085714.397242][208829:208831] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0006 Attribute 0x0000_4001 DataVersion: 4283808198
[1675085714.397263][208829:208831] CHIP:TOO: OnTime: 0
[1675085714.397279][208829:208831] CHIP:DMG: MoveToState ReadClient[0x7f474801d330]: Moving to [AwaitingSu]
[1675085714.397311][208829:208831] CHIP:EM: <<< [E:17188i M:22097192 (Ack:128343668)] (S) Msg TX to 1:0000000000000001 [9666] --- Type 0001:01 (IM:StatusResponse)
[1675085714.397323][208829:208831] CHIP:IN: (S) Sending msg 22097192 on secure session with LSID: 50803
[1675085714.397742][208829:208831] CHIP:EM: >>> [E:17188i M:128343669 (Ack:22097192)] (S) Msg RX from 1:0000000000000001 [9666] --- Type 0001:04 (IM:SubscribeResponse)
[1675085714.397753][208829:208831] CHIP:EM: Found matching exchange: 17188i, Delegate: 0x7f474801d340
[1675085714.397764][208829:208831] CHIP:EM: Rxd Ack; Removing MessageCounter:22097192 from Retrans Table on exchange 17188i
[1675085714.397774][208829:208831] CHIP:DMG: SubscribeResponse is received
[1675085714.397787][208829:208831] CHIP:DMG: SubscribeResponseMessage =
[1675085714.397794][208829:208831] CHIP:DMG: {
[1675085714.397802][208829:208831] CHIP:DMG: SubscriptionId = 0xa11efe71,
[1675085714.397810][208829:208831] CHIP:DMG: MaxInterval = 0x64,
[1675085714.397819][208829:208831] CHIP:DMG: InteractionModelRevision = 1
[1675085714.397825][208829:208831] CHIP:DMG: }
[1675085714.397832][208829:208831] CHIP:DMG: Subscription established with SubscriptionID = 0xa11efe71 MinInterval = 10s MaxInterval = 100s Peer = 01:0000000000000001
disabled: true

- label: "Power off the DUT. Power on the DUT immediately."
verification: |
Verify on the TH(chip-tool) that the subscription between the DUT(Reference-app) and TH(chip-tool) is restablished and DUT(Reference-app) is able to send report data messages for the attribute which was subscribed to in step 1 within the MaxInterval time.


[1675085816.147288][208829:208831] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0006 Attribute 0x0000_4001 DataVersion: 1956782965
[1675085816.147302][208829:208831] CHIP:TOO: OnTime: 0
[1675085816.147318][208829:208831] CHIP:DMG: MoveToState ReadClient[0x7f474801d330]: Moving to [AwaitingSu]
[1675085816.147360][208829:208831] CHIP:EM: <<< [E:17190i M:24372277 (Ack:66274424)] (S) Msg TX to 1:0000000000000001 [9666] --- Type 0001:01 (IM:StatusResponse)
[1675085816.147373][208829:208831] CHIP:IN: (S) Sending msg 24372277 on secure session with LSID: 50804
[1675085816.147908][208829:208831] CHIP:EM: >>> [E:17190i M:66274425 (Ack:24372277)] (S) Msg RX from 1:0000000000000001 [9666] --- Type 0001:04 (IM:SubscribeResponse)
[1675085816.147934][208829:208831] CHIP:EM: Found matching exchange: 17190i, Delegate: 0x7f474801d340
[1675085816.147950][208829:208831] CHIP:EM: Rxd Ack; Removing MessageCounter:24372277 from Retrans Table on exchange 17190i
[1675085816.147964][208829:208831] CHIP:DMG: SubscribeResponse is received
[1675085816.147980][208829:208831] CHIP:DMG: SubscribeResponseMessage =
[1675085816.147989][208829:208831] CHIP:DMG: {
[1675085816.147997][208829:208831] CHIP:DMG: SubscriptionId = 0x2b5276ad,
[1675085816.148006][208829:208831] CHIP:DMG: MaxInterval = 0x64,
[1675085816.148013][208829:208831] CHIP:DMG: InteractionModelRevision = 1
[1675085816.148019][208829:208831] CHIP:DMG: }
[1675085816.148029][208829:208831] CHIP:DMG: Subscription established with SubscriptionID = 0x2b5276ad MinInterval = 10s MaxInterval = 100s Peer = 01:0000000000000001
[1675085816.148041][208829:208831] CHIP:DMG: MoveToState ReadClient[0x7f474801d330]: Moving to [Subscripti]
[1675085816.148055][208829:208831] CHIP:DMG: Refresh LivenessCheckTime for 101500 milliseconds with SubscriptionId = 0x2b5276ad Peer = 01:0000000000000001
[1675085816.148084][208829:208831] CHIP:EM: <<< [E:17190i M:24372278 (Ack:66274425)] (S) Msg TX to 1:0000000000000001 [9666] --- Type 0000:10 (SecureChannel:StandaloneAck)
[1675085816.148097][208829:208831] CHIP:IN: (S) Sending msg 24372278 on secure session with LSID: 50804
[1675085816.148141][208829:208831] CHIP:EM: Flushed pending ack for MessageCounter:66274425 on exchange 17190i
[1675085916.246163][208829:208831] CHIP:EM: >>> [E:17698r M:66274426] (S) Msg RX from 1:0000000000000001 [9666] --- Type 0001:05 (IM:ReportData)
[1675085916.246182][208829:208831] CHIP:EM: Handling via exchange: 17698r, Delegate: 0x5572dfe7d328
[1675085916.246207][208829:208831] CHIP:DMG: ReportDataMessage =
[1675085916.246211][208829:208831] CHIP:DMG: {
[1675085916.246216][208829:208831] CHIP:DMG: SubscriptionId = 0x2b5276ad,
[1675085916.246220][208829:208831] CHIP:DMG: InteractionModelRevision = 1
[1675085916.246223][208829:208831] CHIP:DMG: }
[1675085916.246233][208829:208831] CHIP:DMG: Refresh LivenessCheckTime for 101500 milliseconds with SubscriptionId = 0x2b5276ad Peer = 01:0000000000000001
disabled: true
99 changes: 99 additions & 0 deletions src/app/tests/suites/certification/Test_TC_OPCREDS_3_6.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
# Copyright (c) 2021 Project CHIP Authors
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name: 12.3.6. [TC-OPCREDS-3.6] Last Fabric removal validation [DUT-Server]

PICS:
- OPCREDS.S

config:
nodeId: 0x12344321
cluster: "Basic Information"
endpoint: 0

tests:
- label: "TH1 fully commissions the DUT"
verification: |
"DUT side:
sudo ./chip-all-clusters-app --wifi

TH side:
./chip-tool pairing code 1 34970112332 --trace_decode 1

[1650455358.501816][4366:4371] CHIP:TOO: Device commissioning completed with success"
disabled: true

- label:
"TH1 sends RemoveFabric command with Fabric Index as FabricIndex_TH1
to DUT"
PICS: OPCREDS.S.C0a.Rsp
verification: |
./chip-tool operationalcredentials remove-fabric 1 1 0

[1674780232627] [8807:372926] CHIP: [DMG] InvokeResponseMessage =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] suppressResponse = false,
[1674780232627] [8807:372926] CHIP: [DMG] InvokeResponseIBs =
[1674780232627] [8807:372926] CHIP: [DMG] [
[1674780232627] [8807:372926] CHIP: [DMG] InvokeResponseIB =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] CommandDataIB =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] CommandPathIB =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] EndpointId = 0x0,
[1674780232627] [8807:372926] CHIP: [DMG] ClusterId = 0x3e,
[1674780232627] [8807:372926] CHIP: [DMG] CommandId = 0x8,
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] CommandFields =
[1674780232627] [8807:372926] CHIP: [DMG] {
[1674780232627] [8807:372926] CHIP: [DMG] 0x0 = 11,
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] ],
[1674780232627] [8807:372926] CHIP: [DMG]
[1674780232627] [8807:372926] CHIP: [DMG] InteractionModelRevision = 1
[1674780232627] [8807:372926] CHIP: [DMG] },
[1674780232627] [8807:372926] CHIP: [DMG] Received Command Response Data, Endpoint=0 Cluster=0x0000_003E Command=0x0000_0008
[1674780232627] [8807:372926] CHIP: [TOO] Endpoint: 0 Cluster: 0x0000_003E Command 0x0000_0008
[1674780232627] [8807:372926] CHIP: [TOO] NOCResponse: {
[1674780232627] [8807:372926] CHIP: [TOO] statusCode: 11
[1674780232627] [8807:372926] CHIP: [TOO] }
[1674780232627] [8807:372926] CHIP: [DMG] ICR moving to [AwaitingDe]
[1674780232627] [8807:372926] CHIP: [EM] <<< [E:31626i M:201286751 (Ack:54014818)] (S) Msg TX to 1:0000000000000001 [1A5D] --- Type 0000:10 (SecureChannel:StandaloneAck)
[1674780232627] [8807:372926] CHIP: [IN] (S) Sending msg 201286751 on secure session with LSID: 14333
[1674780232627] [8807:372926] CHIP: [EM] Flushed pending ack for MessageCounter:54014818 on exchange 31626i
[1674780232627] [8807:372921] CHIP: [CTL] Shutting down the commissioner
[1674780232627] [8807:372921] CHIP: [CTL] Stopping commissioning discovery over DNS-SD
[1674780232627] [8807:372921] CHIP: [CTL] Shutting down the controller
[1674780232627] [8807:372921] CHIP: [IN] Expiring all sessions for fabric 0x1!!
[1674780232627] [8807:372921] CHIP: [IN] SecureSession[0x600001c041e0]: MarkForEviction Type:2 LSID:14333
[1674780232627] [8807:372921] CHIP: [SC] SecureSession[0x600001c041e0]: Moving from state "kActive" --> "kPendingEviction"
[1674780232627] [8807:372921] CHIP: [IN] SecureSession[0x600001c041e0]: Released - Type:2 LSID:14333
disabled: true

- label:
"DUT shouldnt be discoverable via both commissionable and operational
advertisements"
verification: |
Verify DUT is not discoverable over DNS-SD in both TCP and UDP

avahi-browse -rt _matter._tcp
avahi-browse -rt _matter._udp
disabled: true
3 changes: 3 additions & 0 deletions src/app/tests/suites/manualTests.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,8 @@
"Test_TC_OPCREDS_3_2",
"Test_TC_OPCREDS_3_3",
"Test_TC_OPCREDS_3_4",
"Test_TC_OPCREDS_3_5",
"Test_TC_OPCREDS_3_6",
"Test_TC_CNET_4_1",
"Test_TC_CNET_4_2",
"Test_TC_CNET_4_3",
Expand Down Expand Up @@ -116,6 +118,7 @@
"Test_TC_IDM_4_1",
"Test_TC_IDM_4_2",
"Test_TC_IDM_4_3",
"Test_TC_IDM_4_4",
"Test_TC_IDM_5_1",
"Test_TC_IDM_5_2",
"Test_TC_IDM_6_1",
Expand Down
Loading