Skip to content

Commit

Permalink
Modified scripts Aug 23 (#28829)
Browse files Browse the repository at this point in the history
* Newly added semi/automated testcases:
TC_GRPKEY_2_1
TC_GRPKEY_2_2
TC_BRBINFO_2_1
TC_DGGEN_2_1
TC_DGGEN_2_3
TC_FAN_2_5
TC_LCFG_2_1
TC_LTIME_3_1
TC_LWM_1_1
TC_LWM_2_1
TC_LWM_3_1
TC_MOD_2_1
TC_MOD_3_1
TC_MOD_3_2
TC_MOD_3_3
TC_MOD_3_4
TC_OPSTATE_2_4
TC_REFALM_1_1
TC_RVCCLEANM_3_1
TC_TCCM_1_1
TC_TCTL_1_1
Test_TC_MOD_2_3

* Auto generated files

* Newly added manual tests:
TC_DT_1_1
TC_GRPKEY_5_4
TC_LWM_3_3
TC_OPCREDS_3_7
TC_RVCCLEANM_1_2
TC_RVCCLEANM_2_1
TC_RVCCLEANM_3_2
TC_RVCRUNM_1_2
TC_RVCRUNM_2_1
TC_RVCRUNM_3_2
TC_SM_1_1
TC_SM_1_2

Modified manual tests:
TC_ACT_2_1
TC_ACT_2_2
TC_BR_1
TC_BR_2
TC_DESC_2_1
TC_DISHALM_1_1
TC_DISHALM_2_1
TC_DISHALM_3_1
TC_DISHALM_3_2
TC_DISHALM_3_3
TC_DISHALM_3_4
TC_DISHALM_3_5
TC_DISHALM_3_6
TC_DISHM_1_1
TC_DISHM_1_2
TC_DISHM_2_1
TC_DISHM_3_1
TC_DISHM_3_2
TC_DISHM_3_3
TC_DRLK_2_1
TC_DRLK_2_10
TC_DRLK_2_2
TC_G_2_2
TC_G_2_3
TC_G_3_2
TC_IDM_4_2
TC_LWM_1_2
TC_LWM_3_2
TC_MOD_1_2
TC_RVCCLEANM_1_1
TC_RVCCLEANM_3_3
TC_RVCRUNM_1_1
TC_RVCRUNM_3_3
TC_TCCM_1_2
TC_TCCM_2_1
TC_TCCM_3_1
TC_TCCM_3_2
TC_TCCM_3_3
TC_TCTL_2_1
TC_TCTL_2_2
TC_TCTL_2_3
TC_TCTL_3_2
TC_TCTL_3_3

* Restyled by whitespace

* Fixes issue 620

* Restyled by whitespace

* Modified tests:
TC-DGGEN-2.1
TC-GRPKEY-2.1

* Modified GRPKEY-2.1 test

* Fixed CI failure for OPSTATE-2.4

* Modified DGGEN-2.1 test

* Fixes issue: 589
Added TC-G-2.4 automated test
Modified test: TC-DGGEN-2.1

* Modified test DGGEN-2.1 PICS

* Test_TC_G_2_4.yaml test added in init.py as the chip-repl does not support EqualityCommands pseudo-cluster

* Fixes issue: 623, 624

* Restyled by whitespace

* Modified ACL commision step logs

* Restyled by whitespace

* MOdified files:
TC-BINFO-2.1
TC-TSTAT-1.1
Removed tests:
TC-WASHERCTRL-3.1
TC-WASHERCTRL-3.2

---------

Co-authored-by: Restyled.io <[email protected]>
  • Loading branch information
2 people authored and pull[bot] committed Feb 8, 2024
1 parent a46c022 commit 84e2ce0
Show file tree
Hide file tree
Showing 100 changed files with 169,061 additions and 16,429 deletions.
2 changes: 2 additions & 0 deletions examples/darwin-framework-tool/templates/tests/ciTests.json
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,8 @@
"Test_TC_SMOKECO_2_3",
"Test_TC_SMOKECO_2_4",
"Test_TC_SMOKECO_2_5",
"Test_TC_DGGEN_2_1",
"Test_TC_OPSTATE_2_4",
"Disabled due to undefined properties",
"Test_TC_SMOKECO_2_6",
"Disabled because the power source configuration cluster is now deprecated and not present in all-clusters",
Expand Down
9 changes: 9 additions & 0 deletions scripts/tests/chiptest/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -165,6 +165,15 @@ def _GetChipReplUnsupportedTests() -> Set[str]:
"Test_TC_S_2_2.yaml", # chip-repl does not support scenes cluster commands
"Test_TC_S_2_3.yaml", # chip-repl does not support scenes cluster commands
"Test_TC_S_2_4.yaml", # chip-repl does not support scenes cluster commands
"Test_TC_MOD_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_MOD_3_2.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_MOD_3_3.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_MOD_3_4.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_BRBINFO_2_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_DGGEN_2_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_DGGEN_2_3.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_G_2_4.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
}


Expand Down
111 changes: 104 additions & 7 deletions src/app/tests/suites/certification/PICS.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1774,8 +1774,25 @@ PICS:
- label:
"Can the Dishwasher Alarm attribute changed by physical control at the
device?"
id: DISHALM.M.ManuallyControlled
id: DISHALM.S.M.ManuallyControlled

- label: "Does the device support the Inflow alarm?"
id: DISHALM.S.M.InflowAlarmSupported

- label: "Does the device support the Drain alarm?"
id: DISHALM.S.M.DrainAlarmSupported

- label: "Does the device support the Door alarm?"
id: DISHALM.S.M.DoorAlarmSupported

- label: "Does the device support the TempLow alarm?"
id: DISHALM.S.M.TempLowAlarmSupported

- label: "Does the device support the TempHigh alarm?"
id: DISHALM.S.M.TempHighAlarmSupported

- label: "Does the device support the WaterLevel alarm?"
id: DISHALM.S.M.WaterLevelAlarmSupported
#
# server / Commands received
#
Expand All @@ -1790,11 +1807,20 @@ PICS:
- label: "Does the device implement the DISHM cluster as a server?"
id: DISHM.S

- label: "IDoes the DUT support testing the failed ChangeToMode command?"
id: DISHM.S.M.CAN_TEST_MODE_FAILURE

# PIXIT

- label:
"Id of mode the device will fail to transition to, given its current
state"
id: PIXIT.DISHM.CAN_TEST_MODE_FAILURE
id: PIXIT.DISHM.MODE_CHANGE_FAIL

- label:
"Id of mode the device will successfully transition to, given its
current state"
id: PIXIT.DISHM.MODE_CHANGE_OK
#
# server / features
#
Expand Down Expand Up @@ -2862,7 +2888,7 @@ PICS:
id: DRLK.S.Simulate.NotFullyLocked

- label: "Does the DUT(server) detect a LockJammed State?"
id: DRLK.S.DetectLockJammed
id: DRLK.S.M.DetectLockJammed

#
# client / attributes
Expand Down Expand Up @@ -3610,6 +3636,43 @@ PICS:
feature?"
id: GRPKEY.S.F00

#
#server attributes
#
- label: "Does the device implement the GroupKeyMap attribute?"
id: GRPKEY.S.A0000

- label: "Does the device implement the GroupTable attribute?"
id: GRPKEY.S.A0001

- label: "Does the device implement the MaxGroupsPerFabric attribute?"
id: GRPKEY.S.A0002

- label: "Does the device implement the MaxGroupKeysPerFabric attribute?"
id: GRPKEY.S.A0003

#
# server commandsGenerated
#
- label: "Does the device implement the KeySetWrite command}?"
id: GRPKEY.S.C00.Rsp

- label: "Does the device implement the KeySetRead command}?"
id: GRPKEY.S.C01.Rsp

- label: "Does the device implement the KeySetReadResponse command}?"
id: GRPKEY.S.C02.Rsp

- label: "Does the device implement the KeySetRemove command}?"
id: GRPKEY.S.C03.Rsp

- label: "Does the device implement the KeySetReadAllIndices command}?"
id: GRPKEY.S.C04.Rsp

- label:
"Does the device implement the KeySetReadAllIndicesResponse command}?"
id: GRPKEY.S.C05.Rsp

#
# client / attributes
#
Expand Down Expand Up @@ -8930,10 +8993,18 @@ PICS:
- label: "Does the device implement the LWM cluster as a server?"
id: LWM.S

- label: "Does the DUT support testing the failed ChangeToMode command?"
id: LWM.S.M.CAN_TEST_MODE_FAILURE

- label:
"Id of mode the device will fail to transition to, given its current
state"
id: PIXIT.LWM.CAN_TEST_MODE_FAILURE
id: PIXIT.LWM.MODE_CHANGE_FAIL

- label:
"Id of mode the device will successfully transition to, given its
current state"
id: PIXIT.LWM.MODE_CHANGE_OK

#
# server / features
Expand Down Expand Up @@ -9012,21 +9083,36 @@ PICS:
"Does the device implement sending the ChangeToModeResponse command?"
id: RVCCLEANM.S.C01.Tx

- label: "Does the DUT support testing the failed ChangeToMode command?"
id: RVCCLEANM.S.M.CAN_TEST_MODE_FAILURE

- label:
"Id of mode the device will fail to transition to, given its current
state"
id: PIXIT.RVCCLEANM.CAN_TEST_MODE_FAILURE
id: PIXIT.RVCCLEANM.MODE_CHANGE_FAIL

- label:
"Id of mode the device will successfully transition to, given its
current state"
id: PIXIT.RVCCLEANM.MODE_CHANGE_OK
#
#Temperature Controlled Cabinet Mode Cluster
#
- label: "Does the device implement the TCCM cluster as a server?"
id: TCCM.S

- label: "Does the DUT support testing the failed ChangeToMode command?"
id: TCCM.S.M.CAN_TEST_MODE_FAILURE

- label:
"Id of mode the device will successfully transition to, given its
current state"
id: PIXIT.TCCM.MODE_CHANGE_OK

- label:
"Id of mode the device will fail to transition to, given its current
state"
id: PIXIT.TCCM.CAN_TEST_MODE_FAILURE
id: PIXIT.TCCM.MODE_CHANGE_FAIL

#Features
- label:
Expand Down Expand Up @@ -9103,6 +9189,9 @@ PICS:
device?"
id: TCC.M.ManuallyControlledTemperature

- label: "Does the device support the INVALID_IN_MODE response"
id: TCTL.S.M.SupportsInvalidInMode

#Commands received
- label:
"Does the device implement receiving the SetTemperatureCommand
Expand Down Expand Up @@ -9161,10 +9250,18 @@ PICS:
- label: "Does the device implement the RVCRUNM cluster as a server?"
id: RVCRUNM.S

- label: "Does the DUT support testing the failed ChangeToMode command?"
id: RVCRUNM.S.M.CAN_TEST_MODE_FAILURE

- label:
"Id of mode the device will fail to transition to, given its current
state"
id: PIXIT.RVCRUNM.CAN_TEST_MODE_FAILURE
id: PIXIT.RVCRUNM.MODE_CHANGE_FAIL

- label:
"Id of mode the device will successfully transition to, given its
current state"
id: PIXIT.RVCRUNM.MODE_CHANGE_OK

#Features
- label:
Expand Down
9 changes: 5 additions & 4 deletions src/app/tests/suites/certification/Test_TC_ACL_2_10.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -106,15 +106,16 @@ tests:
./chip-tool pairing open-commissioning-window 1 1 400 2000 3841
Commission TH2(Chiptool) to DUT using manualcode generated in TH1 using open commission window
./chip-tool pairing code 2 36253605617 --commissioner-name beta --commissioner-nodeid 223344
[1657186324.710951][10820:10825] CHIP:DMG: Received Command Response Status for Endpoint=0 Cluster=0x0000_003C Command=0x0000_0000 Status=0x0
[1657186324.710980][10820:10825] CHIP:CTL: Successfully opened pairing window On TH(Chiptool)e device
[1657186324.711048][10820:10825] CHIP:CTL: Manual pairing code: [36253605617]
[1657186324.711108][10820:10825] CHIP:CTL: SetupQRCode: [MT:-24J0IRV01A7TB7E700]
Commission TH2(Chiptool) to DUT using manualcode generated in TH1 using open commission window
./chip-tool pairing code 2 36253605617 --commissioner-name beta --commissioner-nodeid 223344
Commission TH2(Chiptool) to DUT:
[1657186359.584672][3509:3514] CHIP:CTL: Successfully finished commissioning step 'Cleanup'
[1657186359.584743][3509:3514] CHIP:TOO: Device commissioning completed with success
cluster: "LogCommands"
Expand Down
9 changes: 5 additions & 4 deletions src/app/tests/suites/certification/Test_TC_ACL_2_7.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -97,15 +97,16 @@ tests:
./chip-tool pairing open-commissioning-window 1 1 400 2000 3841
Commission TH2(Chiptool) to DUT using manualcode generated in TH1 using open commission window
./chip-tool pairing code 2 36253605617 --commissioner-name beta --commissioner-nodeid 223344
[1657186324.710951][10820:10825] CHIP:DMG: Received Command Response Status for Endpoint=0 Cluster=0x0000_003C Command=0x0000_0000 Status=0x0
[1657186324.710980][10820:10825] CHIP:CTL: Successfully opened pairing window On TH(Chiptool)e device
[1657186324.711048][10820:10825] CHIP:CTL: Manual pairing code: [36253605617]
[1657186324.711108][10820:10825] CHIP:CTL: SetupQRCode: [MT:-24J0IRV01A7TB7E700]
Commission TH2(Chiptool) to DUT using manualcode generated in TH1 using open commission window
./chip-tool pairing code 2 36253605617 --commissioner-name beta --commissioner-nodeid 223344
Commission TH2(Chiptool) to DUT:
[1657186359.584672][3509:3514] CHIP:CTL: Successfully finished commissioning step 'Cleanup'
[1657186359.584743][3509:3514] CHIP:TOO: Device commissioning completed with success
cluster: "LogCommands"
Expand Down
10 changes: 5 additions & 5 deletions src/app/tests/suites/certification/Test_TC_ACL_2_8.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -98,16 +98,16 @@ tests:
./chip-tool pairing open-commissioning-window 1 1 400 2000 3841
Commission TH2(Chiptool) to DUT using manualcode generated in TH1 using open commission window
./chip-tool pairing code 2 36253605617 --commissioner-name beta --commissioner-nodeid 223344
[1657186324.710951][10820:10825] CHIP:DMG: Received Command Response Status for Endpoint=0 Cluster=0x0000_003C Command=0x0000_0000 Status=0x0
[1657186324.710980][10820:10825] CHIP:CTL: Successfully opened pairing window On TH(Chiptool)e device
[1657186324.711048][10820:10825] CHIP:CTL: Manual pairing code: [36253605617]
[1657186324.711108][10820:10825] CHIP:CTL: SetupQRCode: [MT:-24J0IRV01A7TB7E700]
Commission TH2(Chiptool) to DUT using manualcode generated in TH1 using open commission window
./chip-tool pairing code 2 36253605617 --commissioner-name beta --commissioner-nodeid 223344
Commission TH2(Chiptool) to DUT:
[1657186359.584672][3509:3514] CHIP:CTL: Successfully finished commissioning step 'Cleanup'
[1657186359.584743][3509:3514] CHIP:TOO: Device commissioning completed with success
cluster: "LogCommands"
Expand Down
Loading

0 comments on commit 84e2ce0

Please sign in to comment.