Skip to content

Commit

Permalink
Semi-automated tests Nov 29 (#30733)
Browse files Browse the repository at this point in the history 
* Added new semi-automated tests
TC-LWM-3.2
TC-LWM-3.3
TC-REFALM-2.3
TC-TCTL-3.2
TC-TCTL-3.3

* Auto generated files

* INVALID_IN_STATE in TCTL-3.2

* Fix TCTL-3.3 CI failure

* Modified CI-pics-value files
SupportsInvalidInMode set to 0
  • Loading branch information
@manjunath-grl
manjunath-grl authored Dec 5, 2023
1 parent 8677d1a commit ca23c8a
Show file tree
Hide file tree
Showing 11 changed files with 1,391 additions and 804 deletions.
3 changes: 3 additions & 0 deletions examples/darwin-framework-tool/templates/tests/ciTests.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,9 @@
"Test_TC_TCCM_3_3",
"Test_TC_RVCRUNM_3_1",
"Test_TC_TCTL_2_1",
"Test_TC_LWM_3_1",
"Test_TC_LWM_3_2",
"Test_TC_LWM_3_3",
"Disabled because darwin-framework-tool does not support constraints arithmetic operations",
"Test_TC_FLW_2_1",
"Test_TC_RH_2_1",
Expand Down
2 changes: 2 additions & 0 deletions scripts/tests/chiptest/__init__.py
View file
Original file line number Diff line number Diff line change
Expand Up @@ -184,6 +184,8 @@ def _GetChipReplUnsupportedTests() -> Set[str]:
"Test_TC_DGGEN_2_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_DGGEN_2_3.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_2.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_3.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_G_2_4.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_RVCRUNM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_RVCCLEANM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
Expand Down
313 changes: 116 additions & 197 deletions src/app/tests/suites/certification/Test_TC_LWM_3_2.yaml
View file

Large diffs are not rendered by default.

342 changes: 122 additions & 220 deletions src/app/tests/suites/certification/Test_TC_LWM_3_3.yaml
View file

Large diffs are not rendered by default.

179 changes: 98 additions & 81 deletions src/app/tests/suites/certification/Test_TC_REFALM_2_3.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,117 +11,134 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name:
217.2.3. [TC-REFALM-2.3] Local suppression of the door alarm with DUT as
Server

PICS:
- REFALM.S
- REFALM.S.M.LocalSuppress

config:
nodeId: 0x12344321
cluster: "Basic Information"
endpoint: 0
cluster: "Refrigerator Alarm"
endpoint: 1
PIXIT.REFALM.AlarmThreshold:
type: int16u
defaultValue: 5

tests:
- label:
"Step 1: Commission DUT to TH (can be skipped if done in a preceding
test)"
verification: |
disabled: true
cluster: "DelayCommands"
command: "WaitForCommissionee"
arguments:
values:
- name: "nodeId"
value: nodeId

- label: "Step 2: Ensure that the door on the DUT is closed"
verification: |
Ensure that the door on the DUT is closed
disabled: true

- label: "Step 3: TH reads from the DUT the State attribute"
cluster: "LogCommands"
command: "UserPrompt"
PICS: PICS_USER_PROMPT
arguments:
values:
- name: "message"
value: "Please enter 'y' for success"
- name: "expectedValue"
value: "y"

- label: "Step 3:TH reads from the DUT the State attribute"
command: "readAttribute"
attribute: "State"
PICS: REFALM.S.A0002
verification: |
./chip-tool refrigeratoralarm read state 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 0.
[1688447820.603249][4247:4249] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0002 DataVersion: 1795162772
[1688447820.603415][4247:4249] CHIP:TOO: State: 0
[1688447820.603708][4247:4249] CHIP:EM: <<< [E:2198i S:4260 M:156565261 (Ack:46517349)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true

- label: "Step 4: TH reads from the DUT the Mask attribute"
response:
constraints:
type: bitmap32
hasMasksClear: [0x1]

- label: "Step 4:TH reads from the DUT the Mask attribute"
command: "readAttribute"
attribute: "Mask"
PICS: REFALM.S.A0000
verification: |
./chip-tool refrigeratoralarm read mask 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 1.
[1688447677.832882][4229:4231] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0000 DataVersion: 1795162772
[1688447677.833165][4229:4231] CHIP:TOO: Mask: 1
[1688447677.833494][4229:4231] CHIP:EM: <<< [E:27636i S:5449 M:199797248 (Ack:151091416)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true
response:
constraints:
type: bitmap32
hasMasksSet: [0x1]

- label: "Step 5: Manually open the door on the DUT"
verification: |
Manually open the door on the DUT
disabled: true
cluster: "LogCommands"
command: "UserPrompt"
PICS: PICS_USER_PROMPT
arguments:
values:
- name: "message"
value: "Please enter 'y' for success"
- name: "expectedValue"
value: "y"

- label: "Step 6: Wait for the time defined in PIXIT.REFALM.AlarmThreshold"
verification: |
Wait for the time defined in PIXIT.REFALM.AlarmThreshold
disabled: true

- label: "Step 7: TH reads from the DUT the State attribute"
PICS: REFALM.S.A0002
verification: |
./chip-tool refrigeratoralarm read state 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 0.
[1688447820.603249][4247:4249] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0002 DataVersion: 1795162772
[1688447820.603415][4247:4249] CHIP:TOO: State: 1
[1688447820.603708][4247:4249] CHIP:EM: <<< [E:2198i S:4260 M:156565261 (Ack:46517349)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true
cluster: "DelayCommands"
PICS: PICS_USER_PROMPT
command: "WaitForMs"
arguments:
values:
- name: "ms"
value: PIXIT.REFALM.AlarmThreshold * 1000

- label: "Step 7:TH reads from the DUT the State attribute"
command: "readAttribute"
attribute: "State"
PICS: REFALM.S.A0002 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksSet: [0x1]

- label:
"Step 8: Invoke the on DUT sequence to suppress the alarm, do not
close the door"
verification: |
Invoke the on DUT sequence to suppress the alarm, do not close the door
disabled: true

- label: "Step 9: TH reads from the DUT the State attribute"
PICS: REFALM.S.A0002
verification: |
./chip-tool refrigeratoralarm read state 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 0.
[1688447820.603249][4247:4249] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0002 DataVersion: 1795162772
[1688447820.603415][4247:4249] CHIP:TOO: State: 0
[1688447820.603708][4247:4249] CHIP:EM: <<< [E:2198i S:4260 M:156565261 (Ack:46517349)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true

- label: "Step 10: TH reads from the DUT the Mask attribute"
PICS: REFALM.S.A0000
verification: |
./chip-tool refrigeratoralarm read mask 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 1.
[1688447677.832882][4229:4231] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0000 DataVersion: 1795162772
[1688447677.833165][4229:4231] CHIP:TOO: Mask: 0
[1688447677.833494][4229:4231] CHIP:EM: <<< [E:27636i S:5449 M:199797248 (Ack:151091416)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true

- label: "Step 11: TH reads from the DUT the Supported attribute"
PICS: REFALM.S.A0003
verification: |
./chip-tool refrigeratoralarm read supported 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 1.
[1689677642.708638][18413:18415] CHIP:DMG: SuppressResponse = true,
[1689677642.708645][18413:18415] CHIP:DMG: InteractionModelRevision = 1
[1689677642.708651][18413:18415] CHIP:DMG: }
[1689677642.708726][18413:18415] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0003 DataVersion: 1517282962
[1689677642.708773][18413:18415] CHIP:TOO: Supported: 1
[1689677642.708845][18413:18415] CHIP:EM: <<< [E:32432i S:53289 M:29829407 (Ack:142651059)] (S) Msg TX to 1:0000000000000001 [BFDE] --- Type 0000:10 (SecureChannel:StandaloneAck)
[1689677642.708859][18413:18415] CHIP:IN: (S) Sending msg 29829407 on secure session with LSID: 53289
[1689677642.708900][18413:18415] CHIP:EM: Flushed pending ack for MessageCounter:142651059 on exchange 32432i
disabled: true
cluster: "LogCommands"
command: "UserPrompt"
PICS: PICS_USER_PROMPT
arguments:
values:
- name: "message"
value: "Please enter 'y' for success"
- name: "expectedValue"
value: "y"

- label: "Step 9:TH reads from the DUT the State attribute"
command: "readAttribute"
attribute: "State"
PICS: REFALM.S.A0002 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksClear: [0x1]

- label: "Step 10:TH reads from the DUT the Mask attribute"
command: "readAttribute"
attribute: "Mask"
PICS: REFALM.S.A0000 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksClear: [0x1]

- label: "Step 11:TH reads from the DUT the Supported attribute"
command: "readAttribute"
attribute: "Supported"
PICS: REFALM.S.A0003 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksSet: [0x1]
Loading

0 comments on commit ca23c8a

Please sign in to comment.