Skip to content

Commit

Permalink
Updated Manual Scripts (#16384)
Browse files Browse the repository at this point in the history 
* Added Updated Manual Scripts

* Added updated manual Scripts

* 1.Fixing syntax errors in autogen manual test scripts

* Adding auto generated code.

* Restyled by whitespace

* Restyled by prettier-yaml

* 1.Fixed format issues in IDM manual test case.

* 1. Regenerating files after rebase

* 1. Updated atrribute name in manual test case

Co-authored-by: Vikram Bhat <[email protected]>
Co-authored-by: Restyled.io <[email protected]>
  • Loading branch information
@kowsisoundhar12 @kvikrambhat
@restyled-commits @pull
3 people authored and pull[bot] committed Sep 18, 2023
1 parent cd55e3e commit 6d27ac3
Show file tree
Hide file tree
Showing 115 changed files with 10,681 additions and 10,747 deletions.
1 change: 0 additions & 1 deletion examples/chip-tool/templates/tests/tests.js
View file
Original file line number Diff line number Diff line change
Expand Up @@ -147,7 +147,6 @@ function getManualTests()
const MultipleFabrics = [
'Test_TC_MF_1_1',
'Test_TC_MF_1_2',
'Test_TC_MF_1_3',
'Test_TC_MF_1_4',
'Test_TC_MF_1_5',
'Test_TC_MF_1_6',
Expand Down
24 changes: 12 additions & 12 deletions src/app/tests/suites/certification/Test_TC_BDX_1_2.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -21,16 +21,16 @@ config:

tests:
- label: "DUT sends a ReceiveInit message to TH"
verification:
"1. Verify that the OTA Reference Provider App logs show ReceiveInit
message from DUT [1636410921473] [59203:62969336] CHIP: [ATM] Handling
received BDX Message [1636410921473] [59203:62969336] CHIP: [ATM]
ReceiveInit [1636410921473] [59203:62969336] CHIP: [ATM] Proposed
Transfer Control: 0x20 [1636410921473] [59203:62969336] CHIP: [ATM]
Range Control: 0x0 [1636410921473] [59203:62969336] CHIP: [ATM]
Proposed Max Block Size: 1024 [1636410921473] [59203:62969336] CHIP:
[ATM] Start Offset: 0x0000000000000000 [1636410921473]
[59203:62969336] CHIP: [ATM] Proposed Max Length: 0x0000000000000000
[1636410921473] [59203:62969336] CHIP: [ATM] File Designator Length: 8
[1636410921473] [59203:62969336] CHIP: [ATM] File Designator: test.txt"
verification: |
1. Verify that the OTA Reference Provider App logs show ReceiveInit message from DUT
[1636410921473] [59203:62969336] CHIP: [ATM] Handling received BDX Message
[1636410921473] [59203:62969336] CHIP: [ATM] ReceiveInit
[1636410921473] [59203:62969336] CHIP: [ATM] Proposed Transfer Control: 0x20
[1636410921473] [59203:62969336] CHIP: [ATM] Range Control: 0x0
[1636410921473] [59203:62969336] CHIP: [ATM] Proposed Max Block Size: 1024
[1636410921473] [59203:62969336] CHIP: [ATM] Start Offset: 0x0000000000000000
[1636410921473] [59203:62969336] CHIP: [ATM] Proposed Max Length: 0x0000000000000000
[1636410921473] [59203:62969336] CHIP: [ATM] File Designator Length: 8
[1636410921473] [59203:62969336] CHIP: [ATM] File Designator: test.txt
disabled: true
75 changes: 42 additions & 33 deletions src/app/tests/suites/certification/Test_TC_BDX_2_1.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,47 +24,56 @@ tests:
"DUT sends a SendInit message to TH + TH sends a SendAccept message
back to DUT + DUT sends a Block message to TH + TH sends a BlockAck
message back to DUT"
verification:
"1. Verify that the OTA Reference Requester App logs show Block
message from DUT [1636410923701] [59208:62970584] CHIP: [ATM] Handling
received BDX Message [1636410923701] [59208:62970584] CHIP: [ATM]
Block [1636410923701] [59208:62970584] CHIP: [ATM] Block Counter: 0
[1636410923701] [59208:62970584] CHIP: [ATM] Data Length: 1024 Compare
with [1636410922200] [59208:62970584] CHIP: [ATM] Handling received
BDX Message [1636410922200] [59208:62970584] CHIP: [ATM] ReceiveAccept
[1636410922200] [59208:62970584] CHIP: [ATM] Transfer Control: 0x20
[1636410922200] [59208:62970584] CHIP: [ATM] Range Control: 0x0
[1636410922200] [59208:62970584] CHIP: [ATM] Max Block Size: 1024
[1636410922200] [59208:62970584] CHIP: [ATM] Length:
0x0000000000000000"
verification: |
1. Verify that the OTA Reference Requester App logs show Block message from DUT
[1636410923701] [59208:62970584] CHIP: [ATM] Handling received BDX Message
[1636410923701] [59208:62970584] CHIP: [ATM] Block
[1636410923701] [59208:62970584] CHIP: [ATM] Block Counter: 0
[1636410923701] [59208:62970584] CHIP: [ATM] Data Length: 1024
Compare with
[1636410922200] [59208:62970584] CHIP: [ATM] Handling received BDX Message
[1636410922200] [59208:62970584] CHIP: [ATM] ReceiveAccept
[1636410922200] [59208:62970584] CHIP: [ATM] Transfer Control: 0x20
[1636410922200] [59208:62970584] CHIP: [ATM] Range Control: 0x0
[1636410922200] [59208:62970584] CHIP: [ATM] Max Block Size: 1024
[1636410922200] [59208:62970584] CHIP: [ATM] Length: 0x0000000000000000
disabled: true

- label:
"DUT sends a Block message to TH + TH sends a BlockAck message back to
DUT"
verification:
"1. Verify from the OTA Reference Requester App logs that the Blocks
are sent in ascending and sequential block counter order.
[1636410925203] [59208:62970585] CHIP: [ATM] Block [1636410925203]
[59208:62970585] CHIP: [ATM] Block Counter: 1 [1636410926704]
[59208:62970584] CHIP: [ATM] Block [1636410926704] [59208:62970584]
CHIP: [ATM] Block Counter: 2 and so on"
verification: |
1. Verify from the OTA Reference Requester App logs that the Blocks are sent in ascending and sequential block counter order.
[1636410925203] [59208:62970585] CHIP: [ATM] Block
[1636410925203] [59208:62970585] CHIP: [ATM] Block Counter: 1
[1636410926704] [59208:62970584] CHIP: [ATM] Block
[1636410926704] [59208:62970584] CHIP: [ATM] Block Counter: 2
and so on
disabled: true

- label:
"DUT sends a BlockEOF message to TH + TH sends a BlockAckEOF message
back to DUT"
verification:
"1. Verify that the OTA Reference Requester App logs show BlockEOF
message from DUT [1636410935710] [59208:62970585] CHIP: [ATM] Handling
received BDX Message [1636410935710] [59208:62970585] CHIP: [ATM]
BlockEOF [1636410935710] [59208:62970585] CHIP: [ATM] Block Counter: 8
[1636410935710] [59208:62970585] CHIP: [ATM] Data Length: 147 Compare
with [1636410922200] [59208:62970584] CHIP: [ATM] Handling received
BDX Message [1636410922200] [59208:62970584] CHIP: [ATM] ReceiveAccept
[1636410922200] [59208:62970584] CHIP: [ATM] Transfer Control: 0x20
[1636410922200] [59208:62970584] CHIP: [ATM] Range Control: 0x0
[1636410922200] [59208:62970584] CHIP: [ATM] Max Block Size: 1024
[1636410922200] [59208:62970584] CHIP: [ATM] Length:
0x0000000000000000"
verification: |
1. Verify that the OTA Reference Requester App logs show BlockEOF message from DUT
[1636410935710] [59208:62970585] CHIP: [ATM] Handling received BDX Message
[1636410935710] [59208:62970585] CHIP: [ATM] BlockEOF
[1636410935710] [59208:62970585] CHIP: [ATM] Block Counter: 8
[1636410935710] [59208:62970585] CHIP: [ATM] Data Length: 147
Compare with
[1636410922200] [59208:62970584] CHIP: [ATM] Handling received BDX Message
[1636410922200] [59208:62970584] CHIP: [ATM] ReceiveAccept
[1636410922200] [59208:62970584] CHIP: [ATM] Transfer Control: 0x20
[1636410922200] [59208:62970584] CHIP: [ATM] Range Control: 0x0
[1636410922200] [59208:62970584] CHIP: [ATM] Max Block Size: 1024
[1636410922200] [59208:62970584] CHIP: [ATM] Length: 0x0000000000000000
disabled: true
50 changes: 28 additions & 22 deletions src/app/tests/suites/certification/Test_TC_BDX_2_2.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,37 +24,43 @@ tests:
"IF (PICS_DT_Receiver_Driver) TH sends a SendInit message to DUT + DUT
sends a SendAccept message back to TH + DUT sends a BlockQuery message
to TH + TH sends a Block message back to DUT"
verification:
"1. Verify that the OTA Reference Provider App logs show BlockQuery
message from DUT [1636410922974] [59203:62969336] CHIP: [ATM] Handling
received BDX Message [1636410922974] [59203:62969336] CHIP: [ATM]
BlockQuery [1636410922974] [59203:62969336] CHIP: [ATM] Block Counter:
0"
verification: |
1. Verify that the OTA Reference Provider App logs show BlockQuery message from DUT
[1636410922974] [59203:62969336] CHIP: [ATM] Handling received BDX Message
[1636410922974] [59203:62969336] CHIP: [ATM] BlockQuery
[1636410922974] [59203:62969336] CHIP: [ATM] Block Counter: 0
disabled: true

- label:
"IF (PICS_DT_Receiver_Driver) DUT sends a BlockQuery message to TH +
TH sends a Block message back to DUT"
verification:
"1. Verify from the OTA Reference Provider App logs that the
BlockQuery messages are sent in ascending and sequential block counter
order. [1636410924476] [59203:62969337] CHIP: [ATM] BlockQuery
[1636410924476] [59203:62969337] CHIP: [ATM] Block Counter: 1
verification: |
1. Verify from the OTA Reference Provider App logs that the BlockQuery messages are sent in ascending and sequential block counter order.
[1636410924476] [59203:62969337] CHIP: [ATM] BlockQuery
[1636410924476] [59203:62969337] CHIP: [ATM] Block Counter: 1
[1636410925977] [59203:62969337] CHIP: [ATM] BlockQuery
[1636410925977] [59203:62969337] CHIP: [ATM] Block Counter: 2 and so
on"
[1636410925977] [59203:62969337] CHIP: [ATM] Block Counter: 2
and so on
disabled: true

- label:
"TH sends a BlockEOF message to DUT + DUT sends a BlockAckEOF message
back to TH"
verification:
"1. Verify that the OTA Reference App logs show BlockAckEOF message
from DUT [1636410936486] [59203:62969336] CHIP: [ATM] Handling
received BDX Message [1636410936486] [59203:62969336] CHIP: [ATM]
BlockAckEOF [1636410936486] [59203:62969336] CHIP: [ATM] Block
Counter: 8 Compare with [1636410935209] [59203:62969337] CHIP: [ATM]
Sending BDX Message [1636410935209] [59203:62969337] CHIP: [ATM]
BlockEOF [1636410935209] [59203:62969337] CHIP: [ATM] Block Counter: 8
[1636410935209] [59203:62969337] CHIP: [ATM] Data Length: 147"
verification: |
1. Verify that the OTA Reference App logs show BlockAckEOF message from DUT
[1636410936486] [59203:62969336] CHIP: [ATM] Handling received BDX Message
[1636410936486] [59203:62969336] CHIP: [ATM] BlockAckEOF
[1636410936486] [59203:62969336] CHIP: [ATM] Block Counter: 8
Compare with
[1636410935209] [59203:62969337] CHIP: [ATM] Sending BDX Message
[1636410935209] [59203:62969337] CHIP: [ATM] BlockEOF
[1636410935209] [59203:62969337] CHIP: [ATM] Block Counter: 8
[1636410935209] [59203:62969337] CHIP: [ATM] Data Length: 147
disabled: true
12 changes: 6 additions & 6 deletions src/app/tests/suites/certification/Test_TC_BDX_2_3.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,10 +24,10 @@ tests:
"IF (PICS_DT_Receiver_Driver) TH sends a SendInit message to DUT + DUT
sends a SendAccept message back to TH + DUT sends a BlockQuery message
to TH + TH sends a Block message back to DUT"
verification:
"1. Verify that the OTA Reference Provider App logs show BlockQuery
message from DUT [1636410922974] [59203:62969336] CHIP: [ATM] Handling
received BDX Message [1636410922974] [59203:62969336] CHIP: [ATM]
BlockQuery [1636410922974] [59203:62969336] CHIP: [ATM] Block Counter:
0"
verification: |
1. Verify that the OTA Reference Provider App logs show BlockQuery message from DUT
[1636410922974] [59203:62969336] CHIP: [ATM] Handling received BDX Message
[1636410922974] [59203:62969336] CHIP: [ATM] BlockQuery
[1636410922974] [59203:62969336] CHIP: [ATM] Block Counter: 0
disabled: true
78 changes: 46 additions & 32 deletions src/app/tests/suites/certification/Test_TC_BRAC_2_1.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -21,142 +21,156 @@ config:

tests:
- label: "Commission DUT to TH (can be skipped if done in a preceding test)"
verification: ""
verification: |
disabled: true

- label:
"Use manufacturer provided means (e.g. app) to define groups of
endpoints that can be exposed using the Bridged Actions server cluster
(NOTE if this is not provided, it is assumed the DUT automagically
creates these)"
verification:
"no Matter messages, result will be used in steps 4a and beyond"
verification: |
no Matter messages, result will be used in steps 4a and beyond
disabled: true

- label:
"Use manufacturer provided means (e.g. app) to define available
actions that can be exposed using the Bridged Actions server cluster
(NOTE if this is not provided, it is assumed the DUT automagically
creates these)"
verification:
"no Matter messages, result will be used in steps 5a and beyond"
verification: |
no Matter messages, result will be used in steps 5a and beyond
disabled: true

- label:
"Read PartsList attribute of Descriptor cluster on all endpoints of
the DUT"
verification:
"Read PartsList attribute of Descriptor cluster on all endpoints of
the DUT (start with EP 0 and recursively handle all the EP found in
the PartsList)"
verification: |
Read PartsList attribute of Descriptor cluster on all endpoints of the DUT (start with EP 0 and recursively handle all the EP found in the PartsList)
disabled: true

- label: "Compile a list of all endpoints on the server"
verification: "internal TH: create list of all EP on this server"
verification: |
internal TH: create list of all EP on this server
disabled: true

- label:
"Read EndpointLists attribute of Bridged Actions server and validate
the EndpointListStructs using the following steps"
verification: "Read EndpointLists attribute"
verification: |
Read EndpointLists attribute
disabled: true

- label:
"For each EndpointListStruct, verify that the endpoints in the
Endpoints field are in the list of endpoints of the DUT"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label: "For each EndpointListStruct, verify that the Name is present"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"For each EndpointListStruct, verify that the Type is present and
valid"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"Verify that the EndPointListIDs of all EndpointListStruct are unique
(no duplicates)"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"For each EndpointListStruct, verify Name and Type against the
name/type of each group of endpoints provided by the manufacturers
means"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"Read ActionList attribute of Bridged Actions server and validate the
ActionStructs using the following steps"
verification: "Read ActionList attribute"
verification: |
Read ActionList attribute
disabled: true

- label: "For each ActionStruct, verify the Name is present"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label: "For each ActionStruct, verify the Type is present and valid"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"For each ActionStruct, verify the EndpointListID is present in one of
the EndpointListStructs (see step 4a)"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"For each ActionStruct, verify the SupportedCommands field is present
and valid (at least one bit is set)"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"For each ActionStruct, verify the State field is present and valid"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"Verify that the ActionIDs of all ActionStructs are unique (no
duplicates)"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"For each ActionStruct, verify Name, Type and State against the
name/type/state info for the action provided by the manufacturers
means"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label: "Read SetupURL attribute"
verification: "Read SetupURL attribute"
verification: |
Read SetupURL attribute
disabled: true

- label:
"Verify that its syntax follows the syntax as specified in RFC 3986,
max. 512 ASCII characters"
verification: "no Matter messages, but TH internal checking"
verification: |
no Matter messages, but TH internal checking
disabled: true

- label:
"Verify SetupURL points to a site providing information about the
actions"
verification:
"no Matter messages, but TH internal checking + accessing the URL on
the internet"
verification: |
no Matter messages, but TH internal checking + accessing the URL on the internet
disabled: true

- label:
"Verify SetupURL appended by '?/a=' and the decimal numeric value of
one of the exposed ActionIDs (see step 5a) points to a site providing
information about the action"
verification:
"no Matter messages, but TH internal checking + accessing the URL on
the internet"
verification: |
no Matter messages, but TH internal checking + accessing the URL on the internet
disabled: true
Loading

0 comments on commit 6d27ac3

Please sign in to comment.