Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Semi-automated tests Nov 29 #30733

Merged
merged 5 commits into from
Dec 5, 2023
Merged

Semi-automated tests Nov 29 #30733

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
25c5327
Added new semi-automated tests
manjunath-grl Nov 30, 2023
e0039ba
Auto generated files
manjunath-grl Nov 30, 2023
4017dc5
INVALID_IN_STATE in TCTL-3.2
manjunath-grl Dec 1, 2023
a796e3a
Fix TCTL-3.3 CI failure
manjunath-grl Dec 4, 2023
bfad9c3
Modified CI-pics-value files
manjunath-grl Dec 4, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions examples/darwin-framework-tool/templates/tests/ciTests.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,9 @@
"Test_TC_TCCM_3_3",
"Test_TC_RVCRUNM_3_1",
"Test_TC_TCTL_2_1",
"Test_TC_LWM_3_1",
"Test_TC_LWM_3_2",
"Test_TC_LWM_3_3",
"Disabled because darwin-framework-tool does not support constraints arithmetic operations",
"Test_TC_FLW_2_1",
"Test_TC_RH_2_1",
Expand Down
2 changes: 2 additions & 0 deletions scripts/tests/chiptest/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -184,6 +184,8 @@ def _GetChipReplUnsupportedTests() -> Set[str]:
"Test_TC_DGGEN_2_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_DGGEN_2_3.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_2.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_LWM_3_3.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_G_2_4.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_RVCRUNM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
"Test_TC_RVCCLEANM_3_1.yaml", # chip-repl does not support EqualityCommands pseudo-cluster
Expand Down
313 changes: 116 additions & 197 deletions src/app/tests/suites/certification/Test_TC_LWM_3_2.yaml
View file
Open in desktop

Large diffs are not rendered by default.

342 changes: 122 additions & 220 deletions src/app/tests/suites/certification/Test_TC_LWM_3_3.yaml
View file
Open in desktop

Large diffs are not rendered by default.

179 changes: 98 additions & 81 deletions src/app/tests/suites/certification/Test_TC_REFALM_2_3.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,117 +11,134 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name:
217.2.3. [TC-REFALM-2.3] Local suppression of the door alarm with DUT as
Server

PICS:
- REFALM.S
- REFALM.S.M.LocalSuppress

config:
nodeId: 0x12344321
cluster: "Basic Information"
endpoint: 0
cluster: "Refrigerator Alarm"
endpoint: 1
PIXIT.REFALM.AlarmThreshold:
type: int16u
defaultValue: 5

tests:
- label:
"Step 1: Commission DUT to TH (can be skipped if done in a preceding
test)"
verification: |

disabled: true
cluster: "DelayCommands"
command: "WaitForCommissionee"
arguments:
values:
- name: "nodeId"
value: nodeId

- label: "Step 2: Ensure that the door on the DUT is closed"
verification: |
Ensure that the door on the DUT is closed
disabled: true

- label: "Step 3: TH reads from the DUT the State attribute"
cluster: "LogCommands"
command: "UserPrompt"
PICS: PICS_USER_PROMPT
arguments:
values:
- name: "message"
value: "Please enter 'y' for success"
- name: "expectedValue"
value: "y"

- label: "Step 3:TH reads from the DUT the State attribute"
command: "readAttribute"
attribute: "State"
PICS: REFALM.S.A0002
verification: |
./chip-tool refrigeratoralarm read state 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 0.

[1688447820.603249][4247:4249] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0002 DataVersion: 1795162772
[1688447820.603415][4247:4249] CHIP:TOO: State: 0
[1688447820.603708][4247:4249] CHIP:EM: <<< [E:2198i S:4260 M:156565261 (Ack:46517349)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true

- label: "Step 4: TH reads from the DUT the Mask attribute"
response:
constraints:
type: bitmap32
hasMasksClear: [0x1]

- label: "Step 4:TH reads from the DUT the Mask attribute"
command: "readAttribute"
attribute: "Mask"
PICS: REFALM.S.A0000
verification: |
./chip-tool refrigeratoralarm read mask 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 1.

[1688447677.832882][4229:4231] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0000 DataVersion: 1795162772
[1688447677.833165][4229:4231] CHIP:TOO: Mask: 1
[1688447677.833494][4229:4231] CHIP:EM: <<< [E:27636i S:5449 M:199797248 (Ack:151091416)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true
response:
constraints:
type: bitmap32
hasMasksSet: [0x1]

- label: "Step 5: Manually open the door on the DUT"
verification: |
Manually open the door on the DUT
disabled: true
cluster: "LogCommands"
command: "UserPrompt"
PICS: PICS_USER_PROMPT
arguments:
values:
- name: "message"
value: "Please enter 'y' for success"
- name: "expectedValue"
value: "y"

- label: "Step 6: Wait for the time defined in PIXIT.REFALM.AlarmThreshold"
verification: |
Wait for the time defined in PIXIT.REFALM.AlarmThreshold
disabled: true

- label: "Step 7: TH reads from the DUT the State attribute"
PICS: REFALM.S.A0002
verification: |
./chip-tool refrigeratoralarm read state 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 0.

[1688447820.603249][4247:4249] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0002 DataVersion: 1795162772
[1688447820.603415][4247:4249] CHIP:TOO: State: 1
[1688447820.603708][4247:4249] CHIP:EM: <<< [E:2198i S:4260 M:156565261 (Ack:46517349)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true
cluster: "DelayCommands"
PICS: PICS_USER_PROMPT
command: "WaitForMs"
arguments:
values:
- name: "ms"
value: PIXIT.REFALM.AlarmThreshold * 1000

- label: "Step 7:TH reads from the DUT the State attribute"
command: "readAttribute"
attribute: "State"
PICS: REFALM.S.A0002 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksSet: [0x1]

- label:
"Step 8: Invoke the on DUT sequence to suppress the alarm, do not
close the door"
verification: |
Invoke the on DUT sequence to suppress the alarm, do not close the door
disabled: true

- label: "Step 9: TH reads from the DUT the State attribute"
PICS: REFALM.S.A0002
verification: |
./chip-tool refrigeratoralarm read state 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 0.

[1688447820.603249][4247:4249] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0002 DataVersion: 1795162772
[1688447820.603415][4247:4249] CHIP:TOO: State: 0
[1688447820.603708][4247:4249] CHIP:EM: <<< [E:2198i S:4260 M:156565261 (Ack:46517349)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true

- label: "Step 10: TH reads from the DUT the Mask attribute"
PICS: REFALM.S.A0000
verification: |
./chip-tool refrigeratoralarm read mask 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 1.

[1688447677.832882][4229:4231] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0000 DataVersion: 1795162772
[1688447677.833165][4229:4231] CHIP:TOO: Mask: 0
[1688447677.833494][4229:4231] CHIP:EM: <<< [E:27636i S:5449 M:199797248 (Ack:151091416)] (S) Msg TX to 1:0000000000000001 [10DB] --- Type 0000:10 (SecureChannel:StandaloneAck)
disabled: true

- label: "Step 11: TH reads from the DUT the Supported attribute"
PICS: REFALM.S.A0003
verification: |
./chip-tool refrigeratoralarm read supported 1 1
On TH(chip-tool), Verify that the DUT response contains a 32-bit value with bit 0 set to 1.

[1689677642.708638][18413:18415] CHIP:DMG: SuppressResponse = true,
[1689677642.708645][18413:18415] CHIP:DMG: InteractionModelRevision = 1
[1689677642.708651][18413:18415] CHIP:DMG: }
[1689677642.708726][18413:18415] CHIP:TOO: Endpoint: 1 Cluster: 0x0000_0057 Attribute 0x0000_0003 DataVersion: 1517282962
[1689677642.708773][18413:18415] CHIP:TOO: Supported: 1
[1689677642.708845][18413:18415] CHIP:EM: <<< [E:32432i S:53289 M:29829407 (Ack:142651059)] (S) Msg TX to 1:0000000000000001 [BFDE] --- Type 0000:10 (SecureChannel:StandaloneAck)
[1689677642.708859][18413:18415] CHIP:IN: (S) Sending msg 29829407 on secure session with LSID: 53289
[1689677642.708900][18413:18415] CHIP:EM: Flushed pending ack for MessageCounter:142651059 on exchange 32432i
disabled: true
cluster: "LogCommands"
command: "UserPrompt"
PICS: PICS_USER_PROMPT
arguments:
values:
- name: "message"
value: "Please enter 'y' for success"
- name: "expectedValue"
value: "y"

- label: "Step 9:TH reads from the DUT the State attribute"
command: "readAttribute"
attribute: "State"
PICS: REFALM.S.A0002 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksClear: [0x1]

- label: "Step 10:TH reads from the DUT the Mask attribute"
command: "readAttribute"
attribute: "Mask"
PICS: REFALM.S.A0000 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksClear: [0x1]

- label: "Step 11:TH reads from the DUT the Supported attribute"
command: "readAttribute"
attribute: "Supported"
PICS: REFALM.S.A0003 && PICS_USER_PROMPT
response:
constraints:
type: bitmap32
hasMasksSet: [0x1]
Loading
Loading