Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modified script Aug 16 #21925

Merged
merged 12 commits into from
Aug 16, 2022
Merged

Modified script Aug 16 #21925

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
90bc07f
Modified tests
manjunath-grl Aug 16, 2022
74b462b
Auto generated files
manjunath-grl Aug 16, 2022
9cbe868
Restyled by whitespace
restyled-commits Aug 16, 2022
a8d46d9
Restyled by prettier-json
restyled-commits Aug 16, 2022
6d73771
Restyled by prettier-yaml
restyled-commits Aug 16, 2022
23b10fb
Modified TC-LVL-6.1
manjunath-grl Aug 16, 2022
437e058
Auto generated files
manjunath-grl Aug 16, 2022
2055666
Disabled TC-G-2.1 test from js file
manjunath-grl Aug 16, 2022
8422084
Auto generated files
manjunath-grl Aug 16, 2022
115265f
Disabled test TC-FLABEL-2.1 in darwin json file
manjunath-grl Aug 16, 2022
21a4a6e
Auto generated files
manjunath-grl Aug 16, 2022
547b278
1. Updating top level pics for CADMIN test scripts
kvikrambhat Aug 16, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion examples/darwin-framework-tool/templates/tests/ciTests.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@
"Test_TC_APPLAUNCHER_3_8",
"Test_TC_APPLAUNCHER_3_9",
"Test_TC_BINFO_2_1",
"Test_TC_SWTCH_2_1"
"Test_TC_SWTCH_2_1",
"Test_TC_G_2_1",
"Test_TC_FLABEL_2_1"
]
}
3 changes: 3 additions & 0 deletions src/app/tests/suites/certification/PICS.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1783,6 +1783,9 @@ PICS:
id: LTIME.C.A0000.24HR

#Unit Localization Cluster
- label: "Does the device implement different units of temperature ?"
id: LUNIT.S.F00

- label: "Does the DUT (Server) support TemperatureUnit attribute?"
id: LUNIT.S.A0000

Expand Down
234 changes: 111 additions & 123 deletions src/app/tests/suites/certification/Test_TC_ACL_2_4.yaml
View file
Open in desktop

Large diffs are not rendered by default.

4 changes: 3 additions & 1 deletion src/app/tests/suites/certification/Test_TC_BOOL_2_2.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -66,12 +66,14 @@ tests:
- label: "Set up subscription to StateChange event"
PICS: BOOL.M.ManuallyControlled && BOOL.S.E00 && BOOL.S.A0000
verification: |
Need an SDK implementation required

Run the below command to start interactive mode
./chip-tool interactive start

Subscribe the event using below command in Interactive mode. Once the event occurs, TH(chip-tool) get the subscription message.

booleanstate subscribe-by-id 0x0 1 100 2 1
booleanstate subscribe-event state-change 1 100 1 1 --is-urgent true
disabled: true

- label: "Bring the DUT into a state so StateValue is FALSE"
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_1.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C00.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_10.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_11.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
2 changes: 2 additions & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_12.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C00.Tx
- CADMIN.C.C01.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_13.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
2 changes: 2 additions & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_14.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C01.Tx
- CADMIN.C.C00.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_16.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_17.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C00.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_18.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C01.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_2.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C01.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_20.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_21.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_23.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_4.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ name: 24.1.4. [TC-CADMIN-1.4] Node Behavior using BCM [DUT - Commissionee]

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_6.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ name:

PICS:
- CADMIN.S
- CADMIN.S.F00

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_7.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C00.Tx

config:
nodeId: 0x12344321
Expand Down
1 change: 1 addition & 0 deletions src/app/tests/suites/certification/Test_TC_CADMIN_1_8.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ name:

PICS:
- CADMIN.C
- CADMIN.C.C01.Tx

config:
nodeId: 0x12344321
Expand Down
2 changes: 1 addition & 1 deletion src/app/tests/suites/certification/Test_TC_CC_1_1.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ tests:
type: int16u

- label: "Read the global attribute: FeatureMap"
PICS: (CC.S.F00 || CC.S.F01 || CC.S.F02 || CC.S.F03)
PICS: ( CC.S.F00 || CC.S.F01 || CC.S.F02 || CC.S.F03 )
command: "readAttribute"
attribute: "FeatureMap"
response:
Expand Down
176 changes: 103 additions & 73 deletions src/app/tests/suites/certification/Test_TC_DGWIFI_1_1.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,94 +11,124 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Auto-generated scripts for harness use only, please review before automation. The endpoints and cluster names are currently set to default

name: 3.1.1. [TC-DGWIFI-1.1] Global Attributes [DUT as Server]
name: 53.1.1. [TC-DGWIFI-1.1] Global Attributes [DUT as Server]

PICS:
- DGWIFI.S

config:
nodeId: 0x12344321
cluster: "Basic"
cluster: "WiFi Network Diagnostics"
endpoint: 0

tests:
- label: "Commission DUT to TH"
verification: |
./chip-tool pairing ble-wifi NODEID SSID PASSWD 20202021 3840 (commissioner side)
disabled: true
- label: "Wait for the commissioned device to be retrieved"
cluster: "DelayCommands"
command: "WaitForCommissionee"
arguments:
values:
- name: "nodeId"
value: nodeId

- label: "TH reads the ClusterRevision from DUT"
verification: |
./chip-tool wifinetworkdiagnostics read cluster-revision 1 0

Verify " ClusterRevision " on the TH(Chip-tool) Log:

[1651834623.658618][3910:3916] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_0036 Attribute 0x0000_FFFD DataVersion: 2858283115
[1651834623.658776][3910:3916] CHIP:TOO: ClusterRevision: 1
disabled: true
command: "readAttribute"
attribute: "ClusterRevision"
response:
value: 1
constraints:
type: int16u

- label: "TH reads the FeatureMap from DUT"
verification: |
./chip-tool wifinetworkdiagnostics read feature-map 1 0

Verify " Featuremap " on the TH(Chip-tool) Log:

[1651834671.432383][3919:3924] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_0036 Attribute 0x0000_FFFC DataVersion: 2858283115
[1651834671.432466][3919:3924] CHIP:TOO: FeatureMap: 3
disabled: true

- label: "TH reads AttribubteList from DUT"
verification: |
./chip-tool wifinetworkdiagnostics read attribute-list 1 0

Verify " AttributeList " on the TH(Chip-tool) Log:

[1651834734.844051][3928:3933] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_0036 Attribute 0x0000_FFFB DataVersion: 2858283115
[1651834734.844159][3928:3933] CHIP:TOO: AttributeList: 18 entries
[1651834734.844193][3928:3933] CHIP:TOO: [1]: 0
[1651834734.844218][3928:3933] CHIP:TOO: [2]: 1
[1651834734.844240][3928:3933] CHIP:TOO: [3]: 2
[1651834734.844264][3928:3933] CHIP:TOO: [4]: 3
[1651834734.844287][3928:3933] CHIP:TOO: [5]: 4
[1651834734.844311][3928:3933] CHIP:TOO: [6]: 5
[1651834734.844335][3928:3933] CHIP:TOO: [7]: 6
[1651834734.844358][3928:3933] CHIP:TOO: [8]: 7
[1651834734.844382][3928:3933] CHIP:TOO: [9]: 8
[1651834734.844403][3928:3933] CHIP:TOO: [10]: 9
[1651834734.844427][3928:3933] CHIP:TOO: [11]: 10
[1651834734.844451][3928:3933] CHIP:TOO: [12]: 11
[1651834734.844475][3928:3933] CHIP:TOO: [13]: 12
[1651834734.844499][3928:3933] CHIP:TOO: [14]: 65528
[1651834734.844523][3928:3933] CHIP:TOO: [15]: 65529
[1651834734.844548][3928:3933] CHIP:TOO: [16]: 65531
[1651834734.844571][3928:3933] CHIP:TOO: [17]: 65532
[1651834734.844596][3928:3933] CHIP:TOO: [18]: 65533
disabled: true
PICS: DGWIFI.S.F00 || DGWIFI.S.F01
command: "readAttribute"
attribute: "FeatureMap"
response:
constraints:
type: bitmap32
minValue: 0
maxValue: 3

- label: "TH reads AttributeList from DUT"
command: "readAttribute"
attribute: "AttributeList"
response:
constraints:
type: list
contains: [0, 1, 2, 3, 4, 65528, 65529, 65531, 65532, 65533]

- label:
"TH reads Feature dependent(DGWIFI.S.F00) attributes in attributeList
from DUT"
PICS: DGWIFI.S.F00
command: "readAttribute"
attribute: "AttributeList"
response:
constraints:
type: list
contains: [6, 7, 8, 9, 10]

- label:
"TH reads Feature dependent(DGWIFI.S.F01) attributes in attributeList
from DUT"
PICS: DGWIFI.S.F01
command: "readAttribute"
attribute: "AttributeList"
response:
constraints:
type: list
contains: [5, 12]

- label:
"TH reads optional attribute (CurrentMaxRate) in AttributeList from
DUT"
PICS: DGWIFI.S.A000b
command: "readAttribute"
attribute: "AttributeList"
response:
constraints:
type: list
contains: [11]

- label: "TH reads AcceptedCommandList from DUT"
verification: |
./chip-tool wifinetworkdiagnostics read accepted-command-list 1 0

Verify " AcceptedCommandList " on the TH(Chip-tool) Log:

[1651788161.332422][241228:241233] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_0036 Attribute 0x0000_FFF9 DataVersion: 3097381936
[1651788161.332475][241228:241233] CHIP:TOO: AcceptedCommandList: 1 entries
[1651788161.332500][241228:241233] CHIP:TOO: [1]: 0
disabled: true
PICS: " !DGWIFI.S.F01 "
command: "readAttribute"
attribute: "AcceptedCommandList"
response:
value: []
constraints:
type: list

- label:
"TH reads Feature dependent(DGWIFI.S.F01) command in
AcceptedCommandList from DUT"
PICS: DGWIFI.S.F01
command: "readAttribute"
attribute: "AcceptedCommandList"
response:
constraints:
type: list
contains: [0]

- label: "TH reads GeneratedCommandList from DUT"
verification: |
./chip-tool wifinetworkdiagnostics read generated-command-list 1 0

Verify " GeneratedCommandList " on the TH(Chip-tool) Log:

[1651788208.608429][241239:241244] CHIP:TOO: Endpoint: 0 Cluster: 0x0000_0036 Attribute 0x0000_FFF8 DataVersion: 3097381936
[1651788208.608490][241239:241244] CHIP:TOO: GeneratedCommandList: 0 entries
disabled: true

- label: "TH reads EventList from DUT"
verification: |
(Out of scope for v1.0)
disabled: true
command: "readAttribute"
attribute: "GeneratedCommandList"
response:
value: []
constraints:
type: list
#Commenting out the step EventList attribute which is out of scope for matter V1.0
#- label:
# "Read EventList attribute from the DUT and Verify that the DUT
# response provides a list of supported events."
# verification: |
# Not implemented in chip-tool
# cluster: "LogCommands"
# command: "UserPrompt"
# PICS: PICS_USER_PROMPT
# arguments:
# values:
# - name: "message"
# value: "Please enter 'y' for success"
# - name: "expectedValue"
# value: "y"
Loading