Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Build] Darwin python parser no-ble-tsan failing #27524

Closed
woody-apple opened this issue Jun 28, 2023 · 6 comments · Fixed by #27674
Closed

[Build] Darwin python parser no-ble-tsan failing #27524

woody-apple opened this issue Jun 28, 2023 · 6 comments · Fixed by #27674
Assignees
@bzbarsky-apple @jtung-apple
Labels
build issue darwin

Comments

@woody-apple
Copy link
Contributor

Build issue(s)

https://github.com/project-chip/connectedhomeip/actions/runs/5398386504/jobs/9804137158?pr=27516

ERROR   08:39:54.460 - TEST OUT  : 		    [IN] (U) Sending msg 6874998 to IP address 'UDP:[fd00:0:1:1::3]:5540'
ERROR   08:39:54.460 - TEST OUT  : 		    [SC] Sent Sigma1 msg
ERROR   08:39:54.460 - TEST OUT  : 		    [DIS] OperationalSessionSetup[1:0000000012344321]: State change 3 --> 4
ERROR   08:39:54.460 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.460 - TEST OUT  : 		    [EM] Retransmitting MessageCounter:6874998 on exchange 3292i Send Cnt 1
ERROR   08:39:54.460 - TEST OUT  : 		    [IN] (U) Sending msg 6874998 to IP address 'UDP:[fd00:0:1:1::3]:5540'
ERROR   08:39:54.460 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.460 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.460 - TEST OUT  : 		    [EM] Retransmitting MessageCounter:6874998 on exchange 3292i Send Cnt 2
ERROR   08:39:54.460 - TEST OUT  : 		    [IN] (U) Sending msg 6874998 to IP address 'UDP:[fd00:0:1:1::3]:5540'
ERROR   08:39:54.460 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.460 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.460 - TEST OUT  : 		    [EM] Retransmitting MessageCounter:6874998 on exchange 3292i Send Cnt 3
ERROR   08:39:54.461 - TEST OUT  : 		    [IN] (U) Sending msg 6874998 to IP address 'UDP:[fd00:0:1:1::3]:5540'
ERROR   08:39:54.461 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.461 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.461 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.461 - TEST OUT  : 		    [EM] Retransmitting MessageCounter:6874998 on exchange 3292i Send Cnt 4
ERROR   08:39:54.461 - TEST OUT  : 		    [IN] (U) Sending msg 6874998 to IP address 'UDP:[fd00:0:1:1::3]:5540'
ERROR   08:39:54.461 - TEST OUT  : 		    [DIS] Failed to parse mDNS query
ERROR   08:39:54.461 - TEST OUT  : 		    [EM] Failed to Send CHIP MessageCounter:6874998 on exchange 3292i sendCount: 4 max retries: 4
ERROR   08:39:54.461 - TEST OUT  : 		    [SC] CASESession timed out while waiting for a response from the peer. Current state was 1
ERROR   08:39:54.461 - TEST OUT  : 		    [IN] SecureSession[0x7b3c000078f0]: Released - Type:2 LSID:63073
ERROR   08:39:54.461 - TEST OUT  : 		    [DIS] OperationalSessionSetup[1:0000000012344321]: State change 4 --> 2
ERROR   08:39:54.461 - TEST OUT  : 		    [DIS] OperationalSessionSetup[1:0000000012344321]: State change 2 --> 1
ERROR   08:39:54.462 - TEST OUT  : 		    [-] src/protocols/secure_channel/CASESession.cpp:493: CHIP Error 0x00000032: Timeout at ../../examples/chip-tool/commands/delay/WaitForCommissioneeCommand.cpp:46
ERROR   08:39:54.462 - TEST OUT  : 		    [TOO] Run command failure: src/protocols/secure_channel/CASESession.cpp:493: CHIP Error 0x00000032: Timeout
ERROR   08:39:54.462 - TEST OUT  : 		    Expected: [
ERROR   08:39:54.462 - TEST OUT  : 		                {
ERROR   08:39:54.462 - TEST OUT  : 		                  "values": [
ERROR   08:39:54.462 - TEST OUT  : 		                    {}
ERROR   08:39:54.462 - TEST OUT  : 		                  ]
ERROR   08:39:54.462 - TEST OUT  : 		                }
ERROR   08:39:54.462 - TEST OUT  : 		              ]
ERROR   08:39:54.462 - TEST OUT  : 		    Received: [
ERROR   08:39:54.462 - TEST OUT  : 		                 {
ERROR   08:39:54.462 - TEST OUT  : 		                   "error": "FAILURE"
ERROR   08:39:54.462 - TEST OUT  : 		                 }
ERROR   08:39:54.462 - TEST OUT  : 		               ]
ERROR   08:39:54.462 - TEST OUT  : 		***** Test Failure : The test expects no error but the "FAILURE" error occured.
ERROR   08:39:54.462 - TEST OUT  : 		**** Test Setup: Device Connection Failure [deviceId=305414945. Error The test expects no error but the "FAILURE" error occured.]
ERROR   08:39:54.463 - TEST OUT  : ✗ Test finished in 6461ms with 0 success, 1 errors and 0 warnings
ERROR   ================ CAPTURED LOG END ====================
ERROR   TestSelfFabricRemoval          - FAILED in 9.78 seconds
Traceback (most recent call last):
  File "/__w/connectedhomeip/connectedhomeip/./scripts/tests/run_test_suite.py", line 344, in cmd_run
    test.Run(
  File "/__w/connectedhomeip/connectedhomeip/scripts/tests/chiptest/test_definition.py", line 340, in Run
    runner.RunSubprocess(
  File "/__w/connectedhomeip/connectedhomeip/scripts/tests/chiptest/runner.py", line 167, in RunSubprocess
    raise Exception('Command %r failed: %d' % (cmd, s.returncode))
Exception: Command ['ip', 'netns', 'exec', 'tool', 'python3', '/__w/connectedhomeip/connectedhomeip/scripts/tests/yaml/chiptool.py', 'tests', 'TestSelfFabricRemoval', '--PICS', 'src/app/tests/suites/certification/ci-pics-values', '--server_path', './out/linux-x64-chip-tool-no-ble-tsan-clang/chip-tool', '--server_arguments', 'interactive server --storage-directory /tmp/tmphgafbthn'] failed: 1
Error: Process completed with exit code 2.

Platform

No response

Anything else?

No response
@woody-apple
Copy link
Contributor Author

Another here: https://github.com/project-chip/connectedhomeip/actions/runs/5398386504/jobs/9804137158?pr=27516

@woody-apple woody-apple changed the title [Build] Linux test suite failure [Build] test suite failure Jun 28, 2023
@woody-apple
Copy link
Contributor Author

Running Wait for the commissioned device to be retrieved is timing out

@bzbarsky-apple
Copy link
Contributor

chip-tool sends Sigma1 to device, device sends Sigma2 back:

ERROR   08:39:48.231 - APP  OUT  : CHIP:EM: <<< [E:3292r S:0 M:236022182 (Ack:6874998)] (U) Msg TX to 0:0000000000000000 [0000] --- Type 0000:31 (SecureChannel:CASE_Sigma2)
ERROR   08:39:48.231 - APP  OUT  : CHIP:IN: (U) Sending msg 236022182 to IP address 'UDP:[fd00:0:1:1::2%eth-app]:37979'

but chip-tool never gets that Sigma2. It keeps retransmitting the Sigma1, device keeps acking, chip-tool never gets any of the acks. Eventually both run out of MRP retries and give up.

This part all worked fine at the end of commissioning earlier in the test, though that was a different chip-tool instance running on a different local port.... but the IPs were all the same.

@woody-apple
Copy link
Contributor Author

https://github.com/project-chip/connectedhomeip/actions/runs/5403870057/jobs/9817290510
https://github.com/project-chip/connectedhomeip/actions/runs/5403976009/jobs/9817540869

@woody-apple woody-apple changed the title [Build] test suite failure [Build] test suite failure - packets going missing Jun 28, 2023
@bzbarsky-apple bzbarsky-apple mentioned this issue Jul 6, 2023
Closed
@woody-apple
Copy link
Contributor Author

Escalated here: https://support.github.com/ticket/personal/0/2240190

@woody-apple woody-apple changed the title [Build] test suite failure - packets going missing [Build] Darwin python parser no-ble-tsan failing Jul 6, 2023
@woody-apple
Copy link
Contributor Author

https://github.com/project-chip/connectedhomeip/actions/runs/5471128459/jobs/9961958585#logs
https://github.com/project-chip/connectedhomeip/actions/runs/5467947144/jobs/9954929582
https://github.com/project-chip/connectedhomeip/actions/runs/5465839678/jobs/9949886784
https://github.com/project-chip/connectedhomeip/actions/runs/5465306649/jobs/9948563815
https://github.com/project-chip/connectedhomeip/actions/runs/5464784980/jobs/9947297255
https://github.com/project-chip/connectedhomeip/actions/runs/5464288218

This was referenced Jul 6, 2023
Closed
Merged
@woody-apple woody-apple linked a pull request Jul 6, 2023 that will close this issue
Disabling broken tests for now #27674
Merged
@github-project-automation github-project-automation bot moved this from Todo to Done in [Build] Build Issues Jul 6, 2023
@github-project-automation github-project-automation bot moved this from Todo to Done in [Platform] Darwin Jul 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bzbarsky-apple bzbarsky-apple

@jtung-apple jtung-apple

Labels
build issue darwin
Projects
[Build] Build Issues
Archived in project
[Platform] Darwin
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Disabling broken tests for now woody-apple/connectedhomeip
3 participants
@woody-apple @bzbarsky-apple @jtung-apple