HomeKit integration 2024.8/8.2 Aqara FP2 PS connectivity issue (some presence events not relayed to HA)

[Mustreg]

The problem

My initial issue (integration completetly forezen wihout any indication in the sensor status in HA) with FP2 after upgrading to 2024.8 was resolved by @bdraco with introducing the new #123601 connection polling mechanism in 2024.8.2
My initial issue:
#123412 (comment)

Unfortunately, there is still something very wrong with HA HomeKit controller FP2 integration after 2024.8 upgrade (including 2024.82 fix).
The HA HomeKit controller integration intermittently fails to relay many presence events (especially those that last less than 30 seconds) from Aqara FP2 Presence Sensor to HA. The events are registered 100% accurately in Aqara App (so there is no problem with the FP2 presence sensor itself), however, they are not listed in HA FP2 presense event/trigger sensor log (completely missed as if they never happened). Please see the attached image.

• This makes the presence detection very unreliable and renders the related automations unusable.
• Please note that those automations had worked flawlessly for over 12 months prior to 2024.8/8.2 upgrades. No other changes were made to the FP2 configuration over the last few weeks, just the HA 2024.7.4=>2024.8/8.2 upgrades.

My initial brainstorming thoughts (maybe completely irrelevant) on the problem:

1. Could it be that the HA HomeKit controller-to-FP2 communication still freezes in a stealthy manner for certain periods (some seconds) and the presence events which occur during those "freeze" time windows are not relayed by HA HomeKit integration into HA?
2. Could it be that the new polling mechanisms interferes somehow with the communication so some of the events are missed by HA if they happen at the same time as the polling?"

What version of Home Assistant Core has the issue?

core-2024.8.2

What was the last working version of Home Assistant Core?

2024.7.4

What type of installation are you running?

Home Assistant OS

Integration causing the issue

HomeKit Controller

Link to integration documentation on our website

https://www.home-assistant.io/integrations/homekit_controller/

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

2024-08-24 16:37:01.590 DEBUG (MainThread) [aiohomekit.controller.abstract] callback ev:{(1, 2674): {'value': 158}}
2024-08-24 16:37:01.590 DEBUG (MainThread) [homeassistant.components.homekit_controller.connection] Called async_set_available_state with True for F1:A2:54:9F:E5:19
2024-08-24 16:37:56.257 DEBUG (MainThread) [homeassistant.components.homekit_controller.connection] Accessory is reachable, limiting poll to firmware version: F1:A2:54:9F:E5:19
2024-08-24 16:37:56.257 DEBUG (MainThread) [homeassistant.components.homekit_controller.connection] Starting HomeKit device update: F1:A2:54:9F:E5:19
2024-08-24 16:37:56.257 DEBUG (MainThread) [aiohomekit.controller.ip.connection] 192.168.178.103: raw request: b'GET /characteristics?id=1.7 HTTP/1.1\r\nHost: 192.168.178.103\r\n\r\n'
2024-08-24 16:37:56.278 DEBUG (MainThread) [aiohomekit.controller.ip.connection] 192.168.178.103: raw response: bytearray(b'{"characteristics":[{"aid":1,"iid":7,"value":"1.2.7"}]}')
2024-08-24 16:37:56.278 DEBUG (MainThread) [homeassistant.components.homekit_controller.connection] Called async_set_available_state with True for F1:A2:54:9F:E5:19
2024-08-24 16:37:56.278 DEBUG (MainThread) [homeassistant.components.homekit_controller.connection] Finished HomeKit device update: F1:A2:54:9F:E5:19
2024-08-24 16:37:56.758 DEBUG (MainThread) [aiohomekit.zeroconf] f1:a2:54:9f:e5:19: Notifying pairing of description update: HomeKitService(name='Presence-Sensor-FP2-EDE5', id='f1:a2:54:9f:e5:19', model='PS-S02D', feature_flags=<FeatureFlags.SUPPORTS_SOFTWARE_AUTHENTICATION: 2>, status_flags=<StatusFlags: 0>, config_num=5, state_num=1448, category=<Categories.SENSOR: 10>, protocol_version='1.1', type='_hap._tcp.local.', address='192.168.178.103', addresses=['192.168.178.103'], port=60761)

Additional information

No response

[home-assistant]

Hey there @Jc2k, @bdraco, mind taking a look at this issue as it has been labeled with an integration (homekit_controller) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of homekit_controller can trigger bot actions by commenting:

• @home-assistant close Closes the issue.
• @home-assistant rename Awesome new title Renames the issue.
• @home-assistant reopen Reopen the issue.
• @home-assistant unassign homekit_controller Removes the current integration label and assignees on the issue, add the integration domain after the command.
• @home-assistant add-label needs-more-information Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue.
• @home-assistant remove-label needs-more-information Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

_{^{(message by CodeOwnersMention)}}

---

homekit_controller documentation
homekit_controller source
_{^{(message by IssueLinks)}}

[bdraco]

Maybe the connection is dropping and its not reconnecting? I guess its also possible that the HomeKit firmware is a bit broken and it doesn't always send events and previously relied on polling being lucky enough to catch them. Its hard to tell without a full log though. Is it any better with 2024.8.3?

Please follow the troubleshooting steps to provide full debug logs.

https://www.home-assistant.io/docs/configuration/troubleshooting/#enabling-debug-logging

[Mustreg]

Thank you for your reply.

I will now update to 2024.8.3 and provide the HA HomeKit Controller full debug log after it runs for some time with 8.3 version.

[raphael1688]

Still happens intermittently in CORE 9.1.
My workaround is doing “Home Assistant Core Integration: Reload config entry” to the homekit controller of the FP2 via schedule automation.

[moorecp]

Still happens intermittently in CORE 9.1. My workaround is doing “Home Assistant Core Integration: Reload config entry” to the homekit controller of the FP2 via schedule automation.

I'm having this issue as well. How did you find the appropriate config ID for that config entry as the Homekit controller isn't an entity itself.

[Mustreg]

I am significantly confident that the current (2024.8-2024.9.1) HA HomeKit controller FP2 integration is causing various presence detection issues for the device in HA. Unfortunately, the issues have become so erratic and intermittent that it's very difficult to prove it.
Still hoping to identify some concrete patterns…

[raphael1688]

Still happens intermittently in CORE 9.1. My workaround is doing “Home Assistant Core Integration: Reload config entry” to the homekit controller of the FP2 via schedule automation.

I'm having this issue as well. How did you find the appropriate config ID for that config entry as the Homekit controller isn't an entity itself.

Select any entity in this device,and put it in "{{ configu_entry_id('ENTITIY_NAME') }}", then you can get the corresponding homekit device entity id.

[raphael1688]

I am significantly confident that the current (2024.8-2024.9.1) HA HomeKit controller FP2 integration is causing various presence detection issues for the device in HA. Unfortunately, the issues have become so erratic and intermittent that it's very difficult to prove it.

Still hoping to identify some concrete patterns…

It doesn't work for either doing reloading homekit device periodically for restting connection or pressing identity button for keeping connection alive.

It's getting worse and I'm considering to downgrade back to CORE 7.4.

[raphael1688]

It’s works more reliable to disabling polling for update in the fp2 homekit controller when I added the 10th FP2 in CORE 7.4.
Then I upgraded to 10.2 and works fine.

[Chris112]

I had a lot of issues with my Aqara FP2 sensors via Homekit and had to restart the integration with an automation every 15 mins but after todays firmware update to version 1.2.8, it's been working flawlessly like it did a few months ago.

[Varione47]

After the firmware update to 1.2.8, the situation improved, but for the past two days, the FP2 integration occasionally fails to return any events, even though the sensor functions correctly via the Aqara App. I have set up an automation to restart the integration daily.

[blackadar]

I am experiencing this issue, even after upgrading the FP2 firmware to 1.2.8. Reloading the HomeKit device integration immediately solves the problem temporarily.

[Thorsten1982]

I sometimes have the same problem, but it usually only occurs with one presence detector. I just installed the new firmware on 1.3... maybe this will improve things

[mogim0gi]

i have same issue ever since istalling them.

tried also adding it to HA through smartthings, but it lacks zone presence reporting and its a deal breaker for me.