[Support]: Problem in 0.14.0 beta1... frigate stop recording every hour....needds to restart.. #11642
Replies: 4 comments 18 replies
-
|
I hit the same issue. You may need to up the |
Beta Was this translation helpful? Give feedback.
-
|
Where did you up the --pid-limits on docker compose?? The only way I found was using docker update container but after it is started |
Beta Was this translation helpful? Give feedback.
-
|
I don't use compose, but this article should help. https://forums.docker.com/t/how-to-set-docker-compose-pids-limit/127609/3 |
Beta Was this translation helpful? Give feedback.
-
|
this should be improved soon as well #11653 |
Beta Was this translation helpful? Give feedback.
-
|
A quick test shows with this change, the number of used pids is cut in half. Thanks. |
Beta Was this translation helpful? Give feedback.
-
|
Still whith the problem....weird thing is that happens exactly at every hour....I mean, when it is for example 21:00 and a few seconds...it appears bus error.... then restart container...and when it is 22:00 an a few seconds...again....and so on... I did increase shm size, up the --pid-limit.... and the same... |
Beta Was this translation helpful? Give feedback.
-
|
It makes sense because that is when previews are created. We will need a full copy of logs from beginning |
Beta Was this translation helpful? Give feedback.
-
|
When the app freezes, exec into the container and check the number of used pids. I'll bet that hourly spike blows over the max. |
Beta Was this translation helpful? Give feedback.
-
|
Here is full log in one hour, Also notice that only some random cameras appears on frontend and no cameras are recording.... |
Beta Was this translation helpful? Give feedback.
-
|
There are a lot of camera errors, timeouts, and corrupt data so that is likely where the problem is stemming from and id recommend getting that sorted out first. |
Beta Was this translation helpful? Give feedback.
-
|
Yes, but all those errors were also on previous versions...and there was no problem in recording or accesing cameras... |
Beta Was this translation helpful? Give feedback.
-
|
I think I fixed it...but still don´t know the reason... |
Beta Was this translation helpful? Give feedback.
-
|
I'm still having this issue on 0.14.0 beta 3 where at the top of every hour the Python bus error will occur and all cameras stop recording. My shm size is set to 4GB so the bus error should not be happening. |
Beta Was this translation helpful? Give feedback.
-
|
That would be a different issue, we need to see a full set of logs |
Beta Was this translation helpful? Give feedback.
-
|
The Python bus error triggers the recording segments error, but I unfortunately restarted Frigate before collecting the logs. I will do that the next time it happens. The shm filling up at the top of every hour and triggering the cascade of errors seems to now be able to clear itself sometimes, but it still fills up substantially (>1GB). I was able to catch it filling up last hour. |
Beta Was this translation helpful? Give feedback.
-
|
Here's the log of the most recent instance where the shm was unable to be cleared at the top of the hour, which triggers the failure cascade (shm fills up -> Bus error -> recording process fails): |
Beta Was this translation helpful? Give feedback.
-
|
The logs before indicate something isn't working optimally, the streams are failing due to hw being unavailable. |
Beta Was this translation helpful? Give feedback.
-
I will disable the camera in question and see if that has any impact. This is the only camera where transcoding is taking place. |
Beta Was this translation helpful? Give feedback.
-
Describe the problem you are having
Hi, I found this problem with 0.14 beta 1version... like every hour all the cameras are in black with a message "no Frames have received...."
And logs says something about BUS error in python...
I dont know what to change....
Version
0.14.0 beta1
Frigate config file
Relevant log output
FFprobe output from your camera
Frigate stats
n/aOperating system
Debian
Install method
Docker Compose
Coral version
USB
Network connection
Wired
Camera make and model
n/a
Any other information that may be helpful
No response
Beta Was this translation helpful? Give feedback.
All reactions