Upgrading from v13 to v14 and issues with Recordings #15523
Unanswered
android52
asked this question in
General Support
Replies: 4 comments 11 replies
-
|
We need to see the beginning of the error in the logs, this will be the problem |
Beta Was this translation helpful? Give feedback.
5 replies
-
|
Sorry, I thought I had included the entire log, I don't know what happened. This run, no python errors, and no log messages for the last 5+ minutes (logging is still debug, tmp/cache is not updating the mp4s, etc.) Just after copying, the python messages re-appeard, as well as a single "copied" message for each of my cameras, but after another 2 minutes just the one copied mp4 for each camera exist in the recordings folder. |
Beta Was this translation helpful? Give feedback.
-
this means your SHM size is too small |
Beta Was this translation helpful? Give feedback.
-
|
Thank you so much! I calculated the required SHM as only being less than 160 MB, and set it to 256 MB (as you can see from the stats page). I just bumpted it to 512 MB and it seems to be running (getting a consistent stream of files created in the recordings folder). I will monitor for a bit before confirming this as the answer, but looks a lot better than it did 1/2 an hour ago! I'm not sure if I calculated incorrectly (likely) but thought I follwed the documentation page and had lots of buffer. |
Beta Was this translation helpful? Give feedback.
-
|
The documentation is not up to date, the next beta has a new shm system and way to calculate as well due to significant changes to avoid the problem you were seeing. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks, that makes me feel a little better.... Guess I have to look forward to more config changes in the next release - I'm good with that because the system just keeps getting better and better! Thanks to all of you for the tool, the support, and contributing to the community. |
Beta Was this translation helpful? Give feedback.
-
|
In addition to the error logs @NickM-27 requested, there are many optimizations you can/should make for your 0.14 setup, much has changed since 0.13. In no particular order:
|
Beta Was this translation helpful? Give feedback.
4 replies
-
|
Understood that this can be optimized. I've looked at the detect before, and perhaps it changed in v14 (hopefully) but earlier I wanted the snapshots in Home Assistant from and that seemed to be only possible from the Detect stream which is why I was using the high resolution stream for detect. I've assumed that these aren't the issues for the recording failing, even though I know they are impacting CPU, etc. Partly that is why I disabled detect for testing (not in the above logs) with CPU use seemingly increasing when I did that. If these are critical changes for troubleshooting, please advise. |
Beta Was this translation helpful? Give feedback.
-
|
No, not critical. You should increase your SHM size and then look at these optimizations once you have that fixed. |
Beta Was this translation helpful? Give feedback.
-
|
Optimizing is definitely on the "to do" list, but not this weekend. With the higher SHM, CPU seems to be down to around 60% of what it was, already. I'll monitor with the new SHM for a bit before confirming the answer, but since both of you immediately pointed to that, and it seems to have had an immediate effect, I'm sure that will be the solution. |
Beta Was this translation helpful? Give feedback.
-
|
Great. Happy to help. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for the quick and accurate help, things have been running for an hour now and seem to be working perfectly after updating the SHM size. Since the documentation indicated my old values were more than sufficient, I'm not sure how to calculate what it should be, but as mentioned, V15 should require new calculations and have updated documentation. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
So the tmp/cache stopped updating again. I've raised my SHM to 2048 MB now, but it still doesn't seem to want to work. The recordings folder for the recent run/hour has only 1 of 3 cameras in it. The log shows cleanup of the tmp/cache folder from the previous run, and a single copy but not much else, and then some messages about onvif, but I'm not trying to use ONVIF or PTZ functionality The go2rtc log is small but does have a warning about an empty URL I'm switching back to v13 for now, might be able to take a look at any suggestions during the week. Thanks in advance. |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
The ONVIF messages are caused by the latest version of the Frigate card in Home Assistant making calls to the Frigate API to check for ONVIF capabilities. This has been mitigated in Frigate 0.15. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the confirmation on the ONVIF not being the issue. Any idea why even with 2 GB SHM the videos stop recording again, not even making it to the tmp/cache? It seemed to work find for the first hour+ and then stopped. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Describe the problem you are having
I have been trying off and on for a few months to upgrade from v13 to v14 in Docker. I have parallel containers (one for each environment), and directories on my Synology NAS.
While v13 seems to continue to work without issue, I am having problems (particularly with storing recordings) with v14.
I have use the config.yaml from v13 and let the upgrade process convert it, but started with empty db/media, etc. I modified the v14 config.yaml and it seems to have no issues. I was getting recordings in v14 sporadically for a bit but they have completely stopped now.
The following is what I see happening with v14:
I realize that the Troubleshooting page mentions high CPU may be an issue for recordings, but the same CPU usage is being seen with v13. In addition, v14 seems to be using my TPU where v13 does not.
I commented out the "detect" roles to see if this made a difference and noted the following:
I'm not sure where to go from here, everything seems to work fine (occasional hiccups with losing my doorbell camera) on v13, but I can't seem to get this migration to v14 to work out.
Version
0.14.1-f4f3cfa
What browser(s) are you using?
Google Chrome 131.0.6778.140
Frigate config file
Relevant Frigate log output
Relevant go2rtc log output
2024-12-15 21:43:04.054978994 [INFO] Preparing new go2rtc config... 2024-12-15 21:43:04.552825270 [INFO] Not injecting WebRTC candidates into go2rtc config as it has been set manually 2024-12-15 21:43:04.642439297 [INFO] Starting go2rtc... 2024-12-15 21:43:04.864344277 21:43:04.864 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2 2024-12-15 21:43:04.864392783 21:43:04.864 INF config path=/dev/shm/go2rtc.yaml 2024-12-15 21:43:04.864916139 21:43:04.864 INF [api] listen addr=:1984 2024-12-15 21:43:04.865002630 21:43:04.864 INF [rtsp] listen addr=:8554 2024-12-15 21:43:04.865373639 21:43:04.865 INF [webrtc] listen addr=:8555 2024-12-15 21:43:14.040483912 [INFO] Starting go2rtc healthcheck service...FFprobe output from your camera
Frigate stats
{"cameras":{"frontdoorfrig":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":3.1,"capture_pid":438,"detection_enabled":true,"detection_fps":0.0,"ffmpeg_pid":472,"pid":435,"process_fps":3.1,"skipped_fps":0.0},"kitchenwindowfrig":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":2.6,"capture_pid":439,"detection_enabled":true,"detection_fps":16.1,"ffmpeg_pid":442,"pid":436,"process_fps":2.7,"skipped_fps":0.0},"rearwindowfrig":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":3.3,"capture_pid":445,"detection_enabled":true,"detection_fps":22.0,"ffmpeg_pid":469,"pid":437,"process_fps":3.4,"skipped_fps":0.0}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"104":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"0.0","cpu_average":"0","mem":"0.1"},"121":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"123":{"cmdline":"python3 -u -m frigate","cpu":"0.5","cpu_average":"0","mem":"1.8"},"136":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1543":{"cmdline":"sleep 60","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1548":{"cmdline":"sleep 30s","cpu":"0.0","cpu_average":"0","mem":"0.0"},"165":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"166":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"167":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"168":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"169":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"22":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"23":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"302":{"cmdline":"bash ./run.user certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"32":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"33":{"cmdline":"s6-supervise certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"34":{"cmdline":"s6-supervise certsync-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"344":{"cmdline":"frigate.logger ","cpu":"0.1","cpu_average":"0","mem":"0.6"},"35":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"36":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"37":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"38":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"387":{"cmdline":"frigate.recording_manager","cpu":"0.2","cpu_average":"0","mem":"0.8"},"388":{"cmdline":"frigate.review_segment_manager","cpu":"0.0","cpu_average":"0","mem":"0.7"},"39":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"40":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"41":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"415":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(61)","cpu":"0.0","cpu_average":"0","mem":"0.1"},"416":{"cmdline":"frigate.detector.coral","cpu":"0.1","cpu_average":"0","mem":"0.8"},"418":{"cmdline":"frigate.output ","cpu":"0.1","cpu_average":"0","mem":"0.7"},"435":{"cmdline":"frigate.process:frontdoorfrig","cpu":"0.0","cpu_average":"0","mem":"0.9"},"436":{"cmdline":"frigate.process:kitchenwindowfrig","cpu":"0.1","cpu_average":"1","mem":"0.9"},"437":{"cmdline":"frigate.process:rearwindowfrig","cpu":"0.0","cpu_average":"0","mem":"1.0"},"481":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1536x2048 -i pipe: -threads 1 -f mpegts -s 540x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"486":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"491":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 2304x1296 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"496":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"52":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"53":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"93":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"96":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"97":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"98":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"frigate.full_system":{"cpu":"13.6","mem":"26.1"}},"detection_fps":38.1,"detectors":{"coral":{"detection_start":0.0,"inference_speed":9.25,"pid":416}},"gpu_usages":{"error-gpu":{"gpu":"","mem":""}},"processes":{"go2rtc":{"pid":104},"logger":{"pid":344},"recording":{"pid":387},"review_segment":{"pid":388}},"service":{"last_updated":1734299796,"latest_version":"0.14.1","storage":{"/dev/shm":{"free":237.0,"mount_type":"tmpfs","total":256.0,"used":19.0},"/media/frigate/clips":{"free":3064506.0,"mount_type":"btrfs","total":12806284.8,"used":9741778.8},"/media/frigate/recordings":{"free":3064506.0,"mount_type":"btrfs","total":12806284.8,"used":9741778.8},"/tmp/cache":{"free":3064506.0,"mount_type":"btrfs","total":12806284.8,"used":9741778.8}},"temperatures":{},"uptime":806,"version":"0.14.1-f4f3cfa"}}Install method
Docker CLI
docker-compose file or Docker CLI command
No longer have this, use Portainer to copy from previous existing container.Object Detector
Coral
Network connection
Mixed
Camera make and model
EZVIZ (x2), HeimVision
Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpful
No response
Beta Was this translation helpful? Give feedback.
All reactions