[Support]: Enabling go2rtc causes constant "Unable to keep up with" errors in logs. #15354
Unanswered
baylf2000
asked this question in
General Support
Replies: 9 comments 9 replies
-
|
Maybe not related to your specific problem but you should fix this first and check again.
And you define your main streams in the go2rtc section, but you do not use them in the cameras.
|
Beta Was this translation helpful? Give feedback.
0 replies
-
|
@banthungprong Thank you. I can't really see how either of those issues would lead to the errors I'm experiencing, however I changed the config as you indicated. Unfortunately I did nothing to solve the errors. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
To see if the processor was the issue, I transferred my setup to a new, bare metal Ryzen 7 machine with 64GB of RAM, and new pcie 4.0 nvme drive and Ubuntu, 24.04, using the same Coral USB device for detection. The same errors appeared immediately. So it doesn't seem to be related to the N100 hardware. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
The |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
@hawkeye217 Here's the latest log from the new machine. |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
Did you make the changes to your docker compose file that @banthungprong suggested befire setting up Frigate on your new machine? |
Beta Was this translation helpful? Give feedback.
-
Yes, I made the changes as suggested. I changed: to: And I changed the recording stream for each camera to the go2rtc streams instead of the cameras, but the errors were the same. |
Beta Was this translation helpful? Give feedback.
-
|
Maybe you could try to change the hwaccels to qsv. I just did this for all my cameras. I saw a few posts here and after changing that the error was gone. With 0.15.x you can and should switch to preset-qsv-h264/h265 from preset-vaapi where possible for each camera |
Beta Was this translation helpful? Give feedback.
4 replies
-
|
Thanks again for the suggestions. That was actually one of the first things I tried on the old N100 machine. All four cameras are using H264, and used the option: The new machine uses an AMD processor so it can't use qsv. |
Beta Was this translation helpful? Give feedback.
-
|
I might help if you post a description of your used hardware, your cameras, configs in advance. In your first post you write N100, thats not AMD. |
Beta Was this translation helpful? Give feedback.
-
|
Sorry, the AMD machine is not really relevant. As I said, I tried using qsv on the N100 and it made no difference. |
Beta Was this translation helpful? Give feedback.
-
|
All the relevant hardware and configs have already been posted in great detail. |
Beta Was this translation helpful? Give feedback.
-
|
A further update. Frigate is back on the bare metal N100, but go2rtc is instead running standalone on a remote machine. The Frigate config is now as follows: Error messages continue: |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
let's see a screenshot of the system and camera metrics pages |
Beta Was this translation helpful? Give feedback.
-
|
They are already included above. |
Beta Was this translation helpful? Give feedback.
-
|
very odd, there is no indication of anything for why the recordings would be considered falling behind. When you are seeing this issue can you get a shell in the container and run |
Beta Was this translation helpful? Give feedback.
-
|
I tried adding the low-quality detect streams to go2rtc, and using those in the Frigate config instead of the direct camera links, but the errors are the same. So, to summarize, it seems that any time my frigate pulls from go2rtc for either the record or detect streams, or the local go2rtc is configured to use direct camera streams, then those error occur. If detect and record only pull directly from the cameras, and there is no go2rtc config, then the errors disappear. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
So I reset my original N100 back to the original config on V0.14, and the errors are gone. I guess I'll have to do without webRTC for the time being. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Describe the problem you are having
I'm a long time user of Frigate. I have a fairly basic setup. A bare-metal N100 with 8GB of RAM, a 1TB NVME SSD. and a USB Coral, connected with Home Assistant running on another machine. I have detections enabled on all four cameras.
Recently I enabled go2rtc due to the Home Assistant update. Since then I have noticed fairly constant error messages in the log files.
If I remove the go2rtc config again the errors stop.
The errors all look like this:
Unable to keep up with recording segments in cache for driveway. Keeping the 6 most recent segments out of 7 and discarding the rest...I've tried the basic troubleshooting at https://docs.frigate.video/troubleshooting/recordings/. I added the debug config as suggested, and it returns well within the tolerances it recommends. The longest copied time I could see was
0.1seconds.I've added the additional options to the docker file that it suggests regarding swapiness, but that doesn't seem to have made any difference.
My CPU usage on the machine usually sits around 10-12% on all four cores, and RAM usage is about 1.4GB out of 8GB.
I've also upgraded from stable to 0.15beta2 to see if that helps, but it does not.
I'd really appreciate any suggestions as to where I could start looking. I'd really like to keep the go2rtc config enabled as it looks so much better in the app and in home assistant.
Version
What browser(s) are you using?
No response
Frigate config file
Relevant Frigate log output
Relevant go2rtc log output
No errors in gortc log output.FFprobe output from your camera
[{"return_code":0,"stderr":"","stdout":{"programs":[],"stream_groups":[],"streams":[{"codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","width":1920,"height":1080,"avg_frame_rate":"15/1"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"stream_groups":[],"streams":[{"codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","width":640,"height":480,"avg_frame_rate":"5/1"}]}}]Frigate stats
{"cameras":{"driveway":{"camera_fps":5.0,"process_fps":5.1,"skipped_fps":0.0,"detection_fps":13.4,"detection_enabled":true,"pid":467,"capture_pid":521,"ffmpeg_pid":530,"audio_rms":0.0,"audio_dBFS":0.0},"front_door":{"camera_fps":5.0,"process_fps":5.1,"skipped_fps":0.0,"detection_fps":4.0,"detection_enabled":true,"pid":470,"capture_pid":532,"ffmpeg_pid":540,"audio_rms":0.0,"audio_dBFS":0.0},"backyard":{"camera_fps":5.1,"process_fps":5.1,"skipped_fps":0.0,"detection_fps":1.6,"detection_enabled":true,"pid":472,"capture_pid":548,"ffmpeg_pid":551,"audio_rms":0.0,"audio_dBFS":0.0},"front_courtyard":{"camera_fps":5.1,"process_fps":5.1,"skipped_fps":0.0,"detection_fps":6.4,"detection_enabled":true,"pid":476,"capture_pid":552,"ffmpeg_pid":562,"audio_rms":0.0,"audio_dBFS":0.0}},"detectors":{"coral":{"inference_speed":9.23,"detection_start":0.0,"pid":434}},"detection_fps":25.4,"gpu_usages":{"intel-vaapi":{"gpu":"0.25%","mem":"-%"}},"cpu_usages":{"frigate.full_system":{"cpu":"0.0","mem":"22.2"},"1":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service"},"15":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise s6-linux-init-shutdownd"},"16":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B"},"24":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise nginx"},"25":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise s6rc-oneshot-runner"},"26":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise nginx-log"},"27":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise frigate"},"28":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise go2rtc-healthcheck"},"29":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise certsync"},"30":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise s6rc-fdholder"},"31":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise go2rtc"},"32":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise go2rtc-log"},"33":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise certsync-log"},"34":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-supervise frigate-log"},"45":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules"},"46":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --"},"84":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx"},"88":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate"},"89":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc"},"90":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/certsync"},"98":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml"},"118":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"bash ./run.user go2rtc-healthcheck"},"119":{"cpu":"3.0","cpu_average":"7","mem":"3.5","cmdline":"python3 -u -m frigate"},"130":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"nginx: master process nginx"},"157":{"cpu":"0.0","cpu_average":"0","mem":"0.1","cmdline":"nginx: worker process"},"158":{"cpu":"0.0","cpu_average":"0","mem":"0.1","cmdline":"nginx: worker process"},"159":{"cpu":"0.0","cpu_average":"0","mem":"0.1","cmdline":"nginx: worker process"},"160":{"cpu":"0.0","cpu_average":"0","mem":"0.1","cmdline":"nginx: worker process"},"161":{"cpu":"0.0","cpu_average":"0","mem":"0.1","cmdline":"nginx: cache manager process"},"162":{"cpu":"0.0","cpu_average":"0","mem":"0.1","cmdline":"nginx: cache loader process"},"272":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"bash ./run.user certsync"},"322":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"sleep 60"},"418":{"cpu":"1.4","cpu_average":"0","mem":"2.4","cmdline":"frigate.recording_manager"},"426":{"cpu":"0.6","cpu_average":"0","mem":"2.2","cmdline":"frigate.review_segment_manager"},"434":{"cpu":"18.6","cpu_average":"16","mem":"2.4","cmdline":"frigate.detector.coral"},"453":{"cpu":"5.3","cpu_average":"4","mem":"2.3","cmdline":"frigate.output "},"467":{"cpu":"8.4","cpu_average":"4","mem":"2.4","cmdline":"frigate.process:driveway"},"470":{"cpu":"4.0","cpu_average":"0","mem":"2.4","cmdline":"frigate.process:front_door"},"472":{"cpu":"3.3","cpu_average":"0","mem":"2.4","cmdline":"frigate.process:backyard"},"475":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x480 -i pipe: -threads 1 -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:"},"476":{"cpu":"4.8","cpu_average":"0","mem":"2.4","cmdline":"frigate.process:front_courtyard"},"502":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x480 -i pipe: -threads 1 -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:"},"513":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x480 -i pipe: -threads 1 -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:"},"520":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x480 -i pipe: -threads 1 -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:"},"521":{"cpu":"0.9","cpu_average":"0","mem":"2.4","cmdline":"frigate.capture:driveway"},"530":{"cpu":"1.7","cpu_average":"0","mem":"0.7","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.104:554/stream2 -r 5 -vf fps=5,scale_vaapi=w=640:h=480,hwdownload,format=nv12,eq=gamma=1.4:gamma_weight=0.5 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"},"531":{"cpu":"0.0","cpu_average":"0","mem":"0.2","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:"},"532":{"cpu":"1.1","cpu_average":"0","mem":"2.3","cmdline":"frigate.capture:front_door"},"540":{"cpu":"2.3","cpu_average":"0","mem":"0.7","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.106:554/stream2 -r 5 -vf fps=5,scale_vaapi=w=640:h=480,hwdownload,format=nv12,eq=gamma=1.4:gamma_weight=0.5 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"},"541":{"cpu":"0.8","cpu_average":"0","mem":"0.4","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.104:554/stream1 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/driveway@%Y%m%d%H%M%S%z.mp4"},"546":{"cpu":"0.8","cpu_average":"0","mem":"0.4","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.106:554/stream1 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/front_door@%Y%m%d%H%M%S%z.mp4"},"548":{"cpu":"1.1","cpu_average":"0","mem":"2.4","cmdline":"frigate.capture:backyard"},"551":{"cpu":"2.3","cpu_average":"0","mem":"0.6","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.103:554/stream2 -r 5 -vf fps=5,scale_vaapi=w=640:h=480,hwdownload,format=nv12,eq=gamma=1.4:gamma_weight=0.5 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"},"552":{"cpu":"0.9","cpu_average":"0","mem":"2.4","cmdline":"frigate.capture:front_courtyard"},"562":{"cpu":"2.2","cpu_average":"0","mem":"0.7","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.105:554/stream2 -r 5 -vf fps=5,scale_vaapi=w=640:h=480,hwdownload,format=nv12,eq=gamma=1.4:gamma_weight=0.5 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:"},"563":{"cpu":"0.8","cpu_average":"0","mem":"0.4","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.103:554/stream1 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/backyard@%Y%m%d%H%M%S%z.mp4"},"566":{"cpu":"0.9","cpu_average":"0","mem":"0.3","cmdline":"/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.15.0-e76f4e9 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.4.105:554/stream1 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/front_courtyard@%Y%m%d%H%M%S%z.mp4"},"673":{"cpu":"0.0","cpu_average":"0","mem":"0.0","cmdline":"sleep 30s"}},"service":{"uptime":25,"version":"0.15.0-e76f4e9","latest_version":"0.14.1","storage":{"/media/frigate/recordings":{"total":237813.4,"used":52799.2,"free":172862.8,"mount_type":"ext4"},"/media/frigate/clips":{"total":237813.4,"used":52799.2,"free":172862.8,"mount_type":"ext4"},"/tmp/cache":{"total":953.7,"used":17.4,"free":936.3,"mount_type":"tmpfs"},"/dev/shm":{"total":1024.0,"used":220.3,"free":803.7,"mount_type":"tmpfs"}},"temperatures":{},"last_updated":1733385862},"processes":{"recording":{"pid":418},"review_segment":{"pid":426},"go2rtc":{"pid":98}}}Install method
Docker Compose
docker-compose file or Docker CLI command
Object Detector
Coral
Network connection
Wired
Camera make and model
TP-Link
Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpful
No response
Beta Was this translation helpful? Give feedback.
All reactions