[Support]: High CPU use and Ffmpeg chrashes "Unable to keep up with recording segments in cache for camera" #13486

Emmett9845 · 2024-09-01T15:24:32Z

Emmett9845
Sep 1, 2024

Describe the problem you are having

since switching to v0.14, frigate will only run for a few hours before cameras start crashing. it appears that my CPU usage is always maxed out. It is an older machine (Intel i7 CPU 950 @ 3.07GHz) that doesn't have hardware acceleration, so I wouldn't be surprised if it's a hardware issue. But I also don't have a ton of confidence in my configurations. everything ran well before I upgraded to 0.14.

I attempted to follow the troubleshooting recordings guide for this error (https://docs.frigate.video/troubleshooting/recordings/), but I'm in over my head.

Version

0.14.1

What browser(s) are you using?

Google Chrome 127.0.6533.132

Frigate config file

ui:
  time_format: browser
  date_style: short
  time_style: medium

logger:
  logs:
    frigate.record.maintainer: debug

detectors:
  coral:
    type: edgetpu
    device: usb
  #cpu1:
  #  type: cpu
  #  num_threads: 3
  #cpu2:
  #  type: cpu
  #  num_threads: 3

model:
  path: plus://[redacted]

#ffmpeg:
  #hwaccel_args: preset-vaapi

mqtt:
  host: [redacted]
  port: [redacted]
  # Optional: topic prefix (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  topic_prefix: frigate
  # Optional: client id (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  client_id: frigate
  user: [user]
  password: [password]
  # Optional: interval in seconds for publishing stats (default: shown below)
  stats_interval: 60

go2rtc:
  streams:
    basement:
      - rtsp://[user]:[password]@xxx.xxx.xx.xxx:xxx/cam/realmonitor?channel=1&subtype=0&authbasic=64
    basement_sub:
      - rtsp://[user]:[password]@xxx.xxx.xx.xxx:xxx/cam/realmonitor?channel=1&subtype=1&authbasic=64
    driveway:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    driveway_sub:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    kitchen:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    kitchen_sub:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    doorbell:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    doorbell_sub:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    foyer:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    foyer_sub:
      - rtspx://xxx.xxx.xx.xxx:xxx/[redacted]
    porch:
      - rtsp://[user]:[password]@xxx.xxx.xx.xxx:xxx/cam/realmonitor?channel=1&subtype=0
    porch_sub:
      - rtsp://[user]:[password]@xxx.xxx.xx.xxx:xxx/cam/realmonitor?channel=1&subtype=2
    pool:
      - rtsp://[user]:[password]@xxx.xxx.xx.xxx:xxx/cam/realmonitor?channel=1&subtype=0
    pool_sub:
      - rtsp://[user]:[password]@xxx.xxx.xx.xxx:xxx/cam/realmonitor?channel=1&subtype=2

record:
  retain:
    days: 10
    mode: all
  events:
    retain:
      default: 25
      mode: motion

snapshots:
  enabled: true
  timestamp: true
  bounding_box: true
  crop: false
  height: 175
  retain:
    default: 30

audio:
  enabled: false
  listen:
    - scream
    - fire_alarm
    - speech
    - yell

birdseye:
  enabled: false
  mode: continuous

objects:
  filters:
    dog:
      min_score: .8
      threshold: .9
    cat:
      min_score: .75
      threshold: .85
    face:
      min_score: .7
    package:
      min_score: .65
      threshold: .9
    license_plate:
      min_score: .6
    amazon:
      min_score: .75
    ups:
      min_score: .75
    fedex:
      min_score: .75
    person:
      min_score: .85
      threshold: .92
    car:
      min_score: .65
      threshold: .85

        #timestamp_style:
        #  position: "tl"
        #  format: "%m/%d/%Y %H:%M:%S"
        #  color:
        #    red: 255
        #    green: 255
        #    blue: 255
        #  thickness: 2
        #  effect: None

cameras:
  basement: # Generic Camera
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/basement
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://xxx.xxx.xx.xxx:xxx/basement_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
            #- audio
    detect:
      width: 704
      height: 480
      fps: 5
    record:
      enabled: true
    objects:
      #filters:
      #  person:
      #    min_score: 65
      #    threshold: 76
      track:
        - person
  driveway:
    ffmpeg:
      #output_args: 
        #record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac
        #record: preset-record-ubiquiti
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/driveway
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://xxx.xxx.xx.xxx:xxx/driveway_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
            #- audio
    detect:
      width: 1280
      height: 720
        #      fps: 30
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - face
        - license_plate
        - dog
        - cat
        - car
        - amazon
        - fedex
        - ups
        - package
    zones:
      driveway_start:
        coordinates: 0,477,514,169,448,99,254,177,152,177,0,219
        objects:
          - person
          - face
          - license_plate
          - dog
          - cat
          - car
          - amazon
          - fedex
          - ups
          - package
      all:
        coordinates: 1280,0,1280,720,0,720,0,0
        objects:
          - person
          - face
          - dog
          - cat
          - package
    review:
      alerts:
        required_zones:
          - all
          - driveway_start
  kitchen:
    ffmpeg:
      #output_args:
        #record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac
        #record: preset-record-ubiquiti
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/kitchen
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://xxx.xxx.xx.xxx:xxx/kitchen_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
            #- audio
    detect:
      width: 640
      height: 360
        #      fps: 15
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - cat
  doorbell:
    ffmpeg:
      output_args:
        #record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac
        #record: preset-record-ubiquiti
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/doorbell
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://xxx.xxx.xx.xxx:xxx/doorbell_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
            #- audio
    motion:
      mask:
        - 165,0,169,30,0,28,0,0
    detect:
      width: 960
      height: 720
        #      fps: 30
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - face
        - amazon
        - fedex
        - ups
        - package
        - cat
      #- dog
      filters:
        cat:
          mask: 370,557,400,76,584,135,628,312,641,446,792,720,960,720,960,0,0,0,0,720
        dog:
          mask: 370,557,400,76,584,135,628,312,641,446,792,720,960,720,960,0,0,0,0,720
  foyer:  # UBIQUITI
    ffmpeg:
      output_args:
        #record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac
        record: preset-record-ubiquiti
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/foyer
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://xxx.xxx.xx.xxx:xxx/foyer_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
            #- audio
    detect:
      width: 640
      height: 360
        #      fps: 15
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - cat
  porch: # Generic Camera
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/porch
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://xxx.xxx.xx.xxx:xxx/porch_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
            #- audio
    motion:
      mask:
        - 559,59,808,105,955,150,1280,278,1280,0,805,0,559,0,193,0,142,0,0,0,0,451,203,58
    detect:
      width: 1280
      height: 720
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - cat
  pool: # Generic Camera
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://xxx.xxx.xx.xxx:xxx/pool
          input_args: preset-rtsp-restream
          roles:
            - record
            #- audio
        - path: rtsp://xxx.xxx.xx.xxx:xxx/pool_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    motion:
      mask:
        - 876,68,1245,66,1239,21,876,21
    detect:
      width: 1280
      height: 720
      fps: 5
      #stationary:
      #  max_frames:
      #    default: 1000
    record:
      enabled: true
    objects:
      track:
        - person
        - cat
version: 0.14

Relevant Frigate log output

error
2024-09-01 09:30:20
frigate.api.media
[concat @ 0x55e482d1fa40] No files to concat
error
2024-09-01 09:30:22
frigate.api.media
[concat @ 0x555abb50ca40] No files to concat
error
2024-09-01 09:30:28
frigate.api.media
[concat @ 0x564a8333ea40] No files to concat
error
2024-09-01 09:30:30
frigate.api.media
[concat @ 0x55caeac36a40] No files to concat
error
2024-09-01 09:34:45
frigate.video
driveway: Unable to read frames from ffmpeg process.
error
2024-09-01 09:34:45
frigate.video
driveway: ffmpeg process is not running. exiting capture thread...
error
2024-09-01 09:34:55
watchdog.driveway
Ffmpeg process crashed unexpectedly for driveway.
error
2024-09-01 09:34:55
watchdog.driveway
The following ffmpeg logs include the last 100 lines prior to exit.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d915c6b80] [swscaler @ 0x556d915d3b80] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d915c6b80] [swscaler @ 0x556d9188d240] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d91884540] [swscaler @ 0x556d91891500] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d91884540] [swscaler @ 0x556d915c8b80] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d91884540] [swscaler @ 0x556d91891500] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d91884540] [swscaler @ 0x556d915c9500] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d91884540] [swscaler @ 0x556d91891500] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[swscaler @ 0x556d91884540] [swscaler @ 0x556d915c5600] deprecated pixel format used, make sure you did set range correctly
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 10 expected, 9 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 12 expected, 10 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 13 expected, 11 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 14 expected, 12 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 15 expected, 13 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 16 expected, 14 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 17 expected, 15 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 18 expected, 16 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 19 expected, 17 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 20 expected, 18 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 21 expected, 19 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 22 expected, 20 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 23 expected, 21 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 24 expected, 22 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 25 expected, 23 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 26 expected, 24 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 28 expected, 25 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 29 expected, 26 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 31 expected, 27 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 32 expected, 28 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 33 expected, 29 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[h264 @ 0x556d91509040] error while decoding MB 20 44, bytestream -13
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
rtsp://xxx.xxx.xx.xxx:8554/driveway_sub: corrupt decoded frame in stream 0
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
[rtsp @ 0x556d914f2c40] CSeq 34 expected, 0 received.
error
2024-09-01 09:34:55
ffmpeg.driveway.detect
rtsp://xxx.xxx.xx.xxx:8554/driveway_sub: corrupt decoded frame in stream 0
error
2024-09-01 09:38:19
frigate.api.media
[concat @ 0x5587f7833a40] No files to concat
error
2024-09-01 09:38:20
frigate.api.media
[concat @ 0x55dc8e262a40] No files to concat
error
2024-09-01 09:38:21
frigate.api.media
[concat @ 0x5616ba725a40] No files to concat
error
2024-09-01 09:38:22
frigate.api.media
[concat @ 0x562600568a40] No files to concat
error
2024-09-01 09:46:52
frigate.api.media
[concat @ 0x55e9adc28a40] No files to concat
error
2024-09-01 09:46:54
frigate.api.media
[concat @ 0x5654d0bcea40] No files to concat


*******************
eventually everything crashes and I get a ton of these errors:
*******************
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/13/porch/59.57.mp4 in 22.522996187210083 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/porch/00.08.mp4 in 20.588479042053223 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/porch/00.17.mp4 in 18.63486099243164 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/13/pool/59.57.mp4 in 15.73117995262146 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/pool/00.08.mp4 in 14.261793851852417 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/pool/00.18.mp4 in 13.167402982711792 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/13/basement/59.57.mp4 in 10.656108140945435 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/basement/00.07.mp4 in 9.137298107147217 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/basement/00.17.mp4 in 7.440947771072388 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/13/driveway/59.57.mp4 in 5.5400049686431885 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/00.07.mp4 in 4.825624942779541 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/00.17.mp4 in 3.865449905395508 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/00.27.mp4 in 3.166260004043579 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/13/foyer/59.57.mp4 in 2.7497570514678955 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/foyer/00.07.mp4 in 2.26513409614563 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/foyer/00.17.mp4 in 1.7649669647216797 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/13/doorbell/59.56.mp4 in 1.0867860317230225 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/doorbell/00.14.mp4 in 0.7423710823059082 seconds.
debug
2024-09-01 10:01:11
frigate.record.maintainer
Found 78 old frames.
debug
2024-09-01 10:01:25
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/00.37.mp4 in 2.417480945587158 seconds.
debug
2024-09-01 10:01:25
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/00.47.mp4 in 1.6355080604553223 seconds.
debug
2024-09-01 10:01:25
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/00.57.mp4 in 0.95638108253479 seconds.
debug
2024-09-01 10:01:25
frigate.record.maintainer
Found 29 old frames.
debug
2024-09-01 10:01:31
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/01.07.mp4 in 0.7962489128112793 seconds.
warning
2024-09-01 10:01:31
frigate.record.maintainer
Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 7 and discarding the rest...
debug
2024-09-01 10:01:35
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/01.17.mp4 in 0.8515992164611816 seconds.
warning
2024-09-01 10:01:41
frigate.record.maintainer
Unable to keep up with recording segments in cache for porch. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:41
frigate.record.maintainer
Unable to keep up with recording segments in cache for pool. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:41
frigate.record.maintainer
Unable to keep up with recording segments in cache for basement. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:41
frigate.record.maintainer
Unable to keep up with recording segments in cache for foyer. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:41
frigate.record.maintainer
Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 7 and discarding the rest...
debug
2024-09-01 10:01:45
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/01.27.mp4 in 0.7142629623413086 seconds.
warning
2024-09-01 10:01:46
frigate.record.maintainer
Unable to keep up with recording segments in cache for kitchen. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:51
frigate.record.maintainer
Unable to keep up with recording segments in cache for pool. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:51
frigate.record.maintainer
Unable to keep up with recording segments in cache for porch. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:51
frigate.record.maintainer
Unable to keep up with recording segments in cache for basement. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:51
frigate.record.maintainer
Unable to keep up with recording segments in cache for doorbell. Keeping the 6 most recent segments out of 7 and discarding the rest...
warning
2024-09-01 10:01:51
frigate.record.maintainer
Unable to keep up with recording segments in cache for foyer. Keeping the 6 most recent segments out of 7 and discarding the rest...
debug
2024-09-01 10:01:54
frigate.record.maintainer
Copied /media/frigate/recordings/2024-09-01/14/driveway/01.37.mp4 in 0.6461141109466553 seconds.

Relevant go2rtc log output

2024-09-01 09:19:11.967526288  [INFO] Preparing new go2rtc config...
2024-09-01 09:19:12.731582828  [INFO] Starting go2rtc...
2024-09-01 09:19:12.964460731  09:19:12.963 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-09-01 09:19:12.964716037  09:19:12.964 INF config path=/dev/shm/go2rtc.yaml
2024-09-01 09:19:12.965689661  09:19:12.965 INF [api] listen addr=:1984
2024-09-01 09:19:12.966130134  09:19:12.966 INF [rtsp] listen addr=:8554
2024-09-01 09:19:12.966625889  09:19:12.966 INF [webrtc] listen addr=:8555/tcp
2024-09-01 09:19:21.962641018  [INFO] Starting go2rtc healthcheck service...

FFprobe output from your camera

sorry... I can't get this working

Frigate stats

System
0.14.1-f4f3cfa
Detectors
Detector Inference Speed
coral
20.15ms
Detector CPU Usage
coral
20.1%
Detector Memory Usage
coral
2.4%
Other Processes
Process CPU Usage
go2rtc
42.3%
logger
0.1%
recording
40.1%
review segment
5.9%
Process Memory Usage
go2rtc
0.8%
logger
2.0%
recording
2.7%
review segment
2.2%

Operating system

Debian

Install method

Docker Compose

Object Detector

Coral

Network connection

Wired

Camera make and model

a mixture of cameras: Amcrest (IP5M-T1179EW-28mm), Loryta (IPC-T54IR-AS 2.8mm), Ubiquiti (G3 Flex, G5 bullet, G3 instant, G4 doorbell pro)

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

docker stats before crash

CONTAINER ID NAME CPU % MEM USAGE / LIMIT MEM % NET I/O BLOCK I/O PIDS
9352f30f17be portainer 0.00% 30.75MiB / 5.779GiB 0.52% 109kB / 2.92MB 64MB / 2.58MB 10
e1c9c1086f8c frigate 753.21% 1.299GiB / 5.779GiB 22.47% 1.07GB / 662MB 3.2MB / 303MB 563

docker stats after crash

CONTAINER ID NAME CPU % MEM USAGE / LIMIT MEM % NET I/O BLOCK I/O PIDS
9352f30f17be portainer 0.00% 30.62MiB / 5.779GiB 0.52% 108kB / 2.92MB 64MB / 2.3MB 10
e1c9c1086f8c frigate 76.61% 1.498GiB / 5.779GiB 25.93% 32.7GB / 19.8GB 197MB / 7.8GB 482

vmstat output:

procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
r b swpd free buff cache si so bi bo in cs us sy id wa st
1 0 615432 153408 247280 2990012 0 0 22 189 1 0 25 10 65 0 0
1 0 615432 149880 247280 2992084 0 0 0 0 8555 24118 15 6 79 0 0
1 0 615432 149812 247288 2993976 0 0 0 24 8168 17017 17 6 76 0 0
8 0 615432 124768 247124 2984832 0 0 0 0 13565 25471 34 11 55 0 0
1 0 615432 178144 246932 2964156 0 0 0 0 12349 18783 43 13 44 0 0
10 0 615432 178424 246932 2964920 0 0 0 0 9030 33740 17 8 75 0 0
3 0 615432 175516 246944 2968168 0 0 72 220 9017 31620 18 8 74 0 0
1 0 615432 174856 246948 2969044 0 0 4 25420 9505 27531 17 8 74 2 0
3 0 615432 171048 246948 2972424 0 0 0 0 8148 19079 18 7 75 0 0
5 0 615432 168008 246956 2973784 0 0 0 92 9413 23226 17 7 76 0 0
3 0 615432 165260 246956 2977156 0 0 0 0 7692 17684 17 6 77 0 0
3 0 615432 163920 246980 2978268 0 0 0 148 9052 21078 17 7 76 0 0
2 0 615432 162552 246980 2980816 0 0 0 0 8001 18008 16 7 78 0 0

marekstabla · 2024-09-01T17:23:56Z

marekstabla
Sep 1, 2024

#13444 (reply in thread)

Had the same issue - this solved it for me.

1 reply

Emmett9845 Sep 1, 2024
Author

thanks for the quick response, can't believe I missed that... unfortunately, it didn't change anything. It did however give me more confidence that it's something I screwed up in the config.

NickM-27 · 2024-09-07T16:49:49Z

NickM-27
Sep 7, 2024
Collaborator Sponsor

would be good to see other screenshots of the system metrics, the cameras are not using much CPU

23 replies

NickM-27 Nov 16, 2024
Collaborator Sponsor

I'd suggest enabling debug logs for frigate.record.maintainer

Emmett9845 Nov 17, 2024
Author

turned on frigate.record.maintainer debug...
everything was running fine for a bit, then it started going south. I started to get a message "found ## old frames" and the copy ties started increasing to above a second:

then I started to get errors:

Emmett9845 Nov 17, 2024
Author

NickM-27 Nov 19, 2024
Collaborator Sponsor

the storage is moving quite slow, you may want to look at https://docs.frigate.video/troubleshooting/recordings

Emmett9845 Dec 14, 2024
Author

I "fixed" it... upgraded my system and everything has been running really well for several days. Now that I'm up and running, do you recommend I revert back to my original configuration to use go2rtc?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Support]: High CPU use and Ffmpeg chrashes "Unable to keep up with recording segments in cache for camera" #13486

{{title}}

Replies: 2 comments 24 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Support]: High CPU use and Ffmpeg chrashes "Unable to keep up with recording segments in cache for camera" #13486

Emmett9845 Sep 1, 2024

Describe the problem you are having

Version

What browser(s) are you using?

Frigate config file

Relevant Frigate log output

Relevant go2rtc log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Object Detector

Network connection

Camera make and model

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 2 comments · 24 replies

marekstabla Sep 1, 2024

Emmett9845 Sep 1, 2024 Author

NickM-27 Sep 7, 2024 Collaborator Sponsor

NickM-27 Nov 16, 2024 Collaborator Sponsor

Emmett9845 Nov 17, 2024 Author

Emmett9845 Nov 17, 2024 Author

NickM-27 Nov 19, 2024 Collaborator Sponsor

Emmett9845 Dec 14, 2024 Author

Emmett9845
Sep 1, 2024

Replies: 2 comments 24 replies

marekstabla
Sep 1, 2024

Emmett9845 Sep 1, 2024
Author

NickM-27
Sep 7, 2024
Collaborator Sponsor

NickM-27 Nov 16, 2024
Collaborator Sponsor

Emmett9845 Nov 17, 2024
Author

Emmett9845 Nov 17, 2024
Author

NickM-27 Nov 19, 2024
Collaborator Sponsor

Emmett9845 Dec 14, 2024
Author