[Bug]: ffmpeg crashing on camera detect

[maphilli14]

Describe the problem you are having

System crashing with detector set to openvino and GPU

Steps to reproduce

docker down ; docker up ; view logs

Version

0.14.0 Beta3

Frigate config file

mqtt:
  # Required: host name
  host: 192.168.45.249
  # Optional: port (default: shown below)
  port: 1883
  # Optional: topic prefix (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  topic_prefix: frigate
  # Optional: client id (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  client_id: frigate
  # Optional: user
  user: maphilli14
  # Optional: password
  # NOTE: Environment variables that begin with 'FRIGATE_' may be referenced in {}.
  #       eg. password: '{FRIGATE_MQTT_PASSWORD}'
  password: xxx
  # Optional: interval in seconds for publishing stats (default: shown below)
  stats_interval: 60
detectors:
  ov:
    type: openvino
    device: GPU
record:
  enabled: true
  events:
    retain:
      default: 10
cameras:
  Sideyard:
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags nobuffer -flags low_delay -strict
        experimental -fflags +genpts+discardcorrupt -use_wallclock_as_timestamps 1
      output_args:
        record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps
          1 -strftime 1 -c:v libx264 -an
      inputs:
        - path:
            rtsp://user:[email protected]:554/StreamingSetting?version=1.0&action=getRTSPStream&ChannelID=1&ChannelName=Channel1
          roles:
            - detect
            - rtmp

  Driveway:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
        - path: rtsp://user:[email protected]:554
          roles:
            - detect
            - rtmp
    motion:
      mask:
        - 1,0.802,0.832,0.689,0.778,0.599,0.81,0.457,0.905,0.421,0.976,0.459,1,0.492
        - 0.694,1,0.705,0.94,0.726,0.882,0.771,0.826,0.827,0.781,0.928,0.773,1,0.896,1,1
objects:
  # Optional: list of objects to track from labelmap.txt (default: shown below)
  track:
    - person
    - bird
    - cat
    - car
    - dog
    - bicycle

motion:
  mask:
    - 1280,582,1186,565,989,495,1009,367,1030,304,1147,303,1280,361
    #- 1280,582,1190,538,1003,494,1026,380,1050,327,1158,315,1280,361
    - 964,720,976,675,1031,629,1086,615,1153,576,1217,600,1280,662,1280,720
version: 0.14
camera_groups:
  Birdseye:
    order: 1
    icon: LuBird
    cameras: birdseye

Relevant log output

2024-06-28 14:41:07.421792302  ::ffff:172.26.90.11 - - [28/Jun/2024:14:41:07 +0000] "GET /api/Sideyard/latest.jpg HTTP/1.1" 200 13176 "-" "HomeAssistant/2024.1.3 aiohttp/3.9.1 Python/3.11" "-"
2024-06-28 14:41:07.489908793  [2024-06-28 14:41:07] watchdog.Sideyard              ERROR   : Ffmpeg process crashed unexpectedly for Sideyard.
2024-06-28 14:41:07.490085809  [2024-06-28 14:41:07] watchdog.Sideyard              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-06-28 14:41:07.490900582  [2024-06-28 14:41:07] ffmpeg.Sideyard.detect         ERROR   : [rtsp @ 0x564b01371300] Received packet without a start chunk; dropping frame.
2024-06-28 14:41:07.490905301  [2024-06-28 14:41:07] ffmpeg.Sideyard.detect         ERROR   :     Last message repeated 220 times
2024-06-28 14:41:07.490908794  [2024-06-28 14:41:07] ffmpeg.Sideyard.detect         ERROR   : Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scale_0'
2024-06-28 14:41:07.490911359  [2024-06-28 14:41:07] ffmpeg.Sideyard.detect         ERROR   : Error reinitializing filters!
2024-06-28 14:41:07.490914152  [2024-06-28 14:41:07] ffmpeg.Sideyard.detect         ERROR   : Failed to inject frame into filter network: Function not implemented
2024-06-28 14:41:07.490916781  [2024-06-28 14:41:07] ffmpeg.Sideyard.detect         ERROR   : Error while processing the decoded data for stream #0:0
2024-06-28 14:41:07.677336370  [2024-06-28 14:41:07] frigate.watchdog               INFO    : Detection appears to have stopped. Exiting Frigate...
s6-rc: info: service legacy-services: stopping
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service go2rtc-healthcheck: stopping
s6-rc: info: service certsync: stopping
2024-06-28 14:41:07.690700775  [INFO] The go2rtc-healthcheck service exited with code 256 (by signal 15)
s6-rc: info: service go2rtc-healthcheck successfully stopped
2024-06-28 14:41:07.692478232  [INFO] Service CERTSYNC exited with code 256 (by signal 15)
s6-rc: info: service certsync successfully stopped
s6-rc: info: service nginx: stopping
s6-rc: info: service certsync-log: stopping
s6-rc: info: service certsync-log successfully stopped
2024-06-28 14:41:07.787226579  [INFO] Service NGINX exited with code 0 (by signal 0)
s6-rc: info: service nginx successfully stopped
s6-rc: info: service nginx-log: stopping
s6-rc: info: service frigate: stopping
s6-rc: info: service nginx-log successfully stopped
2024-06-28 14:41:07.791781899  [2024-06-28 14:41:07] frigate.app                    INFO    : Flask has exited...
2024-06-28 14:41:07.792418041  [2024-06-28 14:41:07] frigate.app                    INFO    : Stopping...
2024-06-28 14:41:07.792834127  [2024-06-28 14:41:07] frigate.record.cleanup         INFO    : Exiting recording cleanup...
2024-06-28 14:41:07.792838099  [2024-06-28 14:41:07] frigate.storage                INFO    : Exiting storage maintainer...
2024-06-28 14:41:07.793744055  [2024-06-28 14:41:07] frigate.stats.emitter          INFO    : Exiting stats emitter...
2024-06-28 14:41:07.794101790  [2024-06-28 14:41:07] frigate.watchdog               INFO    : Exiting watchdog...
2024-06-28 14:41:07.794252966  [2024-06-28 14:41:07] frigate.ptz.autotrack          INFO    : Exiting autotracker...
2024-06-28 14:41:07.794762037  [2024-06-28 14:41:07] frigate.events.cleanup         INFO    : Exiting event cleanup...
2024-06-28 14:41:07.795386817  [2024-06-28 14:41:07] frigate.app                    INFO    : Waiting for capture process for Sideyard to stop
2024-06-28 14:41:07.796085996  [2024-06-28 14:41:07] watchdog.Sideyard              INFO    : Terminating the existing ffmpeg process...
2024-06-28 14:41:07.796562761  [2024-06-28 14:41:07] watchdog.Sideyard              INFO    : Waiting for ffmpeg to exit gracefully...
2024-06-28 14:41:07.807812739  [2024-06-28 14:41:07] frigate.app                    INFO    : Waiting for capture process for Driveway to stop
2024-06-28 14:41:07.808880755  [2024-06-28 14:41:07] watchdog.Driveway              INFO    : Terminating the existing ffmpeg process...
2024-06-28 14:41:07.809202821  [2024-06-28 14:41:07] watchdog.Driveway              INFO    : Waiting for ffmpeg to exit gracefully...
2024-06-28 14:41:07.836467108  [2024-06-28 14:41:07] frigate.app                    INFO    : Waiting for process for Sideyard to stop
2024-06-28 14:41:07.959617868  [2024-06-28 14:41:07] frigate.object_processing      INFO    : Exiting object processor...
2024-06-28 14:41:08.492992953  [2024-06-28 14:41:08] frigate.video                  INFO    : Sideyard: emptying frame queue
2024-06-28 14:41:08.493185037  [2024-06-28 14:41:08] frigate.video                  INFO    : Sideyard: exiting subprocess
2024-06-28 14:41:08.501898805  [2024-06-28 14:41:08] frigate.app                    INFO    : Closing frame queue for Sideyard
2024-06-28 14:41:08.686919919  [2024-06-28 14:41:08] frigate.events.maintainer      INFO    : Exiting event processor...
2024-06-28 14:41:09.003184456  [2024-06-28 14:41:09] frigate.app                    INFO    : Waiting for process for Driveway to stop
2024-06-28 14:41:11.942738831  [2024-06-28 14:41:11] frigate.video                  INFO    : Driveway: emptying frame queue
2024-06-28 14:41:11.943094452  [2024-06-28 14:41:11] frigate.video                  INFO    : Driveway: exiting subprocess
2024-06-28 14:41:11.953164412  [2024-06-28 14:41:11] frigate.app                    INFO    : Closing frame queue for Driveway
2024-06-28 14:41:12.955050979  [2024-06-28 14:41:12] frigate.app                    INFO    : Detection queue closed
2024-06-28 14:41:13.456061617  [2024-06-28 14:41:13] frigate.app                    INFO    : Detected frames queue closed
2024-06-28 14:41:13.957087047  [2024-06-28 14:41:13] frigate.app                    INFO    : Timeline queue closed
2024-06-28 14:41:15.072023664  [2024-06-28 14:41:15] frigate.output.output          INFO    : exiting output process...
2024-06-28 14:41:17.327272048  [2024-06-28 14:41:17] frigate.record.maintainer      INFO    : Exiting recording maintenance...
2024-06-28 14:41:18.126058978  [2024-06-28 14:41:18] frigate.comms.ws               INFO    : Exiting websocket client...
2024-06-28 14:41:18.485993634  [2024-06-28 14:41:18] peewee.sqliteq                 INFO    : writer received shutdown request, exiting.
2024-06-28 14:41:19.535299882  /usr/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 6 leaked shared_memory objects to clean up at shutdown
2024-06-28 14:41:19.535304880    warnings.warn('resource_tracker: There appear to be %d '
2024-06-28 14:41:19.539622705  [INFO] Service Frigate exited with code 0 (by signal 0)
s6-rc: info: service frigate successfully stopped
s6-rc: info: service go2rtc: stopping
s6-rc: info: service frigate-log: stopping
2024-06-28 14:41:19.556419147  exit with signal: terminated
s6-rc: info: service frigate-log successfully stopped
2024-06-28 14:41:19.562003388  [INFO] The go2rtc service exited with code 0 (by signal 0)

Operating system

Other Linux

Install method

Docker Compose

Network connection

Wired

Camera make and model

Cisco Video Surveillance 6050 IP Camera

Any other information that may be helpful

camera worked with frigate:stable release

[hawkeye217]

The crashes are related to the manual arguments you're specifying for input_args and output_args. You should be using presets.

https://deploy-preview-11419--frigate-docs.netlify.app/configuration/ffmpeg_presets/

[maphilli14]

I masked the options on that camera out to this new config:

mqtt:
  # Required: host name
  host: 192.168.45.249
  # Optional: port (default: shown below)
  port: 1883
  # Optional: topic prefix (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  topic_prefix: frigate
  # Optional: client id (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  client_id: frigate
  # Optional: user
  user: maphilli14
  # Optional: password
  # NOTE: Environment variables that begin with 'FRIGATE_' may be referenced in {}.
  #       eg. password: '{FRIGATE_MQTT_PASSWORD}'
  password: xxx
  # Optional: interval in seconds for publishing stats (default: shown below)
  stats_interval: 60
detectors:
  ov:
    type: openvino
    device: GPU
record:
  enabled: true
  events:
    retain:
      default: 10
cameras:
  Sideyard:
    ffmpeg:
#      input_args: -avoid_negative_ts make_zero -fflags nobuffer -flags low_delay -strict
#        experimental -fflags +genpts+discardcorrupt -use_wallclock_as_timestamps 1
#      output_args:
#        record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps
#          1 -strftime 1 -c:v libx264 -an
      inputs:
        - path:
            rtsp://user:[email protected]:554/StreamingSetting?version=1.0&action=getRTSPStream&ChannelID=1&ChannelName=Channel1
          roles:
            - detect
            - rtmp

  Driveway:
    ffmpeg:
      #hwaccel_args: preset-vaapi
      inputs:
        - path: rtsp://user:[email protected]:554
          roles:
            - detect
            - rtmp
    motion:
      mask:
        - 1,0.802,0.832,0.689,0.778,0.599,0.81,0.457,0.905,0.421,0.976,0.459,1,0.492
        - 0.694,1,0.705,0.94,0.726,0.882,0.771,0.826,0.827,0.781,0.928,0.773,1,0.896,1,1
objects:
  # Optional: list of objects to track from labelmap.txt (default: shown below)
  track:
    - person
    - bird
    - cat
    - car
    - dog
    - bicycle

motion:
  mask:
    - 1280,582,1186,565,989,495,1009,367,1030,304,1147,303,1280,361
    #- 1280,582,1190,538,1003,494,1026,380,1050,327,1158,315,1280,361
    - 964,720,976,675,1031,629,1086,615,1153,576,1217,600,1280,662,1280,720
version: 0.14
camera_groups:
  Birdseye:
    order: 1
    icon: LuBird
    cameras: birdseye

See logs -
f0140b3-log-20240628a.txt

[hawkeye217]

If you want to use the openvino detector, you need to specify more config options. See the docs:

https://deploy-preview-11419--frigate-docs.netlify.app/configuration/object_detectors/#openvino-detector

[maphilli14]

One or both of those did the trick, thanks!