[Support]: Problems with WebRTC and MSE on various platforms.

[lordratner]

Describe the problem you are having

I can't get the MSE and WebRTC streams to work reliably (or at all) on my phone.

Three cameras:
Nursery: h265 - Reolink RLC-822A
Living Room: h264 - Reolink E1
Litter Box: h264 - Reolink E1 Pro

On Chrome on my desktop, everything works on all three cameras.

On my Google Pixel 8 and Google Pixel 8 Pro running Chrome, JSMPEG works for everything. MSE only works for the two h264 cameras. WebRTC does not work on any camera.

If I use Firefox on the phones, the only difference is that MSE works on the h265 camera. WebRTC still does not work for any camera.

Version

0.13.1-34FB1C2

Frigate config file

mqtt:
  host: 192.168.30.105
  port: 1883
  user: frigate
  password: xxx

detectors:
  # coralusb:
  #   type: edgetpu
  #   device: usb
  coralpci1:
     type: edgetpu
     device: pci:0
  coralpci2:
     type: edgetpu
     device: pci:1

database:
  path: /media/frigate/frigate.db

logger:
  # Optional: Default log verbosity (default: shown below)
  default: info
  # Optional: Component specific logger overrides
#  logs:
#    frigate.event: debug

environment_vars:
  EXAMPLE_VAR: value

birdseye:
  enabled: True
  width: 1280
  height: 720
  # Optional: Encoding quality of the mpeg1 feed (default: shown below)
  # 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
  quality: 8
  # Optional: Mode of the view. Available options are: objects, motion, and continuous
  #   objects - cameras are included if they have had a tracked object within the last 30 seconds
  #   motion - cameras are included if motion was detected in the last 30 seconds
  #   continuous - all cameras are included always
  mode: motion

detect:
  fps: 5
  enabled: True
  # stationary:
  #   interval: 50
  #   threshold: 50

go2rtc:
  streams:
    living_room:
      - rtsp://frigate:[email protected]:554//h264Preview_01_main # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
      - "ffmpeg:living_room#audio=opus" # <- copy of the stream which transcodes audio to opus
    living_room_sub:
      - rtsp://frigate:[email protected]:554//h264Preview_01_sub # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
    nursery:
      - rtsp://frigate:[email protected]:554//h265Preview_01_main # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
      - "ffmpeg:nursery#audio=opus" # <- copy of the stream which transcodes audio to opus
    nursery_sub:
      - rtsp://frigate:[email protected]:554//h264Preview_01_sub # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg

    litter_box:
      - http://192.168.41.101/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=frigate&password=xxx# <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
      - "ffmpeg:litter_box#audio=opus" # <- copy of the stream which transcodes audio to opus
    litter_box_sub:
      - http://192.168.41.101/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=frigate&password=xxx # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
  webrtc:
    candidates:
      - 192.168.30.125:8555

ffmpeg:
  hwaccel_args: preset-nvidia-h264

record:
  enabled: True
  expire_interval: 60
  retain:
    days: 0
    mode: all
  events:
    pre_capture: 5
    post_capture: 5
#    objects:
#      - cat
#    required_zones:
#    - feeder
    retain:
      default: 5
      mode: all

snapshots:
  enabled: True
  timestamp: True
  bounding_box: False
  crop: True
  retain:
    default: 7

# rtmp:
#   enabled: True

live:
  height: 720
  quality: 8

timestamp_style:
  position: "bl"
  format: "%Y/%m/%d %H:%M:%S"
  color:
    red: 252
    green: 111
    blue: 3
  thickness: 3

objects:
  track:
    - person
    - cat
  filters:
    cat:
      min_score: 0.5
      threshold: 0.6

cameras:
  living_room:
    ffmpeg:
      inputs:
        # - path: rtsp://127.0.0.1:8554/living_room_sub
        #   roles:
        #     - detect
        - path: rtsp://127.0.0.1:8554/living_room
          roles:
            - record
            - detect
    detect:
    #  width: 640 # <---- update for your camera's resolution
    #  height: 360 # <---- update for your camera's resolution
      width: 2560 # <---- update for your camera's resolution
      height: 1440 # <---- update for your camera's resolution
    objects:
      track:
        - person
        - cat
      filters:
        person:
          mask:
            - 2287,177,2303,355,2133,328,2167,151
    zones:
      feeders:
        coordinates: 0,563,0,1171,873,1440,1729,1005,1809,383,1336,184,1069,309,568,362
        objects:
          - cat
    snapshots:
      required_zones:
        - feeders
    record:
      enabled: True
      events:
        objects:
          - person
          - cat
        required_zones:
          - feeders
    mqtt:
      enabled: True
      timestamp: True
      bounding_box: False
      crop: True
      height: 500
      quality: 100
      #required_zones: []

  litter_box:
    ffmpeg:
      inputs:
#        - path: rtsp://127.0.0.1:8554/litter_box_sub
#          roles:
#            - detect
        - path: rtsp://127.0.0.1:8554/litter_box
          roles:
            - record
            - detect
    detect:
      width: 2560 # <---- update for your camera's resolution
      height: 1920 # <---- update for your camera's resolution
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
    objects:
      track:
        - cat
    zones:
      entrance:
        coordinates: 2202,1747,2161,759,2036,556,2014,302,1963,134,1700,0,1287,127,1192,453,917,633,894,1753
        objects:
          - cat
      litter_room:
        coordinates: 0,0,2560,0,2560,1920,0,1920
#         coordinates: 1251,743,1234,596,1267,480,1354,384,1465,338,1591,334,1756,397,1849,460,1907,568,1931,691,1913,817,1872>
        objects:
          - cat
#          - person
    snapshots:
      required_zones:
        - entrance
    record:
      enabled: True
      events:
        objects:
          - cat
        required_zones:
          - entrance
          - litter_room
    mqtt:
      enabled: True
      timestamp: True
      bounding_box: True
      crop: True
      height: 500
      quality: 100
      #required_zones: []

  nursery:
    ffmpeg:
      input_args: preset-rtsp-restream
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
#        - path: rtsp://frigate:[email protected]:554//h264Preview_01_sub
#          roles:
#            - detect
        - path: rtsp://127.0.0.1:8554/nursery
          # input_args: preset-rtsp-restream
          roles:
            - record
            - detect
    detect:
      width: 2304 # <---- update for your camera's resolution
      height: 1296 # <---- update for your camera's resolution
      stationary:
        interval: 50
        threshold: 150
    objects:
      track:
        - person
        - cat
    zones:
      crib:
        coordinates: 541,1296,343,1063,773,641,1072,824,1101,905,760,1296
        objects:
         - person
         - cat
      changing_table:
        coordinates: 1543,469,1866,627,1655,1073,1237,874
        objects:
         - person
         - cat
      nursery_room:
        coordinates: 0,0,2304,0,2304,1296,0,1296
        objects:
          - cat
          - person
#    zones:
#      front_door:
#        coordinates: 690,1068,1394,1064,1490,276,579,277

#    snapshots:
#      required_zones:
#        - front_door
    record:
      enabled: True
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 30
          mode: active_objects
          objects:
            person: 30
            cat: 7
        objects:
          - person
          - cat
        required_zones:
          - crib
          - changing_table
    mqtt:
      enabled: True
      timestamp: True
      bounding_box: False
      crop: True
      height: 500
      quality: 100
      #required_zones: []

Relevant log output

Nothing I can find

FFprobe output from your camera

Living Room:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"40/3","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1440,"width":2560},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Litter Box:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"0/0","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1920,"width":2560},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Nursery:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"40/3","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1296,"width":2304},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Frigate stats

{
  "cameras": {
    "litter_box": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5.1,
      "capture_pid": 1289,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 1303,
      "pid": 1285,
      "process_fps": 5.1,
      "skipped_fps": 0
    },
    "living_room": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5.1,
      "capture_pid": 1288,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 1296,
      "pid": 1284,
      "process_fps": 5.1,
      "skipped_fps": 0
    },
    "nursery": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5,
      "capture_pid": 1294,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 1300,
      "pid": 1287,
      "process_fps": 5,
      "skipped_fps": 0
    }
  },
  "cpu_usages": {
    "1": {
      "cmdline": "/package/admin/s6/command/s6-svscan -d4 -- /run/service",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "15": {
      "cmdline": "s6-supervise s6-linux-init-shutdownd",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "17": {
      "cmdline": "/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "24": {
      "cmdline": "s6-supervise s6rc-oneshot-runner",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "25": {
      "cmdline": "s6-supervise go2rtc-healthcheck",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "26": {
      "cmdline": "s6-supervise nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "27": {
      "cmdline": "s6-supervise frigate-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "28": {
      "cmdline": "s6-supervise nginx-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "29": {
      "cmdline": "s6-supervise go2rtc-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "30": {
      "cmdline": "s6-supervise frigate",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "31": {
      "cmdline": "s6-supervise s6rc-fdholder",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "32": {
      "cmdline": "s6-supervise go2rtc",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "43": {
      "cmdline": "/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "44": {
      "cmdline": "/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "86": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "89": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "92": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "106": {
      "cmdline": "/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml",
      "cpu": "2.6",
      "cpu_average": "3",
      "mem": "0.0"
    },
    "117": {
      "cmdline": "bash ./run.user go2rtc-healthcheck",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "122": {
      "cmdline": "python3 -u -m frigate",
      "cpu": "1.2",
      "cpu_average": "0",
      "mem": "0.5"
    },
    "130": {
      "cmdline": "nginx: master process nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "135": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "136": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "137": {
      "cmdline": "nginx: worker process",
      "cpu": "0.2",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "138": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "139": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "140": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "141": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "142": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "143": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "144": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "145": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "146": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "147": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "148": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "149": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "536": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "537": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "538": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "539": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "540": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "541": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "542": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "543": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "544": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "545": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "546": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "547": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "548": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "549": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "550": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "551": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "552": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "553": {
      "cmdline": "nginx: cache manager process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1221": {
      "cmdline": "frigate.logger       ",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "1223": {
      "cmdline": "frigate.recording_manager",
      "cpu": "1.3",
      "cpu_average": "1",
      "mem": "0.2"
    },
    "1232": {
      "cmdline": "/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(49)",
      "cpu": "0.2",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1233": {
      "cmdline": "frigate.detector.coralpci1",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1234": {
      "cmdline": "frigate.detector.coralpci2",
      "cpu": "0.1",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1235": {
      "cmdline": "frigate.output       ",
      "cpu": "1.3",
      "cpu_average": "1",
      "mem": "0.1"
    },
    "1240": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1244": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1920 -i pipe: -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1247": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2304x1296 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1258": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1284": {
      "cmdline": "frigate.process:living_room",
      "cpu": "0.6",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1285": {
      "cmdline": "frigate.process:litter_box",
      "cpu": "0.8",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1287": {
      "cmdline": "frigate.process:nursery",
      "cpu": "0.7",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1288": {
      "cmdline": "frigate.capture:living_room",
      "cpu": "3.5",
      "cpu_average": "3",
      "mem": "0.2"
    },
    "1289": {
      "cmdline": "frigate.capture:litter_box",
      "cpu": "4.5",
      "cpu_average": "4",
      "mem": "0.2"
    },
    "1294": {
      "cmdline": "frigate.capture:nursery",
      "cpu": "2.6",
      "cpu_average": "2",
      "mem": "0.2"
    },
    "1296": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.1-34fb1c2 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/living_room -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/living_room@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_cuda=w=2560:h=1440:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "2.7",
      "cpu_average": "2",
      "mem": "0.2"
    },
    "1300": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.1-34fb1c2 -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/nursery -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/nursery@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_cuda=w=2304:h=1296:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "2.5",
      "cpu_average": "2",
      "mem": "0.2"
    },
    "1303": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.1-34fb1c2 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/litter_box -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/litter_box@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_cuda=w=2560:h=1920:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "3.5",
      "cpu_average": "3",
      "mem": "0.2"
    },
    "2983": {
      "cmdline": "ffmpeg -hide_banner -v error -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp://127.0.0.1:8554/litter_box?audio -c:a libopus -application:a lowdelay -frame_duration 20 -min_comp 0 -vn -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp://127.0.0.1:8554/eec3ba5f158e34f19888f060ecd58eb3",
      "cpu": "0.1",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "3487": {
      "cmdline": "sleep 30s",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    }
  },
  "detection_fps": 0,
  "detectors": {
    "coralpci1": {
      "detection_start": 0,
      "inference_speed": 6.17,
      "pid": 1233
    },
    "coralpci2": {
      "detection_start": 0,
      "inference_speed": 6.17,
      "pid": 1234
    }
  },
  "gpu_usages": {
    "NVIDIA GeForce GTX 1070 Ti": {
      "dec": "12.0%",
      "enc": "0.0%",
      "gpu": "1.0%",
      "mem": "14.68%"
    }
  },
  "processes": {
    "go2rtc": {
      "pid": 106
    },
    "logger": {
      "pid": 1221
    },
    "recording": {
      "pid": 1223
    }
  },
  "service": {
    "last_updated": 1717477620,
    "latest_version": "0.13.2",
    "storage": {
      "/dev/shm": {
        "free": 2029.4,
        "mount_type": "tmpfs",
        "total": 2048,
        "used": 18.6
      },
      "/media/frigate/clips": {
        "free": 55587845,
        "mount_type": "nfs4",
        "total": 58354177,
        "used": 2766332
      },
      "/media/frigate/recordings": {
        "free": 55587845,
        "mount_type": "nfs4",
        "total": 58354177,
        "used": 2766332
      },
      "/tmp/cache": {
        "free": 1898.1,
        "mount_type": "tmpfs",
        "total": 1907.4,
        "used": 9.2
      }
    },
    "temperatures": {
      "apex_0": 71.05,
      "apex_1": 65.3
    },
    "uptime": 1508,
    "version": "0.13.1-34fb1c2"
  }
}

Operating system

Debian

Install method

Docker Compose

Coral version

PCIe

Network connection

Wired

Camera make and model

Reolink E1, E1 Pro, and RLC-822A

Any other information that may be helpful

go2rtc stream info:

{
  "litter_box": {
    "consumers": [
      {
        "medias": [
          "video, sendonly, H264, H265",
          "audio, sendonly, MPEG4-GENERIC"
        ],
        "remote_addr": "127.0.0.1:48996",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000/1\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=1\r\n",
        "send": 339874102,
        "senders": [
          "96 H264, bytes=323317693, receivers=1",
          "97 MPEG4-GENERIC/16000/1, bytes=12326400, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp://127.0.0.1:8554/litter_box",
        "user_agent": "FFmpeg Frigate/0.13.1-34fb1c2"
      },
      {
        "medias": [
          "audio, sendonly, ANY"
        ],
        "remote_addr": "127.0.0.1:56686",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=audio 0 RTP/AVP 96\r\na=rtpmap:96 MPEG4-GENERIC/16000/1\r\na=fmtp:96 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=0\r\n",
        "send": 3371816,
        "senders": [
          "96 MPEG4-GENERIC/16000/1, bytes=3245056, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp://127.0.0.1:8554/litter_box?audio",
        "user_agent": "go2rtc/ffmpeg"
      }
    ],
    "producers": [
      {
        "medias": [
          "video, recvonly, H.264 High 5.1",
          "audio, recvonly, MPEG4-GENERIC/16000/1"
        ],
        "receivers": [
          "255 H264, bytes=323316373, senders=1",
          "255 MPEG4-GENERIC/16000/1, bytes=12326400, senders=2"
        ],
        "recv": 335752822,
        "type": "FLV producer",
        "url": ""
      },
      {
        "url": "ffmpeg:litter_box#audio=opus"
      }
    ]
  },
  "litter_box_sub": {
    "consumers": null,
    "producers": [
      {
        "url": "http://192.168.41.101/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=*&password=*"
      }
    ]
  },
  "living_room": {
    "consumers": [
      {
        "medias": [
          "video, sendonly, H264, H265",
          "audio, sendonly, MPEG4-GENERIC"
        ],
        "remote_addr": "127.0.0.1:48994",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6zoAoALWQ==,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=15;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408; profile=1;\r\na=control:trackID=1\r\n",
        "send": 468021229,
        "senders": [
          "96 H264, bytes=454044355, receivers=1",
          "97 MPEG4-GENERIC/16000, bytes=12420636, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp://127.0.0.1:8554/living_room",
        "user_agent": "FFmpeg Frigate/0.13.1-34fb1c2"
      }
    ],
    "producers": [
      {
        "medias": [
          "video, recvonly, H.264 High 5.1",
          "audio, recvonly, MPEG4-GENERIC/16000"
        ],
        "receivers": [
          "96 H264, bytes=454044355, senders=1",
          "97 MPEG4-GENERIC/16000, bytes=12420636, senders=1"
        ],
        "recv": 467768879,
        "remote_addr": "192.168.41.100:554",
        "sdp": "v=0\r\no=- 1562112000730311 1 IN IP4 192.168.41.100\r\ns=Session streamed by \"preview\"\r\ni=h264Preview_01_main\r\nt=0 0\r\na=tool:LIVE555 Streaming Media v2013.04.08\r\na=type:broadcast\r\na=control:*\r\na=range:npt=0-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\na=x-qt-text-inf:h264Preview_01_main\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:500\r\na=rtpmap:96 H264/90000\r\na=range:npt=0-\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6zoAoALWQ==,aO48sA==\r\na=control:trackID=1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:256\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=15;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408; profile=1;\r\na=control:trackID=2\r\n",
        "type": "RTSP active producer",
        "url": "rtsp://192.168.41.100/h264Preview_01_main/",
        "user_agent": "go2rtc/1.8.4"
      },
      {
        "url": "ffmpeg:living_room#audio=opus"
      }
    ]
  },
  "living_room_sub": {
    "consumers": null,
    "producers": [
      {
        "url": "rtsp://*:*@192.168.41.100:554//h264Preview_01_sub"
      }
    ]
  },
  "nursery": {
    "consumers": [
      {
        "medias": [
          "video, sendonly, H264, H265",
          "audio, sendonly, MPEG4-GENERIC"
        ],
        "remote_addr": "127.0.0.1:48982",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAkAKOQ,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=1\r\n",
        "send": 667170663,
        "senders": [
          "96 H264, bytes=646844983, receivers=1",
          "97 MPEG4-GENERIC/16000, bytes=12585472, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp://127.0.0.1:8554/nursery",
        "user_agent": "FFmpeg Frigate/0.13.1-34fb1c2"
      },
      {
        "medias": [
          "video, sendonly, H264",
          "audio, sendonly, MPEG4-GENERIC, PCMA, PCMU, L16, PCML, OPUS"
        ],
        "remote_addr": "192.168.20.211, 127.0.0.1:58724",
        "send": 181121155,
        "senders": [
          "96 H264, bytes=176886334, receivers=1",
          "97 MPEG4-GENERIC/16000, bytes=3442386, receivers=1"
        ],
        "type": "MSE/WebSocket active consumer",
        "user_agent": "Mozilla/5.0 (Android 14; Mobile; rv:126.0) Gecko/126.0 Firefox/126.0"
      }
    ],
    "producers": [
      {
        "medias": [
          "video, recvonly, H.264 High 5.1",
          "audio, recvonly, MPEG4-GENERIC/16000"
        ],
        "receivers": [
          "96 H264, bytes=646844983, senders=2",
          "97 MPEG4-GENERIC/16000, bytes=12585472, senders=2"
        ],
        "recv": 665265611,
        "remote_addr": "192.168.41.102:554",
        "sdp": "v=0\r\no=- 1717311606570203 1 IN IP4 192.168.41.102\r\ns=Session streamed by \"preview\"\r\ni=h265Preview_01_main\r\nt=0 0\r\na=tool:LIVE555 Streaming Media v2020.08.12\r\na=type:broadcast\r\na=control:*\r\na=range:npt=0-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\na=x-qt-text-inf:h265Preview_01_main\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:500\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAkAKOQ,aO48sA==\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:256\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:track2\r\n",
        "type": "RTSP active producer",
        "url": "rtsp://192.168.41.102/h265Preview_01_main/",
        "user_agent": "go2rtc/1.8.4"
      },
      {
        "url": "ffmpeg:nursery#audio=opus"
      }
    ]
  },
  "nursery_sub": {
    "consumers": null,
    "producers": [
      {
        "url": "rtsp://*:*@192.168.41.102:554//h264Preview_01_sub"
      }
    ]
  }
}

[lineumaciel]

This is how the new automatic livemode works. I have similar symptoms. As far as getting MSE under control, like you sometimes MSE closes stream for no reason. This works nice on desktop browsers but on ios it is a bit tiresome

[hawkeye217]

The user is not using 0.14-beta, so this is a different issue.

[NickM-27]

webrtc does not support h.265 so we already expect that to not work on some cameras. not seeing anything obvious of why it isn't working for the h.264 cameras

[lordratner]

That's what I thought, yet it does work on a desktop. Does frigate convert to h264 based on my config? I've hesitated to upgrade because I wanted to get this sorted out, but maybe I need to and just hope it fixes?

…

On Tue, Jun 4, 2024, 07:16 Nicolas Mowen ***@***.***> wrote: webrtc does not support h.265 so we already expect that to not work on some cameras. not seeing anything obvious of why it isn't working for the h.264 cameras — Reply to this email directly, view it on GitHub <#11731 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALZSL5UCEDAXJJJY2EELN5TZFWVY7AVCNFSM6AAAAABIXX2NZKVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TMNRTHA3TE> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>

[NickM-27]

no, there is no transcoding occurring