[Support]: 0.14.0 Beta 1 - Live View using snapshot wrong format

[jtut1731]

Describe the problem you are having

Two cameras (happen to be Amcrest AD410...with wide angle correction enabled) display strange behavior when camera view switches from live to snapshot. Top picture is live view. Bottom is snapshot. Aspect ratio of snapshot is also incorrect. Stream is 2560x1920.

Version

0.14.0-b97e274

Frigate config file

ffmpeg:
  hwaccel_args: preset-rk-h264

go2rtc:
  streams:
    front_doorbell:
      - rtsp://xxx:[email protected]/cam/realmonitor?channel=1&subtype=0   # h264 2560x1920 / 15 fps
    front_doorbell_detect:
      - rtsp://xxx:[email protected]/cam/realmonitor?channel=1&subtype=1   # h264 720x576 / 5 fps

cameras:
  front_doorbell: # <------ Name the camera
    detect:
      height: 576
      width: 720
    motion:
      mask:
        - 720,0,720,29,488,25,488,0
    ffmpeg:
      output_args:
        record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps
          1 -strftime 1 -c:v copy -c:a aac
      inputs:
        - path: rtsp://127.0.0.1:8554/front_doorbell_detect 
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/front_doorbell
          input_args: preset-rtsp-restream
          roles:
            - record

Relevant log output

No relevant logs

FFprobe output from your camera

Input #0, rtsp, from 'rtsp://127.0.0.1:8554/front_doorbell':
  Metadata:
    title           : go2rtc/1.9.2
  Duration: N/A, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: h264 (High), yuv420p(progressive), 2560x1920, 15 fps, 100 tbr, 90k tbn
  Stream #0:1: Audio: aac (LC), 8000 Hz, mono, fltp

Input #0, rtsp, from 'rtsp://127.0.0.1:8554/front_doorbell_detect':
  Metadata:
    title           : go2rtc/1.9.2
  Duration: N/A, start: 0.200000, bitrate: N/A
  Stream #0:0: Video: h264 (High), yuv420p(progressive), 720x576, 5 fps, 5 tbr, 90k tbn

Frigate stats

n/a

Operating system

Other Linux: Joshua-Riek/ubuntu-rockchip

Install method

Docker Compose

Coral version

Other: Rockchip rk3588

Network connection

Wired

Camera make and model

Amcrest AD410

Any other information that may be helpful

No response

[NickM-27]

the view without the live stream has to use the detect resolution, there is nothing else that can be used as a source of truth.

[nyanmisaka]

@MarcA711 Maybe enable GH actions and let it do the heavy lifting.

[MarcA711]

@nyanmisaka thank you for the suggestion. I was already thinking about that, but I have no experience with it. But since btbn already implemented it and I just have to activate it with some minor changes, I should give it a try.

[MarcA711]

@jtut1731 could you try if this image fixes your color issues:

docker pull ghcr.io/blakeblackshear/frigate:dev-7a4eb0b-rk

The aspect ratio can only be fixed by rescaling. However, this can be done using hw acceleration and your frames have a low resolution, so this shouldn't have a big impact on performance.

[jtut1731]

Thanks @MarcA711, color issue is resolved with frigate:dev-7a4eb0b-rk!
Could you explain how exactly to rescale? Is this using the detect height and width config setting, or some customized ffmpeg command flag?

My:
record stream resolution is 2560x1920 (1.3333:1 ratio)
detect stream resolution is 720x576 (1.25:1 ratio)

So in order to get the detect stream in the same aspect ratio, I could use either:
scale width, fixed height: 768x576 (1.3333:1 ratio) (stretches horizontal detail) <-- I would probably prefer
fixed width, scale height: 720x540 (1.3333:1 ratio) (loses vertical detail)

[MarcA711]

Hey,
yes hardware rescaling can be done using width and height of detector in the config.

scale width, fixed height: 768x576 (1.3333:1 ratio) (stretches horizontal detail) <-- I would probably prefer

It doesn't matter how you re-scale, so you can use this resolution.

However, the best solution for you might be to just add small black bars left and right. This way you don't have to re-scale your image. This can also be done using rockchip hardware. See the overlay_rkrga at the bottom of this page. If I have some time I can post some instructions.