Accessing the video stream with v4l-utils #672

krakowski · 2023-07-16T11:50:16Z

krakowski
Jul 16, 2023

Hi,

I recently compiled v4l-utils to display the properties of the video nodes and generate an image of the media pipeline. Since all /dev/video* nodes are in use by rmm and killing rmm results in a reboot, I simply killed rmm and queried all data fast enough before a reboot happened. My model is RFUS @ 12.0.35. Here is what I found out.

It looks like this is the sensor used (GC2053) inside my device: https://taoic.oss-cn-hangzhou.aliyuncs.com/6446/product/XTW2020_1589249333000.pdf
Controlling /dev/video3 influences the RTSP output. For example v4l2-ctl --device /dev/video3 -c brightness=100 increases the brightness. One interesting setting I found is the ISO setting, which allows to set a lower ISO number.
```
# Disable ISO auto mode
v4l2-ctl --device /dev/video3 -c iso_sensitivity_auto=0

# Set ISO to 100
v4l2-ctl --device /dev/video3 -c iso_sensitivity=0
```
All other video device nodes (/dev/video0, /dev/video1, /dev/video2) are used by rmm and return Resource busy when trying to open them.
The pixel format coming from the camera's sensor seems to be RAW10 (SGRBG10).
Here's the compiled version, if anyone wants to try it out, too : v4l-utils.zip

@roleoroleo Do you know how one can kill rmm without triggering the watchdog? I would like to try accessing the video stream through /dev/video0 (1920x1080) and maybe compile https://github.com/pikvm/ustreamer for my device. Ideally I would like to add another video node (e.g. /dev/video4) which gets connected to one of the media pipeline entities, so that I could process the raw frames (without overlays and preprocessing). Haven't found a way to accomplish this yet, though.

Media Pipeline Topology (`media-ctl --print-dot`)

Text Version (media-ctl --print-topology)

Media controller API version 0.1.0

Media device information
------------------------
driver          sunxi-vin-media
model           Allwinner Vin
serial          
bus info        
hw revision     0x0
driver version  0.0.0

Device topology
- entity 1: gc2053_mipi (1 pad, 4 links)
          type V4L2 subdev subtype Sensor flags 0
          device node name /dev/v4l-subdev0
  pad0: Source
  	[fmt:SGRBG10_1X10/1936x1096 field:none]
  	-> "sunxi_mipi.0":0 [ENABLED]
  	-> "sunxi_mipi.0":0 []
  	-> "sunxi_mipi.0":0 []
  	-> "sunxi_mipi.0":0 []

- entity 3: vin_cap.0 (2 pads, 2 links)
          type Node subtype V4L flags 0
          device node name /dev/v4l-subdev1
  pad0: Sink
  	<- "sunxi_scaler.0":1 [ENABLED]
  pad1: Source
  	-> "vin_video0":0 [ENABLED]

- entity 6: vin_video0 (1 pad, 1 link)
          type Node subtype V4L flags 0
          device node name /dev/video0
  pad0: Sink
  	<- "vin_cap.0":1 [ENABLED]

- entity 10: vin_cap.1 (2 pads, 2 links)
           type Node subtype V4L flags 0
           device node name /dev/v4l-subdev2
  pad0: Sink
  	<- "sunxi_scaler.1":1 [ENABLED]
  pad1: Source
  	-> "vin_video1":0 [ENABLED]

- entity 13: vin_video1 (1 pad, 1 link)
           type Node subtype V4L flags 0
           device node name /dev/video1
  pad0: Sink
  	<- "vin_cap.1":1 [ENABLED]

- entity 17: vin_cap.2 (2 pads, 2 links)
           type Node subtype V4L flags 0
           device node name /dev/v4l-subdev3
  pad0: Sink
  	<- "sunxi_scaler.2":1 [ENABLED]
  pad1: Source
  	-> "vin_video2":0 [ENABLED]

- entity 20: vin_video2 (1 pad, 1 link)
           type Node subtype V4L flags 0
           device node name /dev/video2
  pad0: Sink
  	<- "vin_cap.2":1 [ENABLED]

- entity 24: vin_cap.3 (2 pads, 2 links)
           type Node subtype V4L flags 0
           device node name /dev/v4l-subdev4
  pad0: Sink
  	<- "sunxi_scaler.3":1 [ENABLED]
  pad1: Source
  	-> "vin_video3":0 [ENABLED]

- entity 27: vin_video3 (1 pad, 1 link)
           type Node subtype V4L flags 0
           device node name /dev/video3
  pad0: Sink
  	<- "vin_cap.3":1 [ENABLED]

- entity 31: sunxi_csi.0 (2 pads, 6 links)
           type Node subtype V4L flags 0
           device node name /dev/v4l-subdev5
  pad0: Sink
  	<- "sunxi_mipi.0":1 [ENABLED]
  	<- "sunxi_mipi.0":1 [ENABLED]
  	<- "sunxi_mipi.0":1 [ENABLED]
  	<- "sunxi_mipi.0":1 [ENABLED]
  pad1: Source
  	-> "sunxi_isp.0":0 [ENABLED]
  	-> "sunxi_isp.1":0 []

- entity 34: sunxi_csi.1 (2 pads, 2 links)
           type Node subtype V4L flags 0
           device node name /dev/v4l-subdev6
  pad0: Sink
  pad1: Source
  	-> "sunxi_isp.0":0 []
  	-> "sunxi_isp.1":0 []

- entity 37: sunxi_mipi.0 (2 pads, 8 links)
           type Node subtype V4L flags 0
           device node name /dev/v4l-subdev7
  pad0: Sink
  	<- "gc2053_mipi":0 [ENABLED]
  	<- "gc2053_mipi":0 []
  	<- "gc2053_mipi":0 []
  	<- "gc2053_mipi":0 []
  pad1: Source
  	-> "sunxi_csi.0":0 [ENABLED]
  	-> "sunxi_csi.0":0 [ENABLED]
  	-> "sunxi_csi.0":0 [ENABLED]
  	-> "sunxi_csi.0":0 [ENABLED]

- entity 40: sunxi_isp.0 (3 pads, 7 links)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev8
  pad0: Sink
  	[fmt:SGRBG10_1X10/1936x1096 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown]
  	<- "sunxi_csi.0":1 [ENABLED]
  	<- "sunxi_csi.1":1 []
  pad1: Source
  	[fmt:SGRBG10_1X10/1936x1096 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown]
  	-> "sunxi_h3a.0":0 [ENABLED,IMMUTABLE]
  pad2: Source
  	[fmt:SGRBG10_1X10/1936x1096 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown]
  	-> "sunxi_scaler.0":0 [ENABLED]
  	-> "sunxi_scaler.1":0 [ENABLED]
  	-> "sunxi_scaler.2":0 [ENABLED]
  	-> "sunxi_scaler.3":0 [ENABLED]

- entity 44: sunxi_h3a.0 (1 pad, 1 link)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev9
  pad0: Sink
  	<- "sunxi_isp.0":1 [ENABLED,IMMUTABLE]

- entity 46: sunxi_isp.1 (3 pads, 7 links)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev10
  pad0: Sink
  	[fmt:unknown/0x0]
  	<- "sunxi_csi.0":1 []
  	<- "sunxi_csi.1":1 []
  pad1: Source
  	[fmt:unknown/0x0]
  	-> "sunxi_h3a.1":0 [ENABLED,IMMUTABLE]
  pad2: Source
  	[fmt:unknown/0x0]
  	-> "sunxi_scaler.0":0 []
  	-> "sunxi_scaler.1":0 []
  	-> "sunxi_scaler.2":0 []
  	-> "sunxi_scaler.3":0 []

- entity 50: sunxi_h3a.1 (1 pad, 1 link)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev11
  pad0: Sink
  	<- "sunxi_isp.1":1 [ENABLED,IMMUTABLE]

- entity 52: sunxi_scaler.0 (2 pads, 3 links)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev12
  pad0: Sink
  	[fmt:SGRBG10_1X10/1936x1096 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown
  	 crop.bounds:(0,0)/1936x1096
  	 crop:(4,4)/1920x1080]
  	<- "sunxi_isp.0":2 [ENABLED]
  	<- "sunxi_isp.1":2 []
  pad1: Source
  	[fmt:SGRBG10_1X10/1920x1080 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown]
  	-> "vin_cap.0":0 [ENABLED]

- entity 55: sunxi_scaler.1 (2 pads, 3 links)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev13
  pad0: Sink
  	[fmt:SGRBG10_1X10/1936x1096 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown
  	 crop.bounds:(0,0)/1936x1096
  	 crop:(4,4)/1920x1080]
  	<- "sunxi_isp.0":2 [ENABLED]
  	<- "sunxi_isp.1":2 []
  pad1: Source
  	[fmt:SGRBG10_1X10/640x360 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown]
  	-> "vin_cap.1":0 [ENABLED]

- entity 58: sunxi_scaler.2 (2 pads, 3 links)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev14
  pad0: Sink
  	[fmt:SGRBG10_1X10/1936x1096 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown
  	 crop.bounds:(0,0)/1936x1096
  	 crop:(4,4)/1920x1080]
  	<- "sunxi_isp.0":2 [ENABLED]
  	<- "sunxi_isp.1":2 []
  pad1: Source
  	[fmt:SGRBG10_1X10/640x360 field:none colorspace:rec709 xfer:unknown ycbcr:unknown quantization:unknown]
  	-> "vin_cap.2":0 [ENABLED]

- entity 61: sunxi_scaler.3 (2 pads, 3 links)
           type V4L2 subdev subtype Unknown flags 0
           device node name /dev/v4l-subdev15
  pad0: Sink
  	[fmt:unknown/0x0
  	 crop.bounds:(0,0)/0x0
  	 crop:(0,0)/0x0]
  	<- "sunxi_isp.0":2 [ENABLED]
  	<- "sunxi_isp.1":2 []
  pad1: Source
  	[fmt:unknown/0x0]
  	-> "vin_cap.3":0 [ENABLED]

Video 4 Linux 2 Information

v4l2-ctl --device /dev/video0 --all

Driver Info:
  Driver name      : sunxi-vin
  Card type        : sunxi-vin
  Bus info         : 
  Driver version   : 1.0.0
  Capabilities     : 0x85201000
  	Video Capture Multiplanar
  	Read/Write
  	Streaming
  	Extended Pix Format
  	Device Capabilities
  Device Caps      : 0x00200000
  	Extended Pix Format
Media Driver Info:
  Driver name      : sunxi-vin-media
  Model            : Allwinner Vin
  Serial           : 
  Bus info         : 
  Media version    : 0.1.0
  Hardware revision: 0x00000000 (0)
  Driver version   : 0.0.0
Interface Info:
  ID               : 0x03000007
  Type             : V4L Video
Entity Info:
  ID               : 0x00000006 (6)
  Name             : vin_video0
  Function         : V4L2 I/O
  Pad 0x01000009   : Sink
    Link 0x02000046: from remote pad 0x1000005 of entity 'vin_cap.0' (V4L2 I/O): Data, Enabled
Priority: 2
Video input : 0 (sunxi-vin: ok)
Selection Video Capture: crop, Left 4, Top 4, Width 1920, Height 1080, Flags: 
Selection Video Capture: crop_bounds, Left 0, Top 0, Width 1936, Height 1096, Flags: 
Selection Video Output: crop, Left 4, Top 4, Width 1920, Height 1080, Flags: 
Selection Video Output: crop_bounds, Left 0, Top 0, Width 1936, Height 1096, Flags: 

User Controls

                   brightness 0x00980900 (int)    : min=-128 max=128 step=1 default=0 value=0 flags=slider
                     contrast 0x00980901 (int)    : min=-128 max=128 step=1 default=0 value=0 flags=slider
                   saturation 0x00980902 (int)    : min=-256 max=512 step=1 default=0 value=0 flags=slider
                          hue 0x00980903 (int)    : min=-180 max=180 step=1 default=0 value=0 flags=slider
      white_balance_automatic 0x0098090c (bool)   : default=1 value=1
                     exposure 0x00980911 (int)    : min=1 max=1048576 step=1 default=1 value=4640 flags=volatile
               gain_automatic 0x00980912 (bool)   : default=1 value=1
                         gain 0x00980913 (int)    : min=16 max=96000 step=1 default=16 value=16 flags=volatile
              horizontal_flip 0x00980914 (bool)   : default=0 value=0
                vertical_flip 0x00980915 (bool)   : default=0 value=0
         power_line_frequency 0x00980918 (menu)   : min=0 max=3 default=3 value=3 (Auto)
  			0: Disabled
  			1: 50 Hz
  			2: 60 Hz
  			3: Auto
                hue_automatic 0x00980919 (bool)   : default=1 value=1
    white_balance_temperature 0x0098091a (int)    : min=2800 max=10000 step=1 default=6500 value=6500
                    sharpness 0x0098091b (int)    : min=0 max=1000 step=1 default=0 value=0 flags=slider
                   chroma_agc 0x0098091d (bool)   : default=1 value=1
                color_effects 0x0098091f (menu)   : min=0 max=15 default=0 value=0 (None)
  			0: None
  			1: Black & White
  			2: Sepia
  			3: Negative
  			4: Emboss
  			5: Sketch
  			6: Sky Blue
  			7: Grass Green
  			8: Skin Whiten
  			9: Vivid
  			10: Aqua
  			11: Art Freeze
  			12: Silhouette
  			13: Solarization
  			14: Antique
  			15: Set Cb/Cr
         brightness_automatic 0x00980920 (bool)   : default=1 value=1
             band_stop_filter 0x00980921 (int)    : min=0 max=1 step=1 default=1 value=1
                illuminator_1 0x00980925 (bool)   : default=0 value=0
                illuminator_2 0x00980926 (bool)   : default=0 value=0
            autofocus_initial 0x00981952 (button) : value=0 flags=write-only, execute-on-write
            autofocus_release 0x00981953 (button) : value=0 flags=write-only, execute-on-write
              gsensor_rotaion 0x00981954 (int)    : min=-180 max=180 step=90 default=0 value=0
                 take_picture 0x00981956 (int)    : min=0 max=16 step=1 default=0 value=0
      horizontal_visual_angle 0x00981957 (int)    : min=0 max=360 step=1 default=60 value=60 flags=read-only, volatile
        vertical_visual_angle 0x00981958 (int)    : min=0 max=360 step=1 default=60 value=60 flags=read-only, volatile
                 focus_length 0x00981959 (int)    : min=0 max=1000 step=1 default=280 value=280 flags=volatile
                  sensor_type 0x0098195e (menu)   : min=0 max=1 default=0 value=1 (RAW) flags=volatile
  			0: YUV
  			1: RAW
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN
error 22 getting ctrl R GAIN

Camera Controls

                auto_exposure 0x009a0901 (menu)   : min=0 max=3 default=0 value=0 (Auto Mode)
  			0: Auto Mode
  			1: Manual Mode
  			2: Shutter Priority Mode
  			3: Aperture Priority Mode
       exposure_time_absolute 0x009a0902 (int)    : min=1 max=30000000 step=1 default=1 value=12888 flags=volatile
   exposure_dynamic_framerate 0x009a0903 (bool)   : default=0 value=0
               focus_absolute 0x009a090a (int)    : min=0 max=127 step=1 default=0 value=0
               focus_relative 0x009a090b (int)    : min=-127 max=127 step=1 default=0 value=0 flags=write-only, execute-on-write
   focus_automatic_continuous 0x009a090c (bool)   : default=1 value=1
           auto_exposure_bias 0x009a0913 (intmenu): min=0 max=8 default=4 value=4 (0 0x0)
  			0: -4 (0xfffffffffffffffc)
  			1: -3 (0xfffffffffffffffd)
  			2: -2 (0xfffffffffffffffe)
  			3: -1 (0xffffffffffffffff)
  			4: 0 (0x0)
  			5: 1 (0x1)
  			6: 2 (0x2)
  			7: 3 (0x3)
  			8: 4 (0x4)
    white_balance_auto_preset 0x009a0914 (menu)   : min=0 max=9 default=1 value=1 (Auto)
  			0: Manual
  			1: Auto
  			2: Incandescent
  			3: Fluorescent
  			4: Fluorescent H
  			5: Horizon
  			6: Daylight
  			7: Flash
  			8: Cloudy
  			9: Shade
           wide_dynamic_range 0x009a0915 (bool)   : default=0 value=0
          image_stabilization 0x009a0916 (bool)   : default=0 value=0
              iso_sensitivity 0x009a0917 (intmenu): min=0 max=6 default=2 value=2 (400 0x190)
  			0: 100 (0x64)
  			1: 200 (0xc8)
  			2: 400 (0x190)
  			3: 800 (0x320)
  			4: 1600 (0x640)
  			5: 3200 (0xc80)
  			6: 6400 (0x1900)
         iso_sensitivity_auto 0x009a0918 (menu)   : min=0 max=1 default=1 value=1 (Auto)
  			0: Manual
  			1: Auto
       exposure_metering_mode 0x009a0919 (menu)   : min=0 max=3 default=0 value=0 (Average)
  			0: Average
  			1: Center Weighted
  			2: Spot
  			3: Matrix
                   scene_mode 0x009a091a (menu)   : min=0 max=13 default=0 value=0 (None)
  			0: None
  			1: Backlight
  			2: Beach/Snow
  			3: Candle Light
  			4: Dusk/Dawn
  			5: Fall Colors
  			6: Fireworks
  			7: Landscape
  			8: Night
  			9: Party/Indoor
  			10: Portrait
  			11: Sports
  			12: Sunset
  			13: Text
                      3a_lock 0x009a091b (bitmask): max=0x00000007 default=0x00000000 value=0 flags=volatile
             auto_focus_start 0x009a091c (button) : value=0 flags=write-only, execute-on-write
              auto_focus_stop 0x009a091d (button) : value=0 flags=write-only, execute-on-write
            auto_focus_status 0x009a091e (bitmask): max=0x00000007 default=0x00000000 value=0 flags=read-only, volatile
             auto_focus_range 0x009a091f (menu)   : min=0 max=3 default=0 value=0 (Auto)
  			0: Auto
  			1: Normal
  			2: Macro
  			3: Infinity

Flash Controls

                     led_mode 0x009c0901 (menu)   : min=0 max=4 default=0 value=0 (Off)
  			0: Off
  			1: Flash
  			2: Torch
  			4: Software

v4l2-ctl -d /dev/v4l-subdev0 --get-subdev-fmt 0

VIDIOC_SUBDEV_QUERYCAP: failed: Invalid argument
ioctl: VIDIOC_SUBDEV_G_FMT (pad=0)
  Width/Height      : 1936/1096
  Mediabus Code     : 0x300a (MEDIA_BUS_FMT_SGRBG10_1X10)
  Field             : None
  Colorspace        : Default
  Transfer Function : Default (maps to Rec. 709)
  YCbCr/HSV Encoding: Default (maps to ITU-R 601)
  Quantization      : Default (maps to Full Range)

roleoroleo · 2023-07-16T13:09:13Z

roleoroleo
Jul 16, 2023
Maintainer

Interesting work.
Thank you for sharing it.
About watchdog, there is a "high level" watchdog added by me that you can disable killing wd_rtsp.sh
But I don't remember if there is another watchdog.

1 reply

krakowski Jul 16, 2023
Author

Thanks for your response. Didn't know it was a custom watchdog running on the device. Killing it keeps my device running after killing rmm :)

I tried streaming one frame from /dev/video0 to a file (according to v4l2-ctl examples), which doesn't seem to work due to mmap not being supported by the camera's driver (I guess?).

$ v4l2-ctl --device /dev/video0 --stream-mmap --stream-count=1 --stream-to=file.raw

unsupported stream type

Also ran v4l2-compliance which does not look good (lots of FAILs).

Output of v4l2-compliance

v4l2-compliance 1.24.1, 32 bits, 32-bit time_t

Compliance test for sunxi-vin device /dev/video0:

Driver Info:
	Driver name      : sunxi-vin
	Card type        : sunxi-vin
	Bus info         : 
	Driver version   : 1.0.0
	Capabilities     : 0x85201000
		Video Capture Multiplanar
		Read/Write
		Streaming
		Extended Pix Format
		Device Capabilities
	Device Caps      : 0x00200000
		Extended Pix Format
Media Driver Info:
	Driver name      : sunxi-vin-media
	Model            : Allwinner Vin
	Serial           : 
	Bus info         : 
	Media version    : 0.1.0
	Hardware revision: 0x00000000 (0)
	Driver version   : 0.0.0
Interface Info:
	ID               : 0x03000007
	Type             : V4L Video
Entity Info:
	ID               : 0x00000006 (6)
	Name             : vin_video0
	Function         : V4L2 I/O
	Pad 0x01000009   : Sink
	  Link 0x02000046: from remote pad 0x1000005 of entity 'vin_cap.0' (V4L2 I/O): Data, Enabled

Required ioctls:
	test MC information (see 'Media Driver Info' above): OK
		fail: v4l2-compliance.cpp(298): string empty
		fail: v4l2-compliance.cpp(646): check_ustring(vcap.bus_info, sizeof(vcap.bus_info))
	test VIDIOC_QUERYCAP: FAIL
	test invalid ioctls: OK

Allow for multiple opens:
	test second /dev/video0 open: FAIL
		fail: v4l2-compliance.cpp(753): !ok
	test for unlimited opens: FAIL

Debug ioctls:
	test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
	test VIDIOC_LOG_STATUS: OK (Not Supported)

Input ioctls:
	test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
	test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
	test VIDIOC_ENUMAUDIO: OK (Not Supported)
		fail: v4l2-test-input-output.cpp(554): could set input to invalid input 1
	test VIDIOC_G/S/ENUMINPUT: FAIL
	test VIDIOC_G/S_AUDIO: OK (Not Supported)
	Inputs: 1 Audio Inputs: 0 Tuners: 0

Output ioctls:
	test VIDIOC_G/S_MODULATOR: OK (Not Supported)
	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
	test VIDIOC_ENUMAUDOUT: OK (Not Supported)
	test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
	test VIDIOC_G/S_AUDOUT: OK (Not Supported)
	Outputs: 0 Audio Outputs: 0 Modulators: 0

Input/Output configuration ioctls:
	test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
	test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK (Not Supported)
	test VIDIOC_DV_TIMINGS_CAP: OK (Not Supported)
	test VIDIOC_G/S_EDID: OK (Not Supported)

Control ioctls (Output 0):
	test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
	test VIDIOC_QUERYCTRL: OK
		fail: v4l2-test-controls.cpp(413): returned control value out of range
		fail: v4l2-test-controls.cpp(477): invalid control 00980911
	test VIDIOC_G/S_CTRL: FAIL
		fail: v4l2-test-controls.cpp(615): returned control value out of range
		fail: v4l2-test-controls.cpp(930): invalid control 00980911
	test VIDIOC_G/S/TRY_EXT_CTRLS: FAIL
		fail: v4l2-test-controls.cpp(1115): failed to find event for control 'Brightness'
	test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: FAIL
	test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
	Standard Controls: 43 Private Controls: 16

Format ioctls (Output 0):
		fail: v4l2-test-formats.cpp(182): invalid step_width/height for continuous framesize
	test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: FAIL
		fail: v4l2-test-formats.cpp(1302): cap->capturemode & ~V4L2_MODE_HIGHQUALITY
	test VIDIOC_G/S_PARM: FAIL
	test VIDIOC_G_FBUF: OK (Not Supported)
		fail: v4l2-test-formats.cpp(634): Video Overlay cap not set, but Video Overlay formats defined
	test VIDIOC_G_FMT: FAIL
		fail: v4l2-test-formats.cpp(558): win.clipcount && !(node->fbuf_caps & V4L2_FBUF_CAP_LIST_CLIPPING)
	test VIDIOC_TRY_FMT: FAIL
		fail: v4l2-test-formats.cpp(558): win.clipcount && !(node->fbuf_caps & V4L2_FBUF_CAP_LIST_CLIPPING)
	test VIDIOC_S_FMT: FAIL
	test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
		fail: v4l2-test-formats.cpp(1645): doioctl(node, VIDIOC_G_SELECTION, &sel)
		fail: v4l2-test-formats.cpp(1658): testLegacyCrop(node)
	test Cropping: FAIL
		fail: v4l2-test-formats.cpp(1770): doioctl(node, VIDIOC_G_SELECTION, &sel) != ENOTTY
	test Composing: FAIL
	test Scaling: OK (Not Supported)

Codec ioctls (Output 0):
	test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
	test VIDIOC_G_ENC_INDEX: OK (Not Supported)
	test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)

Buffer ioctls (Output 0):
		fail: v4l2-test-buffers.cpp(554): node->node2 == nullptr
	test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: FAIL
	test VIDIOC_EXPBUF: OK (Not Supported)
	test Requests: OK (Not Supported)
	test TIME32/64: OK

Total for sunxi-vin device /dev/video0: 45, Succeeded: 30, Failed: 15, Warnings: 0

gabest11 · 2024-07-05T06:23:54Z

gabest11
Jul 5, 2024

I got a terrible batch of 4 (Yi 1080p Home 9FUS y20ga 12.2.0.2_202212191129 Allwinner-v1). The contrast is so bad I can see a white halo around black holes and outside everything is too bright in sunlight. I even swapped the lens assembly with an old mstar model, and it made that worse, too (but not that worse). Not sure what is going on, maybe the lens is bad?

So I tried to use this precompiled v4l2-ctl and it kinda works. Brightness works, but changing contrast makes everything orange, and after the first call I get a segfault and "resource busy", every attempt needs a reboot. Is something different between Allwinner v1 and v2? I don't know how to cross compile it.

(sidenote, the update to v12 firmware shifted the address of the serial number ahead by four)

Yea, the quality is terrible, this is about two meters away. There is some artifical image enhancing going on. No other explanation for the halo effect. Those are mounting holes for shelves.

0 replies

coxtor · 2024-07-11T16:55:41Z

coxtor
Jul 11, 2024

Hi there, @krakowski thanks for your work - I found out that my robot vacuum l10s ultra is using exactly the same camera as your device. Could you perhaps upload a arm64 build of your binaries, perhaps even a statically linked one? I am trying to access the videostream, however it fails with:

[video4linux2,v4l2 @ 0x18868930] Not a video capture device.
[in#0 @ 0x188686d0] Error opening input: No such device
Error opening input file /dev/video0.
Error opening input files: No such device

There is a camera test binary that gives this output - this gives me hope that I can access the camera with your binary:

[CAMERA] open /dev/video0!
[CAMERA]**********************************************************
[CAMERA_DEBUG] Querey device capabilities succeed
[CAMERA_DEBUG] cap.driver=sunxi-vin
[CAMERA_DEBUG] cap.card=sunxi-vin
[CAMERA_DEBUG] cap.bus_info=
[CAMERA_DEBUG] cap.version=0x00010000
[CAMERA_DEBUG] cap.capabilities=0x85201000

1 reply

ForksCoolStuff Oct 11, 2024

Hi there, @krakowski thanks for your work - I found out that my robot vacuum l10s ultra is using exactly the same camera as your device. Could you perhaps upload a arm64 build of your binaries, perhaps even a statically linked one? I am trying to access the videostream, however it fails with:
[video4linux2,v4l2 @ 0x18868930] Not a video capture device.
[in#0 @ 0x188686d0] Error opening input: No such device
Error opening input file /dev/video0.
Error opening input files: No such device
There is a camera test binary that gives this output - this gives me hope that I can access the camera with your binary:
[CAMERA] open /dev/video0!
[CAMERA]**********************************************************
[CAMERA_DEBUG] Querey device capabilities succeed
[CAMERA_DEBUG] cap.driver=sunxi-vin
[CAMERA_DEBUG] cap.card=sunxi-vin
[CAMERA_DEBUG] cap.bus_info=
[CAMERA_DEBUG] cap.version=0x00010000
[CAMERA_DEBUG] cap.capabilities=0x85201000

Hi there, I ran across the same exact need, even down to the robot vacuum model. Though I'd drop this here in case you or anyone else still needed it. It is statically compiled and I've tested it on my own vacuum. Should work.
v4l2-ctl_aarch64.zip

I cross compiled this on a Steam Deck and I've never used meson before, so ymmv.

coxtor · 2024-10-11T20:21:59Z

Wow awesome @ForksCoolStuff . how do you use the binary? Thanks so much!

Update: Turns out there was already a copy of v4l2-ctl in /audio/SYS/CAL/v4l2-ctl. So that was pointless. Good to know, though.

Also check out https://github.com/alufers/dreame_mcu_protocol/blob/master/dreame_z10_notes.md

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Accessing the video stream with v4l-utils #672

{{title}}

Replies: 4 comments 4 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Accessing the video stream with v4l-utils #672

krakowski Jul 16, 2023

Media Pipeline Topology (media-ctl --print-dot)

Video 4 Linux 2 Information

Replies: 4 comments · 4 replies

roleoroleo Jul 16, 2023 Maintainer

krakowski Jul 16, 2023 Author

gabest11 Jul 5, 2024

coxtor Jul 11, 2024

ForksCoolStuff Oct 11, 2024

coxtor Oct 11, 2024

ForksCoolStuff Oct 11, 2024

ForksCoolStuff Oct 11, 2024

krakowski
Jul 16, 2023

Media Pipeline Topology (`media-ctl --print-dot`)

Replies: 4 comments 4 replies

roleoroleo
Jul 16, 2023
Maintainer

krakowski Jul 16, 2023
Author

gabest11
Jul 5, 2024

coxtor
Jul 11, 2024

coxtor
Oct 11, 2024