Re: IPU6 Camera Video Output Upside Down

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Bingbu,

On Mon, Aug 19, 2024 at 12:32:52AM +0000, Cao, Bingbu wrote:
> On Sunday, August 18, 2024 8:39 AM, Laurent Pinchart wrote:
> > On Sat, Aug 17, 2024 at 08:00:24PM -0400, Kelvin Miller wrote:
> >> All,
> >>
> >> I don't know who to direct this to, so I added the names of
> >> individuals working on intel_ipu6 related patches.
> >
> > I've added Sakari Ailus to the CC list and dropped Arnd as he's not
> > involved.
> >
> >> I'm running the 6.10.5-arch1-1 and 6.10.5-arch1-1-surface kernelson a
> >> Microsoft Surface Pro 8 in EndeavourOS. The Surface Pro 8 has the
> >> ov5693 (front) and ov13858 (rear) sensors. Only the front sensor is
> >> recognized by libcamera. In all of the camera applications that Iused
> >> (cheese, kamoso, and qcam) the video is inverted (upside down). Itwas
> >> recommended on the Surface Linux Github page
> >> (https://github.com/linux-surface/linux-surface/discussions/1354#discussioncomment-10367513)
> >> that I report this issue here.
> >>
> >> Here are some outputs:
> >>
> >> $ v4l2-ctl -l -d $(media-ctl -d /dev/media0 -e 'ov5693 2-0036')
> >>
> >> User Controls
> >>
> >>                       exposure 0x00980911 (int)    : min=1 max=1030 step=1 default=1030 value=1030
> >>                horizontal_flip 0x00980914 (bool)   : default=0 value=0
> >>                  vertical_flip 0x00980915 (bool)   : default=0 value=0
> >>
> >> Camera Controls
> >>
> >>             camera_orientation 0x009a0922 (menu)   : min=0 max=2 default=0 value=0 (Front) flags=read-only
> >>         camera_sensor_rotation 0x009a0923 (int)    : min=0 max=0 step=1 default=0 value=0 flags=read-only
> >>
> >> Image Source Controls
> >>
> >>              vertical_blanking 0x009e0901 (int)    : min=4max=64563 step=1 default=66 value=66
> >>            horizontal_blanking 0x009e0902 (int)    : min=1392max=1392 step=1 default=1392 value=1392 flags=read-only
> >>                  analogue_gain 0x009e0903 (int)    : min=1 max=127 step=1 default=8 value=127
> >>
> >> Image Processing Controls
> >>
> >>                 link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (419200000 0x18fc7c00) flags=read-only
> >>                     pixel_rate 0x009f0902 (int64)  : min=0 max=167680000 step=1 default=167680000 value=167680000 flags=read-only
> >>                   test_pattern 0x009f0903 (menu)   : min=0 max=3 default=0 value=0 (Disabled)
> >>                   digital_gain 0x009f0905 (int)    : min=1 max=4095 step=1 default=1024 value=1024
> >
> > Looking at this, the sensor reports it's mounted upside-up (through
> > camera_sensor_rotation), which makes me suspect that either the
> > information in the _PLD is incorrect, or the _PLD is not correctly
> > taken into account. Bingbu, Sakari, could you help Kelvin to
> > investigate this ?
> 
> As Laurent said, it is likely that rotation/orientation is not considered
> in ov5693 driver. Which resolution are you running? I checked the camera
> sensor driver and the default flip for 2104x1560, 2080x1170 and 1364x768
> is vertical flip.
> 
> 	{0x3820, 0x8b},
> 
> 0x88 is the normal without flip enabled.

Are we looking at the same driver ? In mainline, register 0x3820 is
initialized to 0x00 in ov5693_global_regs. The
OV5693_FORMAT1_FLIP_VERT_ISP_EN and OV5693_FORMAT1_FLIP_VERT_SENSOR_EN
bits are then set in ov5693_flip_vert_configure when the vflip control
is set to true. The OV5693_FORMAT1_VBIN_EN is additionally set in
ov5693_mode_configure() when binning vertically, but that shouldn't be
related. I don't see any other place where the register value is
changed.

> >> $ lsmod | grep ipu
> >> intel_ipu6_isys       143360  6
> >> videobuf2_dma_contig   28672  2 intel_ipu6_isys
> >> videobuf2_v4l2         40960  1 intel_ipu6_isys
> >> videobuf2_common       94208  4 videobuf2_dma_contig,videobuf2_v4l2,intel_ipu6_isys,videobuf2_memops
> >> v4l2_fwnode            32768  8 ov5693,intel_ipu6_isys,ov13858
> >> v4l2_async             32768  4 v4l2_fwnode,ov5693,intel_ipu6_isys,ov13858
> >> videodev              393216  15 v4l2_async,v4l2_fwnode,videobuf2_v4l2,ov5693,v4l2loopback,intel_ipu6_isys,ov13858
> >> mc                     90112  9 v4l2_async,videodev,videobuf2_v4l2,ov5693,intel_ipu6_isys,ov13858,videobuf2_common
> >> intel_ipu6             86016  7 intel_ipu6_isys
> >> ipu_bridge             24576  2 intel_ipu6,intel_ipu6_isys
> >>
> >> $ LIBCAMERA_LOG_LEVELS=0 cam --list
> >> [1:10:50.807754803] [10863] DEBUG IPAModule ipa_module.cpp:334 ipa_ipu3.so: IPA module /usr/lib/libcamera/ipa_ipu3.so is signed
> >> [1:10:50.807872559] [10863] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_ipu3.so'
> >> [1:10:50.807962280] [10863] DEBUG IPAModule ipa_module.cpp:334 ipa_soft_simple.so: IPA module/usr/lib/libcamera/ipa_soft_simple.so is signed
> >> [1:10:50.807980265] [10863] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_soft_simple.so'
> >> [1:10:50.808012629] [10863] DEBUG IPAModule ipa_module.cpp:334 ipa_vimc.so: IPA module /usr/lib/libcamera/ipa_vimc.so is signed
> >> [1:10:50.808025804] [10863] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_vimc.so'
> >> [1:10:50.808050072] [10863] ERROR IPAModule ipa_module.cpp:172Symbol ipaModuleInfo not found
> >> [1:10:50.808057333] [10863] ERROR IPAModule ipa_module.cpp:292 v4l2-compat.so: IPA module has no valid info
> >> [1:10:50.808131102] [10863]  INFO Camera camera_manager.cpp:325 libcamera v0.3.1+64-ce690bd9-dirty (2024-08-17T16:17:18EDT)
> >> [1:10:50.808343190] [10864] DEBUG Camera camera_manager.cpp:73 Starting camera manager
> >> [1:10:50.821605192] [10864] DEBUG DeviceEnumerator device_enumerator.cpp:230 New media device "intel-ipu6" createdfrom /dev/media0
> >> [1:10:50.824319260] [10864] DEBUG DeviceEnumerator device_enumerator_udev.cpp:96 Defer media device /dev/media0 due to1 missing dependencie s
> >> [1:10:50.824612021] [10864] DEBUG DeviceEnumerator device_enumerator_udev.cpp:322 All dependencies for media device /dev/media0 found
> >> [1:10:50.824624081] [10864] DEBUG DeviceEnumerator device_enumerator.cpp:258 Added device /dev/media0: intel-ipu6
> >> [1:10:50.825560945] [10864] DEBUG Camera camera_manager.cpp:138Found registered pipeline handler 'ipu3'
> >> [1:10:50.825858267] [10864] DEBUG Camera camera_manager.cpp:138Found registered pipeline handler 'simple'
> >> [1:10:50.825960032] [10864] DEBUG DeviceEnumerator device_enumerator.cpp:318 Successful match for media device "intel-ipu6"
> >> [1:10:50.826073453] [10864] DEBUG SimplePipeline simple.cpp:1554 Sensor found for /dev/media0
> >> [1:10:50.826578250] [10864] DEBUG SimplePipeline simple.cpp:417 Found capture device Intel IPU6 ISYS Capture 32
> >> [1:10:50.826673664] [10864] DEBUG V4L2v4l2_device.cpp:636 'ov5693 2-0036': Control: Exposure (0x00980911)
> >> [1:10:50.826807959] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Horizontal Flip (0x00980914)
> >> [1:10:50.826837706] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Vertical Flip (0x00980915)
> >> [1:10:50.826855790] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Camera Orientation (0x009a0922)
> >> [1:10:50.826903725] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Camera Sensor Rotation (0x009a0923)
> >> [1:10:50.826923461] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Vertical Blanking (0x009e0901)
> >> [1:10:50.826936999] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Horizontal Blanking (0x009e0902)
> >> [1:10:50.826951952] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Analogue Gain (0x009e0903)
> >> [1:10:50.826966185] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Link Frequency (0x009f0901)
> >> [1:10:50.826983040] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Pixel Rate (0x009f0902)
> >> [1:10:50.826997454] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Test Pattern (0x009f0903)
> >> [1:10:50.827015198] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Digital Gain (0x009f0905)
> >> [1:10:50.828490135] [10864] DEBUG CameraSensor camera_sensor.cpp:431 'ov5693 2-0036': Test pattern mode 1 ignored
> >> [1:10:50.828508710] [10864] DEBUG CameraSensor camera_sensor.cpp:431 'ov5693 2-0036': Test pattern mode 3 ignored
> >> [1:10:50.828545992] [10864] DEBUG CameraSensor camera_sensor.cpp:1187 'ov5693 2-0036': Apply test pattern mode 0
> >> [1:10:50.828573532] [10864] DEBUG SimplePipeline simple.cpp:487 Found pipeline: [ov5693 2-0036|0] -> [0|Intel IPU6 CSI2 4|1] -> [0|IntelIPU 6 ISYS Capture 32]
> >> [1:10:50.828701911] [10864] DEBUG V4L2 v4l2_videodevice.cpp:632 /dev/video32[14:cap]: Opened device : isys: ipu6
> >> [1:10:50.828871825] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Exposure (0x00980911)
> >> [1:10:50.828899010] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Horizontal Flip (0x00980914)
> >> [1:10:50.828914160] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Vertical Flip (0x00980915)
> >> [1:10:50.828928349] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Camera Orientation (0x009a0922)
> >> [1:10:50.828947214] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Camera Sensor Rotation (0x009a0923)
> >> [1:10:50.828961230] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Vertical Blanking (0x009e0901)
> >> [1:10:50.828974089] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Horizontal Blanking (0x009e0902)
> >> [1:10:50.828986298] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Analogue Gain (0x009e0903)
> >> [1:10:50.828998654] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Link Frequency (0x009f0901)
> >> [1:10:50.829014321] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Pixel Rate (0x009f0902)
> >> [1:10:50.829027065] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Test Pattern (0x009f0903)
> >> [1:10:50.829043099] [10864] DEBUG V4L2 v4l2_device.cpp:636 'ov5693 2-0036': Control: Digital Gain (0x009f0905)
> >> [1:10:50.829102862] [10864] DEBUG DmaBufAllocator dma_buf_allocator.cpp:103 Failed to open /dev/dma_heap/linux,cma: Permission denied
> >> [1:10:50.829116555] [10864] DEBUG DmaBufAllocator dma_buf_allocator.cpp:103 Failed to open /dev/dma_heap/reserved: Permission denied
> >> [1:10:50.829124690] [10864] DEBUG DmaBufAllocator dma_buf_allocator.cpp:103 Failed to open /dev/dma_heap/system: Permission denied
> >> [1:10:50.829137432] [10864] DEBUG DmaBufAllocator dma_buf_allocator.cpp:109 Using /dev/udmabuf
> >> [1:10:50.830824251] [10864] DEBUG IPAManager ipa_manager.cpp:306 IPA module /usr/lib/libcamera/ipa_soft_simple.so signature is valid
> >> [1:10:50.830945293] [10864] DEBUG IPAProxy soft_ipa_proxy.cpp:45 initializing soft proxy: loading IPA from /usr/lib/libcamera/ipa_soft_simpl e.so
> >> [1:10:50.831350571] [10864] WARN IPAProxy ipa_proxy.cpp:161 Configuration file 'ov5693.yaml'not found for IPA module 'simple', falling bac k to 'uncalibrated.yaml'
> >> [1:10:50.831585810] [10864] DEBUG IPASoft soft_simple.cpp:135Tuning file version 1
> >> [1:10:50.831695682] [10864] DEBUG MediaDevice media_device.cpp:830 /dev/media0[intel-ipu6]: Intel IPU6 CSI2 4[1] -> Intel IPU6 ISYS Capture 32[0]: 0
> >> [1:10:50.831706917] [10864] DEBUG MediaDevice media_device.cpp:830 /dev/media0[intel-ipu6]: Intel IPU6 CSI2 4[1] -> Intel IPU6 ISYS Capture 32[0]: 1
> >> [1:10:50.831829423] [10864] DEBUG SimplePipeline simple.cpp:776Link 'ov5693 2-0036':0 -> 'Intel IPU6 CSI2 4':0 configured with format 1296x 972-SBGGR10_1X10
> >> [1:10:50.831850084] [10864] DEBUG SimplePipeline simple.cpp:776Link 'Intel IPU6 CSI2 4':1 -> 'Intel IPU6 ISYS Capture 32':0 configured with format 1296x972-SBGGR10_1X10
> >> [1:10:50.831916492] [10864] DEBUG SimplePipeline simple.cpp:627 Adding configuration for 1296x972 in pixel formats [ BG10, pBAA ]
> >> [1:10:50.832031091] [10864] DEBUG SimplePipeline simple.cpp:776 Link 'ov5693 2-0036':0 -> 'Intel IPU6 CSI2 4':0 configured with format 2592x 1944-SBGGR10_1X10
> >> [1:10:50.832040698] [10864] DEBUG SimplePipeline simple.cpp:776Link 'Intel IPU6 CSI2 4':1 -> 'Intel IPU6 ISYS Capture 32':0 configured with format 2592x1944-SBGGR10_1X10
> >> [1:10:50.832056763] [10864]DEBUG SimplePipeline simple.cpp:627 Adding configuration for 2592x1944 in pixel formats [ BG10, pBAA ]
> >> [1:10:50.832301449] [10864] DEBUGCamera camera_manager.cpp:159 Pipeline handler "simple" matched
> >> [1:10:50.832331269] [10864] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'uvcvideo'
> >> Available cameras:
> >> 1: Internal front camera (\_SB_.PC00.I2C2.CAMF)
> >>
> >> Please let me know if you need any more information.

-- 
Regards,

Laurent Pinchart




[Index of Archives]     [Linux Input]     [Video for Linux]     [Gstreamer Embedded]     [Mplayer Users]     [Linux USB Devel]     [Linux Audio Users]     [Linux Kernel]     [Linux SCSI]     [Yosemite Backpacking]

  Powered by Linux