On Mon, Jul 10, 2023 at 12:58 AM Frieder Schrempf <frieder.schrempf@xxxxxxxxxx> wrote: > > Hi Tim, > > On 07.07.23 23:57, Tim Harvey wrote: > [...] > > > > Frieder, > > > > Where did you end up with this? I have imx219 capture working on > > imx8mm on a 5.15 kernel with lots of backports but have not managed to > > repeat it on a 6.4 kernel. I don't run into the issue you are running > > into (I have the imx-media device showing) but the media-ctl entities > > have changed since my 5.15 kernel and I can't figure out how to link > > them up and configure them with media-ctl. > > > > On my imx8mm-venice-gw72xx with imx8mm-venice-gw72xx-0x-imx219.dtso I see: > > root@jammy-venice:~# cat /sys/bus/media/devices/media*/model > > imx-media > > hantro-vpu > > hantro-vpu > > root@jammy-venice:~# cat /sys/bus/media/devices/media0/model > > imx-media > > root@jammy-venice:~# media-ctl --device /dev/media0 -p > > Media controller API version 6.4.0 > > > > Media device information > > ------------------------ > > driver imx7-csi > > model imx-media > > serial > > bus info platform:32e20000.csi > > hw revision 0x0 > > driver version 6.4.0 > > > > Device topology > > - entity 1: csi (2 pads, 2 links) > > type V4L2 subdev subtype Unknown flags 0 > > device node name /dev/v4l-subdev0 > > pad0: Sink > > [fmt:UYVY8_2X8/640x480 field:none colorspace:srgb > > xfer:srgb ycbcr:601 quantization:lim-range] > > <- "csis-32e30000.mipi-csi":1 [ENABLED,IMMUTABLE] > > pad1: Source > > [fmt:UYVY8_2X8/640x480 field:none colorspace:srgb > > xfer:srgb ycbcr:601 quantization:lim-range] > > -> "csi capture":0 [ENABLED,IMMUTABLE] > > > > - entity 4: csi capture (1 pad, 1 link) > > type Node subtype V4L flags 0 > > device node name /dev/video0 > > pad0: Sink > > <- "csi":1 [ENABLED,IMMUTABLE] > > > > - entity 10: csis-32e30000.mipi-csi (2 pads, 2 links) > > type V4L2 subdev subtype Unknown flags 0 > > device node name /dev/v4l-subdev1 > > pad0: Sink > > [fmt:UYVY8_1X16/640x480 field:none > > colorspace:smpte170m xfer:709 ycbcr:601 quantization:lim-range] > > <- "imx219 2-0010":0 [] > > pad1: Source > > [fmt:UYVY8_1X16/640x480 field:none > > colorspace:smpte170m xfer:709 ycbcr:601 quantization:lim-range] > > -> "csi":0 [ENABLED,IMMUTABLE] > > > > - entity 15: imx219 2-0010 (1 pad, 1 link) > > type V4L2 subdev subtype Sensor flags 0 > > device node name /dev/v4l-subdev2 > > pad0: Source > > [fmt:SRGGB10_1X10/3280x2464 field:none colorspace:srgb > > xfer:srgb ycbcr:601 quantization:full-range > > crop.bounds:(8,8)/3280x2464 > > crop:(8,8)/3280x2464] > > -> "csis-32e30000.mipi-csi":0 [] > > > > When I try to link and configure the pipeline I run into issues I > > don't know how to resolve: > > root@jammy-venice:~# media-ctl --device /dev/media0 --reset > > root@jammy-venice:~# media-ctl --device /dev/media0 --links "'imx219 > > 2-0010':0->'csis-32e30000.mipi-csi.0':0[1]" > > Unable to parse link: Invalid argument (22) > > ^^^ not sure why I can't link imx219 source pad with mipi-csi sink pad > > > > What changed for me from my 5.15 kernel is the entities and pads > > above. My 5.15 kernel looks like this: > > root@jammy-venice:~# cat /sys/bus/media/devices/media2/model > > imx-media > > root@jammy-venice:~# media-ctl --device /dev/media2 -p > > Media controller API version 5.15.15 > > > > Media device information > > ------------------------ > > driver imx7-csi > > model imx-media > > serial > > bus info platform:32e20000.csi > > hw revision 0x0 > > driver version 5.15.15 > > > > Device topology > > - entity 1: csi (2 pads, 2 links) > > type V4L2 subdev subtype Unknown flags 0 > > device node name /dev/v4l-subdev0 > > pad0: Sink > > [fmt:UYVY8_2X8/800x600 field:none colorspace:srgb > > xfer:srgb ycbcr:601 quantization:lim-range] > > <- "imx7-mipi-csis.0":1 [ENABLED,IMMUTABLE] > > pad1: Source > > [fmt:UYVY8_2X8/800x600 field:none colorspace:srgb > > xfer:srgb ycbcr:601 quantization:lim-range] > > -> "csi capture":0 [ENABLED,IMMUTABLE] > > > > - entity 4: csi capture (1 pad, 1 link) > > type Node subtype V4L flags 0 > > device node name /dev/video2 > > pad0: Sink > > <- "csi":1 [ENABLED,IMMUTABLE] > > > > - entity 10: imx7-mipi-csis.0 (2 pads, 2 links) > > type V4L2 subdev subtype Unknown flags 0 > > device node name /dev/v4l-subdev1 > > pad0: Sink > > [fmt:UYVY8_1X16/640x480 field:none > > colorspace:smpte170m xfer:709 ycbcr:601 quantization:lim-range] > > <- "imx219 2-0010":0 [] > > pad1: Source > > [fmt:UYVY8_1X16/640x480 field:none > > colorspace:smpte170m xfer:709 ycbcr:601 quantization:lim-range] > > -> "csi":0 [ENABLED,IMMUTABLE] > > > > - entity 15: imx219 2-0010 (1 pad, 1 link) > > type V4L2 subdev subtype Sensor flags 0 > > device node name /dev/v4l-subdev2 > > pad0: Source > > [fmt:SRGGB10_1X10/3280x2464 field:none colorspace:srgb > > xfer:srgb ycbcr:601 quantization:full-range > > crop.bounds:(8,8)/3280x2464 > > crop:(8,8)/3280x2464] > > -> "imx7-mipi-csis.0":0 [] > > # configure media controller links > > media-ctl --device /dev/media2 --reset > > # link the imx219 source pad (0) to the imx7-mipi-csis sink pad (0) > > media-ctl --device /dev/media2 --links "'imx219 > > 2-0010':0->'imx7-mipi-csis.0':0[1]" > > # configure the imx219 source pad (0) for srgb 640x480 > > media-ctl --device /dev/media2 -v -V "'imx219 2-0010':0 > > [fmt:SRGGB8/640x480 field:none]" > > # configure the csi sink pad (0) for srgb 640x480 > > media-ctl --device /dev/media2 -v -V "'csi':0 [fmt:SRGGB8/640x480 field:none]" > > # stream 640x480@30fps > > gst-launch-1.0 v4l2src device=/dev/video0 ! > > video/x-bayer,format=rggb,width=640,height=480,framerate=10/1 ! > > bayer2rgb ! fbdevsink # works > > > > Maybe you have gotten further than this by now? > > > > If you are still having issues getting imx-media to register we can > > look at kernel configs. I believe the following are necessary: > > CONFIG_VIDEO_IMX219=y > > CONFIG_VIDEO_IMX_MIPI_CSIS=y > > CONFIG_VIDEO_IMX7_CSI=y > > I got this working back in February with Linux 6.2-rc8 and a few > additional patches (see [1]), but I haven't tried this anymore since then. > > In my notes I have the following commands to test the camera: > > media-ctl -d /dev/media0 -l "'imx219 1-0010':0 -> > 'csis-32e30000.mipi-csi':0[1]" Hi Frieder, Thank you - this helped me identify a typo in my link configuration. My link configuration had an invalid argument in it which is why I was getting the invalid argument: # media-ctl -l "'imx219 2-0010':0->'csis-32e30000.mipi-csi.0':0[1]" Unable to parse link: Invalid argument (22) ^^^ the entity name does not include the .0 pad I believe this is the correct setup for imx219 on 6.5-rc1 with imx219 for 640x480 raw8 bayer: media-ctl -l "'imx219 2-0010':0 -> 'csis-32e30000.mipi-csi':0 [1]" media-ctl -v -V "'imx219 2-0010':0 [fmt:SRGGB8/640x480 field:none]" media-ctl -v -V "'csis-32e30000.mipi-csi':0 [fmt:SRGGB8/640x480 field:none]" media-ctl -v -V "'csi':0 [fmt:SRGGB8/640x480 field:none]" I still can't get this to stream via gstreamer however: # gst-launch-1.0 v4l2src device=/dev/video0 ! video/x-bayer,format=rggb,width=640,height=480,framerate=10/1 ! bayer2rgb ! fbdevsink Setting pipeline to PAUSED ... Pipeline is live and does not need PREROLL ... [ 411.185357] imx7-csi 32e20000.csi: capture format not valid Pipeline is PREROLLED ... Setting pipeline to PLAYING ... New clock: GstSystemClock ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate required memory. Additional debug info: ../sys/v4l2/gstv4l2src.c(759): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Buffer pool activation failed Execution ended after 0:00:00.010357497 Setting pipeline to NULL ... ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error. Additional debug info: ../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: streaming stopped, reason not-negotiated (-4) Freeing pipeline ... I'm not sure if your notes show you how you captured/streamed data after the linux media pipeline configuration? best regards, Tim > media-ctl -d /dev/media0 -V '"imx219 1-0010":0[fmt:SRGGB8_1X8/1920x1080 > field:none]' > media-ctl -d /dev/media0 -V > '"csis-32e30000.mipi-csi":0[fmt:SRGGB8_1X8/1920x1080 field:none]' > media-ctl -d /dev/media0 -V '"csi":0[fmt:SRGGB8_1X8/1920x1080 field:none]' > > v4l2-ctl -d /dev/video0 > --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --stream-mmap > > I currently don't have the time to look at this any closer, but maybe > this already helps you in some way. > > Best regards > Frieder > > [1] > https://git.kontron-electronics.de/sw/misc/linux/-/commits/feature/v6.2-debug-csi
