Habidere, TL;DR: This series introduces support for the Rockchip Camera Interface (CIF), which can be found (in the form of variants that differ significantly) in different Rockchip SoCs in general, and for the Rockchip RK3568 Video Capture (VICAP) variant in particular. The patches are functional and have been tested successfully on a custom RK3568 board including the ITE Tech. IT6801 HDMI receiver as attached subdevice. The IT6801 driver still needs some loving care but shall be submitted as well at some point. The long story (gather 'round children): The Rockchip Camera Interface (CIF) is featured in many Rockchip SoCs in different variations. For example, the PX30 Video Input Processor (VIP) is able to receive video data via the Digital Video Port (DVP, a parallel data interface and transfer it into system memory using a double-buffering mechanism called ping-pong mode. The RK3568 Video Capture (VICAP) unit, on the other hand, features a DVP and a MIPI CSI-2 receiver that can receive video data independently (both using the ping-pong scheme). The different variants may have additional features, such as scaling and/or cropping. Finally, the RK3588 VICAP unit constitutes an essential piece of the camera interface with one DVP, six MIPI CSI-2 receivers, scale/crop units, and different data path multiplexers (to system memory, to ISP, ...). This submission bases on the work of several Bootlin developers who have been tirelessly submitting support for the PX30 Video Input Processor (VIP) block for inclusion in mainline. This process has been going on for several years now, with Maxime Chevallier working on the topic up to v5 [0] and Mehdi Djait taking over until v13 [1]. In the review feedback on v13 a major rework with a media controller centric driver as a goal was requested. This motivated me to take over (with no clue about the MC framework whatsoever, though). I decided to merge Mehdi's v13 with my v1 of the RK3568 VICAP support [2] and refactor the whole thing. The resulting v2 of the series now adds a basic media controller centric V4L2 driver for the Rockchip CIF with - support for the PX30 VIP (not tested, though, due to the lack of HW) - support for the RK3568 VICAP DVP - abstraction for the ping-pong scheme to allow for future extensions However, several features are not yet addressed, such as - support for the RK3568 MIPI CSI-2 receiver - support for the RK3588 variant - support for the scaling/cropping units that can be found in some variants - support for capturing different virtual channels (up to four IDs possible) This needs to be in the scope of future work. Finally, please forgive me if I forgot to address reviewer comments from the previous iterations. Between v1 and v13 they have seen significant feedback including renaming the complete driver twice (from rkcif to vip and back to cif) and I am pretty sure that I was not able to gather everything. Looking forward to your comments! [0] https://lore.kernel.org/linux-media/20201229161724.511102-1-maxime.chevallier@xxxxxxxxxxx/ [1] https://lore.kernel.org/linux-media/cover.1707677804.git.mehdi.djait.k@xxxxxxxxx/ [2] https://lore.kernel.org/all/20240220-v6-8-topic-rk3568-vicap-v1-0-2680a1fa640b@xxxxxxxxxxxxxx/ To: Mehdi Djait <mehdi.djait@xxxxxxxxxxxxxxx> To: Maxime Chevallier <maxime.chevallier@xxxxxxxxxxx> To: Théo Lebrun <theo.lebrun@xxxxxxxxxxx> To: Thomas Petazzoni <thomas.petazzoni@xxxxxxxxxxx> To: Sakari Ailus <sakari.ailus@xxxxxx> To: Laurent Pinchart <laurent.pinchart@xxxxxxxxxxxxxxxx> To: Mauro Carvalho Chehab <mchehab@xxxxxxxxxx> To: Rob Herring <robh+dt@xxxxxxxxxx> To: Krzysztof Kozlowski <krzk+dt@xxxxxxxxxx> To: Conor Dooley <conor+dt@xxxxxxxxxx> To: Heiko Stuebner <heiko@xxxxxxxxx> To: Kever Yang <kever.yang@xxxxxxxxxxxxxx> To: Nicolas Dufresne <nicolas@xxxxxxxxxxxx> To: Sebastian Fricke <sebastian.fricke@xxxxxxxxxxxxx> To: Alexander Shiyan <eagle.alexander923@xxxxxxxxx> To: Val Packett <val@xxxxxxxxxxxx> To: Rob Herring <robh@xxxxxxxxxx> To: Philipp Zabel <p.zabel@xxxxxxxxxxxxxx> Cc: linux-media@xxxxxxxxxxxxxxx Cc: devicetree@xxxxxxxxxxxxxxx Cc: linux-kernel@xxxxxxxxxxxxxxx Cc: linux-arm-kernel@xxxxxxxxxxxxxxxxxxx Cc: linux-rockchip@xxxxxxxxxxxxxxxxxxx Signed-off-by: Michael Riesch <michael.riesch@xxxxxxxxxxxxxx> Changes in v2: - merged with Mehdi's v13 - refactored the complete driver towards a media controller centric driver - abstracted the generic ping-pong stream (can be used for DVP as well as for CSI-2) - switched to MPLANE API - added support for notifications - Link to v1: https://lore.kernel.org/r/20240220-v6-8-topic-rk3568-vicap-v1-0-2680a1fa640b@xxxxxxxxxxxxxx --- Mehdi Djait (2): media: dt-bindings: media: add bindings for rockchip px30 vip arm64: dts: rockchip: add the vip node to px30 Michael Riesch (4): media: dt-bindings: media: video-interfaces: add defines for sampling modes media: dt-bindings: media: add bindings for rockchip rk3568 vicap media: rockchip: add a driver for the rockchip camera interface (cif) arm64: dts: rockchip: add vicap node to rk356x .../bindings/media/rockchip,px30-vip.yaml | 123 ++++ .../bindings/media/rockchip,rk3568-vicap.yaml | 168 +++++ MAINTAINERS | 9 + arch/arm64/boot/dts/rockchip/px30.dtsi | 12 + arch/arm64/boot/dts/rockchip/rk356x-base.dtsi | 44 ++ drivers/media/platform/rockchip/Kconfig | 1 + drivers/media/platform/rockchip/Makefile | 1 + drivers/media/platform/rockchip/cif/Kconfig | 15 + drivers/media/platform/rockchip/cif/Makefile | 3 + .../media/platform/rockchip/cif/cif-capture-dvp.c | 794 +++++++++++++++++++++ .../media/platform/rockchip/cif/cif-capture-dvp.h | 24 + drivers/media/platform/rockchip/cif/cif-common.h | 163 +++++ drivers/media/platform/rockchip/cif/cif-dev.c | 405 +++++++++++ drivers/media/platform/rockchip/cif/cif-regs.h | 132 ++++ drivers/media/platform/rockchip/cif/cif-stream.c | 676 ++++++++++++++++++ drivers/media/platform/rockchip/cif/cif-stream.h | 24 + include/dt-bindings/media/video-interfaces.h | 4 + 17 files changed, 2598 insertions(+) --- base-commit: 40384c840ea1944d7c5a392e8975ed088ecf0b37 change-id: 20240220-v6-8-topic-rk3568-vicap-b9b3f9925f44 Best regards, -- Michael Riesch <michael.riesch@xxxxxxxxxxxxxx>
