These patches add a bcm2835-codec driver in order to use the hw codecs. This makes eg playing a h264 1080p movie playable with some cpu cycles to spare, instead of dropping frames and 100% cpu usage. I tested with ffmpeg encode and decode, and I'm using it on my RPI4 mediabox. I cherry-picked some patches from the rpi kernel and put these on top of Umang's git tree (to have bcm2835-isp driver) and then rebased the whole thing to media_stage and then squashed it a bit to these 13 patches. The reason I put this on top of Umang's patches for bcm2835-isp is because of common dependencies. I know that this will not be accepted until the vchiq is unstaged, but I'd like some comments on these patches in order to have this accepted faster after vchiq is unstaged. Umang's git tree I based it on: https://git.uk.ideasonboard.com/uajain/linux/src/branch/uajain/rpi4/staging-next/isp I pushed my work on github if anyone wishes to try it out: https://github.com/alien999999999/linux/tree/rpi4-codec/media_stage/v1 Thanks in advance for any comment, Maarten Vanraes (AL13N on #linux-media ) Dave Stevenson (11): staging: mmal-vchiq: Avoid use of bool in structures staging: mmal-vchiq: Update mmal_parameters.h with recently defined params staging: mmal-vchiq: Fix memory leak in error path media: videodev2.h: Add a format for column YUV4:2:0 modes staging/vchiq-mmal: Add buffer flags for interlaced video staging/vchiq-mmal: Add parameters for interlaced video support staging/vchiq-mmal: Add the deinterlace image effects enums staging/mmal-vchiq: Rationalise included headers staging: mmal-vchiq: Reset buffers_with_vpu on port_enable vc04_services: vchiq-mmal: Add defines for mmal_es_format flags staging: vc04_services: Add a V4L2 M2M codec driver Phil Elwell (1): staging: vchiq_arm: Add 36-bit address support detule (1): staging: vchiq_arm: Usa a DMA pool for small bulks .../media/v4l/pixfmt-nv12-col128.rst | 215 + .../media/v4l/pixfmt-yuv-planar.rst | 12 + .../userspace-api/media/v4l/yuv-formats.rst | 19 + drivers/media/v4l2-core/v4l2-ioctl.c | 2 + drivers/staging/vc04_services/Kconfig | 2 + drivers/staging/vc04_services/Makefile | 2 + .../vc04_services/bcm2835-codec/Kconfig | 11 + .../vc04_services/bcm2835-codec/Makefile | 5 + .../bcm2835-codec/bcm2835-v4l2-codec.c | 3973 +++++++++++++++++ .../interface/vchiq_arm/vchiq_arm.c | 147 +- .../vchiq-mmal/mmal-msg-format.h | 10 + .../vc04_services/vchiq-mmal/mmal-msg.h | 19 + .../vchiq-mmal/mmal-parameters.h | 86 +- .../vc04_services/vchiq-mmal/mmal-vchiq.c | 40 +- include/uapi/linux/videodev2.h | 4 + 15 files changed, 4509 insertions(+), 38 deletions(-) create mode 100644 Documentation/userspace-api/media/v4l/pixfmt-nv12-col128.rst create mode 100644 drivers/staging/vc04_services/bcm2835-codec/Kconfig create mode 100644 drivers/staging/vc04_services/bcm2835-codec/Makefile create mode 100644 drivers/staging/vc04_services/bcm2835-codec/bcm2835-v4l2-codec.c -- 2.41.0
