On Thu, Mar 17, 2022 at 10:56:03PM +0800, Moudy Ho wrote: > This patch adds DT binding documents for Media Data Path 3 (MDP3) > a unit in multimedia system combined with several components and > used for scaling and color format convert. > > It can create multiple paths with different functions by assigning > different components, a simple diagram is as follows: > > +------------+ +------------+ > | RDMA | | ISP[*1] | > +---+--+--+--+ +-----+--+---+ > A B C 2 1 > v v v v v > | | | | | > | | +---------+ | | > | | | | | > | +-------+ | | | > | | | | | > | +-------+----+---------+ | > | | | | | > | | | +---------+ | > v v | | | > A 2 | | | > ******** | | | > ** ** | | | > * PQ[*2] * | | | > ** ** | | | > ******** | | | > | | | | | > v v | v v > A 2 | C 1 > +---+--+---+ | +-----+--+--+ > | RSZ | | | RSZ | > +---+------+ | +-----+--+--+ > D | 3 4 > v | v v > | | | | > | +-------+ | | > | | | | > | | +-------------------+ | > | | | | > v v v v > D B 3 4 > +---+--+--+--+ +---------+--+ > | WROT | | WDMA | > +------------+ +------------+ Sure seems like you should be using the OF graph binding to describe these connections unless all the sub-blocks and their connections are fixed across different SoCs. > > [*1] Direct-link path for camera input > [*2] A series of picture quality adjustment > engines, composed of AAL, CCORR, TDSHP > and COLOR > > Signed-off-by: Moudy Ho <moudy.ho@xxxxxxxxxxxx> > --- > .../bindings/media/mediatek,mdp3-rdma.yaml | 214 ++++++++++++++++++ > .../bindings/media/mediatek,mdp3-rsz.yaml | 54 +++++ > .../bindings/media/mediatek,mdp3-wrot.yaml | 57 +++++ > .../bindings/soc/mediatek/mediatek,ccorr.yaml | 47 ++++ > .../bindings/soc/mediatek/mediatek,wdma.yaml | 58 +++++ > 5 files changed, 430 insertions(+) > create mode 100644 Documentation/devicetree/bindings/media/mediatek,mdp3-rdma.yaml > create mode 100644 Documentation/devicetree/bindings/media/mediatek,mdp3-rsz.yaml > create mode 100644 Documentation/devicetree/bindings/media/mediatek,mdp3-wrot.yaml > create mode 100644 Documentation/devicetree/bindings/soc/mediatek/mediatek,ccorr.yaml > create mode 100644 Documentation/devicetree/bindings/soc/mediatek/mediatek,wdma.yaml > > diff --git a/Documentation/devicetree/bindings/media/mediatek,mdp3-rdma.yaml b/Documentation/devicetree/bindings/media/mediatek,mdp3-rdma.yaml > new file mode 100644 > index 000000000000..3bf59c3f521f > --- /dev/null > +++ b/Documentation/devicetree/bindings/media/mediatek,mdp3-rdma.yaml > @@ -0,0 +1,214 @@ > +# SPDX-License-Identifier: (GPL-2.0-only OR BSD-2-Clause) > +%YAML 1.2 > +--- > +$id: http://devicetree.org/schemas/media/mediatek,mdp3-rdma.yaml# > +$schema: http://devicetree.org/meta-schemas/core.yaml# > + > +title: Mediatek Read Direct Memory Access > + > +maintainers: > + - Matthias Brugger <matthias.bgg@xxxxxxxxx> > + > +description: | > + Mediatek Read Direct Memory Access(RDMA) component used to do read DMA. > + It contains one line buffer to store the sufficient pixel data, and > + must be siblings to the central MMSYS_CONFIG node. > + For a description of the MMSYS_CONFIG binding, see > + Documentation/devicetree/bindings/arm/mediatek/mediatek,mmsys.yaml > + for details. > + The 1st RDMA is also used to be a controller node in Media Data Path 3(MDP3) > + that containing MMSYS, MUTEX, GCE and SCP settings. > + > +properties: > + compatible: > + oneOf: > + - items: > + # MDP3 controller node > + - const: mediatek,mt8183-mdp3 > + - const: mediatek,mt8183-mdp3-rdma This does not make sense as a compatible entry. The first string should be more specific than the 2nd string. The controller node is a different instance of the RDMA block or some s/w designation? Looks like the latter to me... > + - items: > + # normal RDMA conponent > + - const: mediatek,mt8183-mdp3-rdma > + > + mediatek,scp: > + description: | > + The node of system control processor (SCP), using > + the remoteproc & rpmsg framework. > + $ref: '/schemas/types.yaml#/definitions/phandle' > + maxItems: 1 > + > + mediatek,mdp3-comps: > + description: | > + MDP subsystem which has direct-link from Image Signal Processor(ISP). > + When using the camera, the DMA of ISP PASS (DIP) module will directly > + trigger MDP3 without other control (such as V4L2 M2M) to create > + corresponding HW path. > + The MDP3 controller must set up a series of registers at the beginning of > + path creation which covering MMSYS, IMGSYS, and MDP3's components, > + so that data flow can pass through MDP3. > + The entire path is briefly described as follows > + ISP --+ > + | > + +-> DIP --+ > + ................|.............................................. > + (MDP3) +->IMGI -+-> DL1 -> RSZ -+-> PATH1 -> WROT > + | ^ | > + | | | > + +-> DL2 -----+ +-> PATH2 -> WDMA > + | > + +---------------------------> EXTO > + $ref: '/schemas/types.yaml#/definitions/string-array' > + items: > + enum: > + # MDP direct-link input path selection, create a > + # component for path connectedness of HW pipe control > + - mediatek,mt8183-mdp3-dl1 > + - mediatek,mt8183-mdp3-dl2 > + # MDP direct-link output path selection, create a > + # component for path connectedness of HW pipe control > + - mediatek,mt8183-mdp3-path1 > + - mediatek,mt8183-mdp3-path2 > + # Input DMA of ISP PASS2 (DIP) module for raw image input > + - mediatek,mt8183-mdp3-imgi > + # Output DMA of ISP PASS2 (DIP) module for YUV image output > + - mediatek,mt8183-mdp3-exto > + > + reg: > + items: > + - description: basic RDMA HW address > + - description: MDP direct-link 1st and 2nd input > + - description: MDP direct-link 1st output > + - description: MDP direct-link 2nd output > + - description: ISP input and output > + > + mediatek,gce-client-reg: > + $ref: '/schemas/types.yaml#/definitions/phandle-array' > + minItems: 1 > + items: > + - description: GCE client for RDMA > + - description: GCE client for dl1 and dl2 > + - description: GCE client for path1 > + - description: GCE client for path2 > + - description: GCE client for imgi and exto > + description: | > + The register of client driver can be configured by gce with > + 4 arguments defined in this property, such as phandle of gce, subsys id, > + register offset and size. Each GCE subsys id is mapping to a client > + defined in the header include/dt-bindings/gce/<chip>-gce.h. > + > + power-domains: > + maxItems: 1 > + > + clocks: > + items: > + - description: RDMA clock > + - description: RSZ clock > + - description: direck-link TX clock in MDP side > + - description: direck-link RX clock in MDP side > + - description: direck-link TX clock in ISP side > + - description: direck-link RX clock in ISP side > + > + iommus: > + maxItems: 1 > + > + mediatek,mmsys: > + description: The node of mux(multiplexer) controller for HW connections. > + $ref: '/schemas/types.yaml#/definitions/phandle' > + > + mediatek,mm-mutex: > + description: | > + Mediatek mutex, namely MUTEX, is used to send the triggers signals called > + Start Of Frame(SOF) / End Of Frame(EOF) to each sub-modules on the data path. > + In some SoC, such as mt2701, MUTEX could be a hardware mutex which protects > + the shadow register. > + $ref: '/schemas/types.yaml#/definitions/phandle' > + > + mediatek,mailbox-gce: > + description: | > + The node of global command engine (GCE), used to read/write > + registers with critical time limitation. > + $ref: '/schemas/types.yaml#/definitions/phandle' > + > + mboxes: > + items: > + - description: used for 1st data pipe from RDMA > + - description: used for 2nd data pipe from RDMA > + - description: used for 3rd data pipe from Direct-Link > + - description: used for 4th data pipe from Direct-Link > + > + gce-subsys: Vendor prefix needed. > + description: | > + sub-system id corresponding to the global command engine (GCE) > + register address. > + $ref: '/schemas/types.yaml#/definitions/phandle-array' > + > +if: > + properties: > + compatible: > + contains: > + const: mediatek,mt8183-mdp3 > + > +then: > + required: > + - mediatek,scp > + - mediatek,mmsys > + - mediatek,mm-mutex > + - mediatek,mailbox-gce Note that if there's only 1 instance of these blocks, you can just find them by compatible and don't need a property. > + - mboxes > + - gce-subsys > + > +required: > + - compatible > + - reg > + - clocks > + - mediatek,gce-client-reg > + > +additionalProperties: false > + > +examples: > + - | > + #include <dt-bindings/clock/mt8183-clk.h> > + #include <dt-bindings/gce/mt8183-gce.h> > + #include <dt-bindings/power/mt8183-power.h> > + #include <dt-bindings/memory/mt8183-larb-port.h> > + > + mdp3_rdma0: mdp3_rdma0@14001000 { > + compatible = "mediatek,mt8183-mdp3", > + "mediatek,mt8183-mdp3-rdma"; > + mediatek,scp = <&scp>; > + mediatek,mdp3-comps = "mediatek,mt8183-mdp3-dl1", > + "mediatek,mt8183-mdp3-dl2", > + "mediatek,mt8183-mdp3-path1", > + "mediatek,mt8183-mdp3-path2", > + "mediatek,mt8183-mdp3-imgi", > + "mediatek,mt8183-mdp3-exto"; > + reg = <0x14001000 0x1000>, > + <0x14000000 0x1000>, > + <0x14005000 0x1000>, > + <0x14006000 0x1000>, > + <0x15020000 0x1000>; > + mediatek,gce-client-reg = <&gce SUBSYS_1400XXXX 0x1000 0x1000>, > + <&gce SUBSYS_1400XXXX 0 0x1000>, > + <&gce SUBSYS_1400XXXX 0x5000 0x1000>, > + <&gce SUBSYS_1400XXXX 0x6000 0x1000>, > + <&gce SUBSYS_1502XXXX 0 0x1000>; > + power-domains = <&spm MT8183_POWER_DOMAIN_DISP>; > + clocks = <&mmsys CLK_MM_MDP_RDMA0>, > + <&mmsys CLK_MM_MDP_RSZ1>, > + <&mmsys CLK_MM_MDP_DL_TXCK>, > + <&mmsys CLK_MM_MDP_DL_RX>, > + <&mmsys CLK_MM_IPU_DL_TXCK>, > + <&mmsys CLK_MM_IPU_DL_RX>; > + iommus = <&iommu>; > + mediatek,mmsys = <&mmsys>; > + mediatek,mm-mutex = <&mutex>; > + mediatek,mailbox-gce = <&gce>; > + mboxes = <&gce 20 CMDQ_THR_PRIO_LOWEST>, > + <&gce 21 CMDQ_THR_PRIO_LOWEST>, > + <&gce 22 CMDQ_THR_PRIO_LOWEST>, > + <&gce 23 CMDQ_THR_PRIO_LOWEST>; > + gce-subsys = <&gce 0x14000000 SUBSYS_1400XXXX>, > + <&gce 0x14010000 SUBSYS_1401XXXX>, > + <&gce 0x14020000 SUBSYS_1402XXXX>, > + <&gce 0x15020000 SUBSYS_1502XXXX>; > + };