Hi Can, > Subject: Re: [PATCH v2 06/17] ufs: core: mcq: Configure resource > regions > Date: Fri, 14 Oct 2022 17:31:52 +0800 > From: Can Guo <quic_cang@xxxxxxxxxxx> > To: Eddie Huang <eddie.huang@xxxxxxxxxxxx>, Asutosh Das < > quic_asutoshd@xxxxxxxxxxx>, quic_nitirawa@xxxxxxxxxxx, > quic_rampraka@xxxxxxxxxxx, quic_bhaskarv@xxxxxxxxxxx, > quic_richardp@xxxxxxxxxxx, linux-scsi@xxxxxxxxxxxxxxx > CC: linux-arm-msm@xxxxxxxxxxxxxxx, quic_nguyenb@xxxxxxxxxxx, > quic_xiaosenh@xxxxxxxxxxx, bvanassche@xxxxxxx, avri.altman@xxxxxxx, > mani@xxxxxxxxxx, beanhuo@xxxxxxxxxx > > > Hi Eddie, > > On 10/14/2022 5:08 PM, Eddie Huang wrote: > > Hi Asutosh, > > > > On Wed, 2022-10-05 at 18:06 -0700, Asutosh Das wrote: > > > Define the mcq resources and add support to ioremap > > > the resource regions. > > > > > > Co-developed-by: Can Guo <quic_cang@xxxxxxxxxxx> > > > Signed-off-by: Can Guo <quic_cang@xxxxxxxxxxx> > > > Signed-off-by: Asutosh Das <quic_asutoshd@xxxxxxxxxxx> > > > --- > > > drivers/ufs/core/ufs-mcq.c | 99 > > > ++++++++++++++++++++++++++++++++++++++++++++++ > > > include/ufs/ufshcd.h | 28 +++++++++++++ > > > 2 files changed, 127 insertions(+) > > > > > > diff --git a/drivers/ufs/core/ufs-mcq.c b/drivers/ufs/core/ufs- > > > mcq.c > > > index 659398d..7d0a37a 100644 > > > --- a/drivers/ufs/core/ufs-mcq.c > > > +++ b/drivers/ufs/core/ufs-mcq.c > > > @@ -18,6 +18,11 @@ > > > #define UFS_MCQ_NUM_DEV_CMD_QUEUES 1 > > > #define UFS_MCQ_MIN_POLL_QUEUES 0 > > > +#define MCQ_QCFGPTR_MASK GENMASK(7, 0) > > > +#define MCQ_QCFGPTR_UNIT 0x200 > > > +#define MCQ_SQATTR_OFFSET(c) \ > > > + ((((c) >> 16) & MCQ_QCFGPTR_MASK) * MCQ_QCFGPTR_UNIT) > > > +#define MCQ_QCFG_SIZE 0x40 > > > static int rw_queue_count_set(const char *val, const struct > > > kernel_param *kp) > > > { > > > @@ -67,6 +72,97 @@ module_param_cb(poll_queues, > > > &poll_queue_count_ops, &poll_queues, 0644); > > > MODULE_PARM_DESC(poll_queues, > > > "Number of poll queues used for r/w. Default value is > > > 1"); > > > +/* Resources */ > > > +static const struct ufshcd_res_info ufs_res_info[RES_MAX] = { > > > + {.name = "ufs_mem",}, > > > + {.name = "mcq",}, > > > + /* Submission Queue DAO */ > > > + {.name = "mcq_sqd",}, > > > + /* Submission Queue Interrupt Status */ > > > + {.name = "mcq_sqis",}, > > > + /* Completion Queue DAO */ > > > + {.name = "mcq_cqd",}, > > > + /* Completion Queue Interrupt Status */ > > > + {.name = "mcq_cqis",}, > > > + /* MCQ vendor specific */ > > > + {.name = "mcq_vs",}, > > > +}; > > > + > > > +static int ufshcd_mcq_config_resource(struct ufs_hba *hba) > > > +{ > > > + struct platform_device *pdev = to_platform_device(hba->dev); > > > + struct ufshcd_res_info *res; > > > + struct resource *res_mem, *res_mcq; > > > + int i, ret = 0; > > > + > > > + memcpy(hba->res, ufs_res_info, sizeof(ufs_res_info)); > > > + > > > + for (i = 0; i < RES_MAX; i++) { > > > + res = &hba->res[i]; > > > + res->resource = platform_get_resource_byname(pdev, > > > + IORESOURCE > > > _MEM, > > > + res- > > > > name); > > > + if (!res->resource) { > > > + dev_info(hba->dev, "Resource %s not > > > provided\n", res->name); > > > + if (i == RES_UFS) > > > + return -ENOMEM; > > > + continue; > > > + } else if (i == RES_UFS) { > > > + res_mem = res->resource; > > > + res->base = hba->mmio_base; > > > + continue; > > > + } > > > + > > > + res->base = devm_ioremap_resource(hba->dev, res- > > > > resource); > > > + if (IS_ERR(res->base)) { > > > + dev_err(hba->dev, "Failed to map res %s, > > > err=%d\n", > > > + res->name, (int)PTR_ERR(res- > > > > base)); > > > + res->base = NULL; > > > + ret = PTR_ERR(res->base); > > > + return ret; > > > + } > > > + } > > > + > > > + /* MCQ resource provided in DT */ > > > + res = &hba->res[RES_MCQ]; > > > + /* Bail if NCQ resource is provided */ > > > + if (res->base) > > > + goto out; > > > + > > > + /* Manually allocate MCQ resource from ufs_mem */ > > > + res_mcq = res->resource; > > > + res_mcq = devm_kzalloc(hba->dev, sizeof(*res_mcq), GFP_KERNEL); > > > + if (!res_mcq) { > > > + dev_err(hba->dev, "Failed to allocate MCQ resource\n"); > > > + return ret; > > > + } > > > + > > > + res_mcq->start = res_mem->start + > > > + MCQ_SQATTR_OFFSET(hba->mcq_capabilities); > > > + res_mcq->end = res_mcq->start + hba->nr_hw_queues * > > > MCQ_QCFG_SIZE - 1; > > > + res_mcq->flags = res_mem->flags; > > > + res_mcq->name = "mcq"; > > > + > > > + ret = insert_resource(&iomem_resource, res_mcq); > > > + if (ret) { > > > + dev_err(hba->dev, "Failed to insert MCQ resource, > > > err=%d\n", ret); > > > + return ret; > > > + } > > > + > > Mediatek UFS hardware put MCQ SQ head/tail and SQ IS/IE together > > (SQ0 > > head, SQ0 tail, SQ0 IS, SQ0 IE, CQ0 head, CQ0 tail....), which > > means > > mcq_sqd register range interleave with mcq_sqis. I suggest let > > vendor > > customize config mcq resource function to fit vendor's register > > assignment > > In your case, which is similar to ours, you can just provide the res > of SQD in DT, then use the > > ufshcd_mcq_vops_op_runtime_config() introduced in Patch #8 to > configure each operation > Let me explain more detail about Mediatek UFS register assignment: a. 0x0 ~ 0x5FF: UFS common register b. 0x1600 ~ : MCQ register c. 0x2200: UFS common vendor specific register d. 0x2800: SQ/CQ head/tail pointer and interrupt status/enable register 0x2800 SQ0_head 0x2814 SQ0_IS 0x281C CQ0_head 0x2824 CQ0_IS The register location meet UFSHCI4.0 spec definition In legacy doorbell mode, need region a, c registers In MCQ mode, need region a, b, c, d registers As you can see, region b in the middle of region a and c. If I declare "mcq" in device tree, i.e. reg = <0, 0x11270000, 0, 0x2300>, <0, 0x11271600, 0, 0x1400>; reg-names = "ufs_mem", "mcq"; Linux kernel boot fail due to register region overlapped and devm_ioremap_resource() return error. If I don't declare "mcq" region in device tree, Linux kernel still boot fail due to ufshcd_mcq_config_resource() call devm_ioreamap_resource() using calculated res_mcq which is overlapped with ufs_mem. We treat UFS as a single IP, so we suggest: 1. Map whole UFS register (include MCQ) in ufshcd_pltfrm_init() 2. In ufshcd_mcq_config_resource() assign mcq_base address directly, ie, hba->mcq_base = hba->mmio_base + MCQ_SQATTR_OFFSET(hba- >mcq_capabilities) 3. In ufshcd_mcq_vops_op_runtime_config(), assign SQD, SQIS, CQD, CQIS base, offset and stride This is why I propose ufshcd_mcq_config_resource() to be customized, not in common code Regards, Eddie Huang