On Tue, Feb 06, 2018 at 09:02:49PM +0200, Ran Shalit wrote: > Hello, > > I write a pci linux driver, and after reviewing some examples in > kernel, there is issue I am not sure about: > DMA seems to follow the following steps in PCI: > 1. driver allocate dma buffers and map them to BAR. The driver needs to allocate and map buffers for DMA. See Documentation/DMA-API-HOWTO.txt for a start. DMA has nothing to do with BARs. BARs describe address space on the *device* that can be accessed by the CPU. BARs are used for "programmed I/O", not for DMA. > 2. driver initialize device to be familiar with dma addresses. When the driver creates a DMA mapping, for example, by calling dma_map_single(), it gets the DMA address. It can then program the DMA address into the device. > 3. tx from cpu to device: driver trigger dma, by writing into device BARs. If you mean the device is doing a DMA read from system memory, the driver must first allocate and DMA-map a buffer, then tell the device what the DMA address is, then tell the device to start the DMA. The driver would typically use the BARs to give the device the buffer's DMA address and the "DMA start" command. > 4. rx from device to cpu: device is responsible for triggering DMA > (driver does not do anything here) The driver *always* has to perform DMA mapping, regardless of whether the device is doing DMA reads or writes. In this case, I think you're talking about a device doing a DMA write to system memory. The driver must have previously performed the mapping and told the device "here's a DMA address where you can write things in the future." > 5. tx/rx completion: interrupt from DMA (in cpu) Typically a device generates an interrupt when DMA is complete. > 6. interrupt handler of section 5 above checks that device finished tx/rx. > > Is the above understanding correct ? > 1. As to 6, I am not sure about, is it that device knows that > transaction is finished (DMA is in soc , not device) ? This is device-specific. > 2. How does device triggers DMA from device to cpu, is it by simply > writing to BAR ? In most cases the device itself performs the DMA. It sounds like you have a case where the DMA engine is not part of the device itself. I don't know how that would be programmed, except to say that the DMA engine presumably operates on DMA addresses, and something would still have to DMA-map buffers to obtain those. BARs are typically used for programming the device, i.e., the driver would use them. BARs are not in the data path for a DMA transfer. > 3. How does device triggers DMA from cpu to device, is it by simply > reading from BAR ?
