This series implements support for ZBC disks used through the scsi-mq I/O path. The current scsi level support of ZBC disks guarantees write request ordering using a per-zone write lock which prevents issuing simultaneously multiple write commands to a zone, doing so avoid reordering of sequential writes to sequential zones. This method is however ineffective when scsi-mq is used with zoned block devices. This is due to the different execution model of blk-mq which passes a request to the scsi layer for dispatching after the request has been removed from the I/O scheduler queue. That is, when the scsi layer tries to lock the target zone of the request, the request may already be out of order and zone write locking fails to prevent that. Various approaches have been tried to solve this problem. All of them had the serious disadvantage of cluttering blk-mq code with zoned block device specific conditions and processing. As such extensive changes can only transform into maintenance nightmares, a radically different solution is proposed here. This series support implementation is in the form of a new "zoned" I/O scheduler based on mq-deadline. Zoned is mostly identical to the mq-deadline scheduler. It only differs from mq-deadline from the addition of a per zone write locking mechanism similar to that implemented in sd_zbc.c. The zoned scheduler zone write locking mechanism is used for the exact same purpose as the one in the scsi disk driver: limit writes per zone to one to avoid reordering. The locking context however changes and is moved to the dispatch_request method of the scheduler, that is, target zones of write requests can be locked before the requests are issued. In effect, this results in the same behavior as the legacy scsi path. Sequential write ordering is preserved. The zoned scheduler is added as part of the scsi code under driver/scsi. This allows access to information on the disk zones maintained within the device scsi_disk structure as this information (e.g. zone types) cannot be retreived from the context of an I/O scheduler initialization method (init_queue() method). The series patches are as follows: - The first 2 patches fix exported symbols declaration to allow compiling an I/O scheduler outside of the block/ directory. No functional changes from these patches. - Patches 3 to 7 reorganize and cleanup the scsi ZBC support to facilitate the intorduction of the scheduler. - Path 8 is a bug fix - Patch 9 is an optimization for the legacy scsi path which avoids zone locking if a write request targets a conventional zone. - Path 10 disables zone write locking for disks accessed through scsi-mq. - Patch 11 introduces the new function scsi_disk_from_queue() - Patch 12 introduces the zoned blk-mq I/O scheduler. Comments are as always very much appreciated. Changes from v1: * Addressed Bart's comments for the blk-mq patches (declarations files) * Split (former) patch 4 into multiple patches to facilitate review * Fixed scsi disk lookup from io scheduler by introducing scsi_disk_from_queue() Damien Le Moal (12): block: Fix declaration of blk-mq debugfs functions block: Fix declaration of blk-mq scheduler functions scsi: sd_zbc: Move ZBC declarations to scsi_proto.h scsi: sd_zbc: Move zbc disk declarations to sd_zbc.h scsi: sd_zbc: Fix comments and indentation scsi: sd_zbc: Rearrange code scsi: sd_zbc.c: Use well defined macros scsi: sd_zbc: Fix sd_zbc_read_zoned_characteristics() scsi: sd_zbc: Limit zone write locking to sequential zones scsi: sd_zbc: Disable zone write locking with scsi-mq scsi: sd: Introduce scsi_disk_from_queue() scsi: Introduce ZBC disk I/O scheduler Documentation/block/zoned-iosched.txt | 48 ++ block/Kconfig.iosched | 12 + block/blk-mq-debugfs.h | 14 +- block/blk-mq-sched.h | 11 +- drivers/scsi/Makefile | 1 + drivers/scsi/sd.c | 33 ++ drivers/scsi/sd.h | 54 +- drivers/scsi/sd_zbc.c | 236 +++++---- drivers/scsi/sd_zbc.h | 91 ++++ drivers/scsi/zoned_iosched.c | 939 ++++++++++++++++++++++++++++++++++ include/linux/blk-mq-debugfs.h | 23 + include/linux/blk-mq-sched.h | 14 + include/scsi/scsi_proto.h | 45 +- 13 files changed, 1354 insertions(+), 167 deletions(-) create mode 100644 Documentation/block/zoned-iosched.txt create mode 100644 drivers/scsi/sd_zbc.h create mode 100644 drivers/scsi/zoned_iosched.c create mode 100644 include/linux/blk-mq-debugfs.h create mode 100644 include/linux/blk-mq-sched.h -- 2.13.5
