This series introduces a proposal to implementing atomic writes in the kernel for torn-write protection. This series takes the approach of adding a new "atomic" flag to each of pwritev2() and iocb->ki_flags - RWF_ATOMIC and IOCB_ATOMIC, respectively. When set, these indicate that we want the write issued "atomically". Only direct IO is supported and for block devices here. For this, atomic write HW is required, like SCSI ATOMIC WRITE (16). XFS FS support will require rework according to discussion at: https://lore.kernel.org/linux-fsdevel/20240124142645.9334-1-john.g.garry@xxxxxxxxxx/T/#m916df899e9d0fb688cdbd415826ae2423306c2e0 The current plan there is to use forcealign feature from the start. This will take a bit more time to get done. Updated man pages have been posted at: https://lore.kernel.org/lkml/20240124112731.28579-1-john.g.garry@xxxxxxxxxx/T/#m520dca97a9748de352b5a723d3155a4bb1e46456 The goal here is to provide an interface that allows applications use application-specific block sizes larger than logical block size reported by the storage device or larger than filesystem block size as reported by stat(). With this new interface, application blocks will never be torn or fractured when written. For a power fail, for each individual application block, all or none of the data to be written. A racing atomic write and read will mean that the read sees all the old data or all the new data, but never a mix of old and new. Three new fields are added to struct statx - atomic_write_unit_min, atomic_write_unit_max, and atomic_write_segments_max. For each atomic individual write, the total length of a write must be a between atomic_write_unit_min and atomic_write_unit_max, inclusive, and a power-of-2. The write must also be at a natural offset in the file wrt the write length. For pwritev2, iovcnt is limited by atomic_write_segments_max. SCSI sd.c and scsi_debug and NVMe kernel support is added. This series is based on v6.8-rc6 Patches can be found at: https://github.com/johnpgarry/linux/commits/atomic-writes-v6.8-v5 Changes since v4: - Finally combine both NVMe patches - Pass inode to bdev_statx() (Ritesh) - Add IOCB_ATOMIC to TRACE_IOCB_STRINGS (Ritesh) - Make rq_straddles_atomic_write_boundary() size+sign safe (Dave) and simplify (Ritesh) - Improve generic_fill_statx_atomic_writes() doc (Dave, Ritesh) and use GPL export (Christoph) - Drop BDEV_STATX_SUPPORTED_MASK and improve bdev_statx() comments (Christoph) - Tweak atomic_write_valid() flow and use IS_ALIGNED (Dave) and also rename to generic_atomic_write_valid() (Ritesh) - Fix module param in scsi_debug (Ojaswin) - Tweak blkdev_direct_IO() patch to pass bdev (Keith mentioned idea) - Some smaller code style changes, like variable renames (Ritesh) - Restructure first block layer patch commit message (Ritesh) - Add more RB tags (thanks) Alan Adamson (1): nvme: Atomic write support John Garry (6): block: Pass blk_queue_get_max_sectors() a request pointer block: Call blkdev_dio_unaligned() from blkdev_direct_IO() block: Add core atomic write support block: Add fops atomic write support scsi: sd: Atomic write support scsi: scsi_debug: Atomic write support Prasad Singamsetty (3): fs: Initial atomic write support fs: Add initial atomic write support info to statx block: Add atomic write support for statx Documentation/ABI/stable/sysfs-block | 52 +++ block/bdev.c | 36 +- block/blk-merge.c | 98 ++++- block/blk-mq.c | 2 +- block/blk-settings.c | 101 +++++ block/blk-sysfs.c | 33 ++ block/blk.h | 9 +- block/fops.c | 57 ++- drivers/nvme/host/core.c | 72 ++++ drivers/scsi/scsi_debug.c | 588 +++++++++++++++++++++------ drivers/scsi/scsi_trace.c | 22 + drivers/scsi/sd.c | 93 ++++- drivers/scsi/sd.h | 8 + fs/aio.c | 8 +- fs/btrfs/ioctl.c | 2 +- fs/read_write.c | 2 +- fs/stat.c | 50 ++- include/linux/blk_types.h | 3 +- include/linux/blkdev.h | 67 ++- include/linux/fs.h | 40 +- include/linux/stat.h | 3 + include/scsi/scsi_proto.h | 1 + include/trace/events/scsi.h | 1 + include/uapi/linux/fs.h | 5 +- include/uapi/linux/stat.h | 9 +- io_uring/rw.c | 4 +- 26 files changed, 1177 insertions(+), 189 deletions(-) -- 2.31.1
