The following changes since commit d206a76d7d2726f3b096037f2079ce0bd3ba329b: Linux 6.8-rc6 (2024-02-25 15:46:06 -0800) are available in the Git repository at: https://evilpiepirate.org/git/bcachefs.git tags/bcachefs-2024-03-13 for you to fetch changes up to be28368b2ccb328b207c9f66c35bb088d91e6a03: bcachefs: time_stats: shrink time_stat_buffer for better alignment (2024-03-13 21:38:03 -0400) ---------------------------------------------------------------- bcachefs updates for 6.9 - Subvolume children btree; this is needed for providing a userspace interface for walking subvolumes, which will come later - Lots of improvements to directory structure checking - Improved journal pipelining, significantly improving performance on high iodepth write workloads - Discard path improvements: the discard path is more efficient, and no longer flushes the journal unnecessarily - Buffered write path can now avoid taking the inode lock - new mm helper: memalloc_flags_{save|restore} - mempool now does kvmalloc mempools ---------------------------------------------------------------- Brian Foster (1): bcachefs: fix lost journal buf wakeup due to improved pipelining Calvin Owens (1): bcachefs: Silence gcc warnings about arm arch ABI drift Colin Ian King (1): bcachefs: remove redundant assignment to variable ret Daniel Hill (1): bcachefs: rebalance_status now shows correct units Darrick J. Wong (8): bcachefs: thread_with_file: allow creation of readonly files bcachefs: thread_with_file: fix various printf problems bcachefs: thread_with_file: create ops structure for thread_with_stdio bcachefs: thread_with_file: allow ioctls against these files bcachefs: time_stats: add larger units bcachefs: mean_and_variance: put struct mean_and_variance_weighted on a diet bcachefs: time_stats: split stats-with-quantiles into a separate structure bcachefs: time_stats: shrink time_stat_buffer for better alignment Erick Archer (1): bcachefs: Prefer struct_size over open coded arithmetic Guoyu Ou (1): bcachefs: skip invisible entries in empty subvolume checking Hongbo Li (3): bcachefs: fix the error code when mounting with incorrect options. bcachefs: avoid returning private error code in bch2_xattr_bcachefs_set bcachefs: intercept mountoption value for bool type Kent Overstreet (109): bcachefs: journal_seq_blacklist_add() now handles entries being added out of order bcachefs: extent_entry_next_safe() bcachefs: no_splitbrain_check option bcachefs: fix check_inode_deleted_list() bcachefs: Fix journal replay with unreadable btree roots bcachefs: Fix degraded mode fsck bcachefs: Correctly validate k->u64s in btree node read path bcachefs: Set path->uptodate when no node at level bcachefs: fix split brain message bcachefs: Kill unnecessary wakeups in journal reclaim bcachefs: Split out journal workqueue bcachefs: Avoid setting j->write_work unnecessarily bcachefs: Journal writes should be REQ_SYNC|REQ_META bcachefs: Avoid taking journal lock unnecessarily bcachefs: fixup for building in userspace bcachefs: Improve bch2_dirent_to_text() bcachefs: Workqueues should be WQ_HIGHPRI bcachefs: bch2_hash_set_snapshot() -> bch2_hash_set_in_snapshot() bcachefs: Cleanup bch2_dirent_lookup_trans() bcachefs: convert journal replay ptrs to darray bcachefs: improve journal entry read fsck error messages bcachefs: jset_entry_datetime bcachefs: bio per journal buf bcachefs: closure per journal buf bcachefs: better journal pipelining bcachefs: btree_and_journal_iter.trans bcachefs: btree node prefetching in check_topology bcachefs: Subvolumes may now be renamed bcachefs: Switch to uuid_to_fsid() bcachefs: Initialize super_block->s_uuid bcachefs: move fsck_write_inode() to inode.c bcachefs: bump max_active on btree_interior_update_worker bcachefs: Kill some -EINVALs bcachefs: Factor out check_subvol_dirent() bcachefs: factor out check_inode_backpointer() mm: introduce memalloc_flags_{save,restore} mm: introduce PF_MEMALLOC_NORECLAIM, PF_MEMALLOC_NOWARN bcachefs: bch2_inode_insert() bcachefs: bch2_lookup() gives better error message on inode not found mempool: kvmalloc pool bcachefs: kill kvpmalloc() bcachefs: thread_with_stdio: eliminate double buffering bcachefs: thread_with_stdio: convert to darray bcachefs: thread_with_stdio: kill thread_with_stdio_done() bcachefs: thread_with_stdio: fix bch2_stdio_redirect_readline() bcachefs: Thread with file documentation bcachefs: thread_with_stdio: Mark completed in ->release() kernel/hung_task.c: export sysctl_hung_task_timeout_secs bcachefs: thread_with_stdio: suppress hung task warning bcachefs: thread_with_file: Fix missing va_end() bcachefs: thread_with_file: add f_ops.flush bcachefs: Kill more -EIO error codes bcachefs: Check subvol <-> inode pointers in check_subvol() bcachefs: Check subvol <-> inode pointers in check_inode() bcachefs: check_inode_dirent_inode() bcachefs: better log message in lookup_inode_for_snapshot() bcachefs: check bi_parent_subvol in check_inode() bcachefs: simplify check_dirent_inode_dirent() bcachefs: delete duplicated checks in check_dirent_to_subvol() bcachefs: check inode->bi_parent_subvol against dirent bcachefs: check dirent->d_parent_subvol bcachefs: Repair subvol dirents that point to non subvols bcachefs: bch_subvolume::parent -> creation_parent bcachefs: Fix path where dirent -> subvol missing and we don't fix bcachefs: Pass inode bkey to check_path() bcachefs: check_path() now prints full inode when reattaching bcachefs: Correctly reattach subvolumes bcachefs: bch2_btree_bit_mod -> bch2_btree_bit_mod_buffered bcachefs: bch2_btree_bit_mod() bcachefs: bch_subvolume::fs_path_parent bcachefs: BTREE_ID_subvolume_children bcachefs: Check for subvolume children when deleting subvolumes bcachefs: Pin btree cache in ram for random access in fsck bcachefs: Save key_cache_path in peek_slot() bcachefs: Track iter->ip_allocated at bch2_trans_copy_iter() bcachefs: Use kvzalloc() when dynamically allocating btree paths bcachefs: Improve error messages in device remove path bcachefs: bch2_print_opts() bcachefs: bch2_trigger_alloc() handles state changes better bcachefs: bch2_check_subvolume_structure() bcachefs: check_path() now only needs to walk up to subvolume root bcachefs: more informative write path error message bcachefs: Drop redundant btree_path_downgrade()s bcachefs: improve bch2_journal_buf_to_text() bcachefs: Split out discard fastpath bcachefs: Fix journal_buf bitfield accesses bcachefs: Add journal.blocked to journal_debug_to_text() bcachefs: Errcode tracepoint, documentation bcachefs: jset_entry for loops declare loop iter bcachefs: Rename journal_keys.d -> journal_keys.data bcachefs: journal_keys now uses darray helpers bcachefs: improve move_gap() bcachefs: split out ignore_blacklisted, ignore_not_dirty bcachefs: Fix bch2_journal_noflush_seq() fs: file_remove_privs_flags() bcachefs: Buffered write path now can avoid the inode lock bcachefs: Split out bkey_types.h bcachefs: copy_(to|from)_user_errcode() lib/generic-radix-tree.c: Make nodes more reasonably sized bcachefs: fix bch2_journal_buf_to_text() bcachefs: Check for writing superblocks with nonsense member seq fields bcachefs: Kill unused flags argument to btree_split() bcachefs: fix deletion of indirect extents in btree_gc bcachefs: Fix order of gc_done passes bcachefs: Always flush write buffer in delete_dead_inodes() bcachefs: Fix btree key cache coherency during replay bcachefs: fix bch_folio_sector padding bcachefs: reconstruct_alloc cleanup bcachefs: pull out time_stats.[ch] Li Zetao (1): bcachefs: Fix null-ptr-deref in bch2_fs_alloc() Thomas Bertschinger (1): bcachefs: omit alignment attribute on big endian struct bkey Documentation/filesystems/bcachefs/errorcodes.rst | 30 + MAINTAINERS | 1 + fs/bcachefs/Makefile | 4 + fs/bcachefs/alloc_background.c | 219 ++++-- fs/bcachefs/alloc_background.h | 1 + fs/bcachefs/alloc_foreground.c | 13 +- fs/bcachefs/backpointers.c | 143 ++-- fs/bcachefs/bbpos_types.h | 2 +- fs/bcachefs/bcachefs.h | 21 +- fs/bcachefs/bcachefs_format.h | 53 +- fs/bcachefs/bkey.h | 207 +----- fs/bcachefs/bkey_types.h | 213 ++++++ fs/bcachefs/btree_cache.c | 37 +- fs/bcachefs/btree_gc.c | 151 ++-- fs/bcachefs/btree_io.c | 22 +- fs/bcachefs/btree_iter.c | 20 +- fs/bcachefs/btree_journal_iter.c | 180 +++-- fs/bcachefs/btree_journal_iter.h | 14 +- fs/bcachefs/btree_key_cache.c | 8 +- fs/bcachefs/btree_locking.c | 3 +- fs/bcachefs/btree_types.h | 9 +- fs/bcachefs/btree_update.c | 23 +- fs/bcachefs/btree_update.h | 3 +- fs/bcachefs/btree_update_interior.c | 83 ++- fs/bcachefs/btree_update_interior.h | 2 + fs/bcachefs/btree_write_buffer.c | 4 +- fs/bcachefs/buckets.c | 32 +- fs/bcachefs/chardev.c | 57 +- fs/bcachefs/checksum.c | 2 +- fs/bcachefs/compress.c | 14 +- fs/bcachefs/debug.c | 6 +- fs/bcachefs/dirent.c | 143 ++-- fs/bcachefs/dirent.h | 6 +- fs/bcachefs/ec.c | 4 +- fs/bcachefs/errcode.c | 15 +- fs/bcachefs/errcode.h | 18 +- fs/bcachefs/error.c | 10 +- fs/bcachefs/error.h | 2 +- fs/bcachefs/extents.h | 11 +- fs/bcachefs/fifo.h | 4 +- fs/bcachefs/fs-common.c | 74 +- fs/bcachefs/fs-io-buffered.c | 149 +++- fs/bcachefs/fs-io-pagecache.h | 9 +- fs/bcachefs/fs.c | 222 ++++-- fs/bcachefs/fsck.c | 847 ++++++++++++++-------- fs/bcachefs/fsck.h | 1 + fs/bcachefs/inode.c | 55 +- fs/bcachefs/inode.h | 19 + fs/bcachefs/io_read.c | 2 +- fs/bcachefs/io_write.c | 18 +- fs/bcachefs/journal.c | 280 ++++--- fs/bcachefs/journal.h | 7 +- fs/bcachefs/journal_io.c | 403 +++++----- fs/bcachefs/journal_io.h | 47 +- fs/bcachefs/journal_reclaim.c | 29 +- fs/bcachefs/journal_seq_blacklist.c | 69 +- fs/bcachefs/journal_types.h | 30 +- fs/bcachefs/lru.c | 7 +- fs/bcachefs/mean_and_variance.c | 28 +- fs/bcachefs/mean_and_variance.h | 14 +- fs/bcachefs/mean_and_variance_test.c | 80 +- fs/bcachefs/migrate.c | 8 +- fs/bcachefs/opts.c | 8 +- fs/bcachefs/opts.h | 10 + fs/bcachefs/rebalance.c | 4 +- fs/bcachefs/recovery.c | 88 ++- fs/bcachefs/recovery_types.h | 2 + fs/bcachefs/sb-clean.c | 16 - fs/bcachefs/sb-downgrade.c | 10 +- fs/bcachefs/sb-errors_types.h | 19 +- fs/bcachefs/str_hash.h | 15 +- fs/bcachefs/subvolume.c | 187 ++++- fs/bcachefs/subvolume.h | 8 +- fs/bcachefs/subvolume_format.h | 4 +- fs/bcachefs/super-io.c | 22 +- fs/bcachefs/super.c | 93 ++- fs/bcachefs/sysfs.c | 4 +- fs/bcachefs/thread_with_file.c | 391 +++++++--- fs/bcachefs/thread_with_file.h | 59 +- fs/bcachefs/thread_with_file_types.h | 15 +- fs/bcachefs/time_stats.c | 165 +++++ fs/bcachefs/time_stats.h | 159 ++++ fs/bcachefs/trace.h | 19 + fs/bcachefs/util.c | 227 +----- fs/bcachefs/util.h | 142 +--- fs/bcachefs/xattr.c | 5 +- fs/inode.c | 7 +- include/linux/fs.h | 1 + include/linux/generic-radix-tree.h | 29 +- include/linux/mempool.h | 13 + include/linux/sched.h | 4 +- include/linux/sched/mm.h | 60 +- kernel/hung_task.c | 1 + lib/generic-radix-tree.c | 35 +- mm/mempool.c | 13 + 95 files changed, 3770 insertions(+), 2253 deletions(-) create mode 100644 Documentation/filesystems/bcachefs/errorcodes.rst create mode 100644 fs/bcachefs/bkey_types.h create mode 100644 fs/bcachefs/time_stats.c create mode 100644 fs/bcachefs/time_stats.h
