On Mon, Dec 03, 2018 at 04:04:36PM +1100, Christopher James Halse Rogers wrote: > Hey Kent! > > bcachefs master seems to be particularly unstable at the moment. This crash > occurs after only a small amount of data is written to a freshy formatted > bcachefs volume (encryption, lz4, 3 devices, 2 HDDs in the background group, > 1 SSD in the promote/foreground group). yeah, I seem to be slipping on the testing lately... I've reprod this one, working on it now > > [ 652.580096] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): initializing > new filesystem > [ 666.533929] EXT4-fs (sdb1): mounted filesystem with ordered data mode. > Opts: (null) > [ 670.522954] FAT-fs (sda1): Volume was not properly unmounted. Some data > may be corrupt. Please run fsck. > [ 703.327624] ------------[ cut here ]------------ > [ 703.327625] disk usage increased without a reservation > [ 703.327633] WARNING: CPU: 6 PID: 1999 at fs/bcachefs/buckets.c:333 > bch2_fs_usage_apply+0x26f/0x280 > [ 703.327634] Modules linked in: nls_iso8859_1 xfs jfs btrfs raid10 raid456 > async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 > multipath linear scsi_dh_emc scsi_dh_rdac scsi_dh_alua scsi_dh_hp_sw > ghash_clmulni_intel pcbc iwlwifi aesni_intel aes_x86_64 nvme crypto_simd > cfg80211 cryptd glue_helper uas ahci nvme_core r8169 usb_storage libahci > [ 703.327649] CPU: 6 PID: 1999 Comm: kworker/6:1H Not tainted > 4.19.0+bcachefs.git20181203.0bd7367c-1-generic #0 > [ 703.327650] Hardware name: System76 Oryx Pro/ Oryx Pro, BIOS > 1.05.02dRSA2 02/20/2017 > [ 703.327653] Workqueue: bcachefs bch2_write_index > [ 703.327654] RIP: 0010:bch2_fs_usage_apply+0x26f/0x280 > [ 703.327655] Code: f0 4c 29 ab 78 18 00 00 4c 89 f6 e9 3d fe ff ff 48 c7 > c7 80 9d b4 a3 48 89 95 88 fe ff ff c6 05 05 54 43 01 01 e8 93 4f c8 ff <0f> > 0b 48 8b 95 88 fe ff ff eb cb e8 31 4c c8 ff 90 0f 1f 44 00 00 > [ 703.327656] RSP: 0018:ffffa0e4463cf600 EFLAGS: 00010286 > [ 703.327657] RAX: 0000000000000000 RBX: ffff92b5d5ba0000 RCX: > 0000000000000006 > [ 703.327657] RDX: 0000000000000007 RSI: 0000000000000082 RDI: > ffff92b5e6996420 > [ 703.327658] RBP: ffffa0e4463cf778 R08: 0000000000000000 R09: > 0000000000000345 > [ 703.327658] R10: 00000200ce2e1da6 R11: 0000000000000000 R12: > ffffa0e4463cf808 > [ 703.327659] R13: 0000000000000038 R14: 0000000000000000 R15: > ffff92b5d5ba0000 > [ 703.327660] FS: 0000000000000000(0000) GS:ffff92b5e6980000(0000) > knlGS:0000000000000000 > [ 703.327661] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 703.327661] CR2: 000055b38d734278 CR3: 0000000298a0a004 CR4: > 00000000003606e0 > [ 703.327662] Call Trace: > [ 703.327665] bch2_mark_update+0x2b9/0x5b0 > [ 703.327667] do_btree_insert_at+0x177/0xbb0 > [ 703.327669] ? bch2_extent_mark_replicas_cached+0x125/0x340 > [ 703.327670] __bch2_btree_insert_at+0xfa/0x800 > [ 703.327671] bch2_migrate_index_update+0x6c0/0x980 > [ 703.327674] ? ata_scsi_queuecmd+0xad/0x210 > [ 703.327676] ? __blk_mq_requeue_request+0x7c/0x100 > [ 703.327677] ? blk_mq_dispatch_rq_list+0x1da/0x520 > [ 703.327679] __bch2_write_index+0x180/0x320 > [ 703.327681] bch2_write_index+0x18/0xa0 > [ 703.327682] process_one_work+0x20f/0x410 > [ 703.327683] worker_thread+0x34/0x400 > [ 703.327685] kthread+0x120/0x140 > [ 703.327685] ? pwq_unbound_release_workfn+0xd0/0xd0 > [ 703.327687] ? kthread_bind+0x40/0x40 > [ 703.327688] ret_from_fork+0x35/0x40 > [ 703.327689] ---[ end trace d13000b37b755a53 ]--- > [ 714.473830] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): invalid key > in journal: spans multiple buckets > [ 714.473830] u64s 9 type 6 4121:256 snap 0 len 128 ver 65555: ptr: > 0:31581104 gen 1 crc: c_size 48 size 128 offset 0 nonce 0 csum 3 compress 3 > ptr: 2:4442680 gen 1 cached i, exiting > [ 714.473831] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): Unable to > continue, halting > [ 714.473833] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): emergency > read only > [ 714.473834] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): unable to > write journal to sufficient devices > [ 744.169837] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): IO error: > read only > [ 744.169847] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): IO error: > read only > [ 744.169849] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): IO error: > read only > [ 749.289851] bcachefs (9bd0313c-696a-4104-97cf-376ed4f892ee): IO error: > read only >