On Sep 05, 2008 13:24 -0500, Eric Sandeen wrote: > If I write even, then odd, blocks, in the end it comes out to one > extent - even with an unmount in between: > > # for I in `seq 0 2 1024`; do dd if=/dev/zero of=testfile bs=4k count=1 > conv=notrunc seek=$I 2>/dev/null; done > > (unmount, remount) > > # for I in `seq 1 2 1024`; do dd if=/dev/zero of=testfile bs=4k count=1 > conv=notrunc seek=$I 2>/dev/null; done > # filefrag testfile > File is stored in extents format > testfile: 1 extent found Interesting. I'd asked Alex to tune the allocator to locate blocks with a position relative to the end of the previously-allocated blocks. I didn't think it would actually work so well :-). > However, sequential, synchronous writes are doing weird things: > > # for I in `seq 1 1024`; do dd if=/dev/zero of=testfile bs=4k count=1 > conv=notrunc seek=$I oflag=sync 2>/dev/null; done > > # filefrag -v testfile > Checking testfile > Filesystem type is: ef53 > Filesystem cylinder groups is approximately 235 > File is stored in extents format > Blocksize of file testfile2 is 4096 > File size of testfile2 is 4198400 (1025 blocks) > First block: 0 > Last block: 45312 > Discontinuity: Block 2 is at 44032 (was 43520) > Discontinuity: Block 11 is at 43521 (was 44040) > Discontinuity: Block 15 is at 43066 (was 43524) > Discontinuity: Block 256 is at 44544 (was 43306) > testfile: 5 extents found > > not only is it non-contiguous, it's out of order. I agree this is completely strange. The only thing I can think of is that this is being treated as a "small file" and the blocks are being packed into the small file preallocation group, and if this is an SMP system then it is possible there are 2 or more preallocation spaces. Since you have 3 processes running (bash, seq, dd) and dd is being run in a different process (CPU?) for each block. Can you try running this with a single process? Even if you run "dd if=/dev/zero of=testfile bs=4k count=1024 oflag=sync" should still produce single-block sync writes without forking each time. I agree the allocator probably shouldn't do this, but it isn't exactly a normal workload. It seems possible that the goal block (the last block allocated) isn't being taken into account properly? It also seems possible that if the dd process is moving between CPUs each time the preallocation group is blocking the allocation of the "next" block? > Interestingly, a backwards synchronous write comes out exactly the same: Are you sure you unlinked the file in between? :-) Cheers, Andreas -- Andreas Dilger Sr. Staff Engineer, Lustre Group Sun Microsystems of Canada, Inc. -- To unsubscribe from this list: send the line "unsubscribe linux-ext4" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
