Data loss/corruption when using fallocate/ftruncate.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello again, folks.  We've got an app that needs to use O_DIRECT for
performance and is using fallocate() to make sure the files are all in
one extent.  Unfortunately the end size isn't always the fallocated size
so it has to do a truncate when it's done; the sequence is generally:

	create(file)
	fallocate(file, KEEP_SIZE, 0, maxlen)
	write/write/write/write...
	fallocate(file, 0, 0. maxlen-minus a bit)
	ftruncate(file, actual-len)

We've been seeing some of these files end up all or partly zero after
(but not before) the truncate.  After further analysis, it's clear that
the last extent (possibly the only extent) is being marked uninit for
some reason.  The actual blocks on disk are nonzero but due to the
extent being marked uninit they are being read as zero.

Note that this isn't easy to reproduce; lots of other stuff is going on
when this happens.  Our feeling is that there's a race somewhere, quite
possibly between fallocate and ftruncate, but it's not clear.  Certainly
a single-threaded application doesn't see this, nor does an application
that uses mutexes to serialize access to the file.

This is a heads-up to point out a real problem.  We're still analyzing
and trying to track down the bug but it may take a little while.
-- 
Frank Mayhar <fmayhar@xxxxxxxxxx>
Google, Inc.

--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[Index of Archives]     [Reiser Filesystem Development]     [Ceph FS]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Linux FS]     [Yosemite National Park]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Device Mapper]     [Linux Media]

  Powered by Linux