On Tue, Jul 28, 2015 at 09:08:27PM +0000, Somnath Roy wrote: > 2. Each filestore Op threads is now doing O_DSYNC write followed by > posix_fadvise(**fd, 0, 0, POSIX_FADV_DONTNEED); Where aren't you using O_DIRECT | O_DSYNC? > 15. The main challenge I am facing in both the scheme is XFS metadata > flush process (xfsaild) is choking all the processes accessing the disk > when it is waking up. I can delay it till max 30 sec and if there are > lot of dirty metadata, there is a performance spike down for very brief > amount of time. Even if we are acknowledging writes from say NVRAM > journal write, still the opthreads are doing getattrs on the XFS > and those threads are getting blocked. Can you send a more detailed report to the XFS lists? E.g. which locks your blocked on and some perf data? -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html