Hi Craig, On Thu, Jul 10, 2014 at 03:09:51PM -0700, Craig Lewis wrote: > I fixed this issue by reformatting all of the OSDs. I changed the mkfs > options from > > [osd] > osd mkfs type = xfs > osd mkfs options xfs = -l size=1024m -n size=64k -i size=2048 -s size=4096 > > to > [osd] > osd mkfs type = xfs > osd mkfs options xfs = -s size=4096 > > (I have a mix of 512 and 4k sector drives, and I want to treat them all > like 4k sector). > > > Now deep scrub runs to completion, and CPU usage of the daemon never goes > over 30%. I did have to restart a few OSDs when I scrubbed known problem > PGs, but they scrubbed the 2nd time successfully. The cluster is still > scrubbing, but it's completed half with no more issues. I suspect it was the "-n size=64k" causing this behaviour, potentially using too much CPU and starving the OSD processes: http://xfs.org/index.php/XFS_FAQ#Q:_Performance:_mkfs.xfs_-n_size.3D64k_option Cheers, Chris
 |