I have PGs that I can't deep-scrub

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Craig,

On Thu, Jul 10, 2014 at 03:09:51PM -0700, Craig Lewis wrote:
> I fixed this issue by reformatting all of the OSDs.  I changed the mkfs
> options from
> 
> [osd]
>   osd mkfs type = xfs
>   osd mkfs options xfs = -l size=1024m -n size=64k -i size=2048 -s size=4096
> 
> to
> [osd]
>   osd mkfs type = xfs
>   osd mkfs options xfs = -s size=4096
> 
> (I have a mix of 512 and 4k sector drives, and I want to treat them all
> like 4k sector).
> 
> 
> Now deep scrub runs to completion, and CPU usage of the daemon never goes
> over 30%.  I did have to restart a few OSDs when I scrubbed known problem
> PGs, but they scrubbed the 2nd time successfully.  The cluster is still
> scrubbing, but it's completed half with no more issues.

I suspect it was the "-n size=64k" causing this behaviour, potentially using
too much CPU and starving the OSD processes:

http://xfs.org/index.php/XFS_FAQ#Q:_Performance:_mkfs.xfs_-n_size.3D64k_option

Cheers,

Chris


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux