Replacing OSD disks with SSD journal - journal disk space use

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

It's firefly 0.80.9, so if the improvement is in Hammer I haven't seen it.

Will check back when I upgrade the cluster.

Thanks
Eneko

On 26/05/15 17:45, Robert LeBlanc wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> What version of Ceph are you using? I seem to remember an enhancement
> of ceph-disk for Hammer that is more aggressive in reusing previous
> partition.
> - ----------------
> Robert LeBlanc
> GPG Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1
>
>
> On Mon, May 25, 2015 at 4:22 AM, Eneko Lacunza  wrote:
>> Hi all,
>>
>> We have a firefly ceph cluster (using Promxox VE, but I don't think this is
>> revelant), and found a OSD disk was having quite a high amount of errors as
>> reported by SMART, and also quite high wait time as reported by munin, so we
>> decided to replace it.
>>
>> What I have done is down/out the osd, then remove it (removing partitions).
>> Replace the disk and create a new OSD, which was created with the same ID as
>> the removed one (as I was hoping to not change CRUSH map).
>>
>> So everything has worked as expected, except one minor non-issue:
>> - Original OSD journal was on a separate SSD disk, which had partitions #1
>> and #2 (journals of 2 OSDs).
>> - Original journal partition (#1) was removed
>> - A new partition has been created as #1, but has been assigned space after
>> the last existing partition. So there is now hole of 5GB in the beginning of
>> SSD disk. Promox is using ceph-disk prepare for this, I seen in the docs
>> (http://ceph.com/docs/master/man/8/ceph-disk/) that ceph-disk prepare
>> creates a new partition in the journal block device.
>>
>> What I'm afraid is that given enough OSD replacements, Proxmox wouldn't find
>> free space for new journals in that SSD disk? Although there would be plenty
>> in the beginning?
>>
>> Maybe the journal-partition creation can be improved so that it can detect
>> free space also in the beginning and between existing partitions?
>>
>> Cheers
>> Eneko
>>
>> --
>> Zuzendari Teknikoa / Director T?cnico
>> Binovo IT Human Project, S.L.
>> Telf. 943575997
>>        943493611
>> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
>> www.binovo.es
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users at lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> -----BEGIN PGP SIGNATURE-----
> Version: Mailvelope v0.13.1
> Comment: https://www.mailvelope.com
>
> wsFcBAEBCAAQBQJVZJUvCRDmVDuy+mK58QAAZ+4QAIr27ymAPpOZPr9JUVWZ
> M8avNyddIiJpG/S2pP91UyxAzrgAy+mGbVQG0istpo98QKjT9UNxi/ySe64c
> OxmIHb1tp40nyMtWFnv3W0Iw1iiScTxp2hWc2KSubbibFS6YY4ACRmTysBh+
> Curdo9TG9h6k4zSbQ1gAInuMCh6NIoxUMnNatkyju5UgxpGYKg9iN8Ddt+wX
> H/YC3yKLnwuqIkYBWsMpQCNpry2RZYWTUF9tRiuGTJg5lnIuU572sXRCpXkZ
> NGcVYjbOX2g16MMxohSfivxJ36PbCGsvPIde3WZz0RDP7xmeJnEanR3Zw9mC
> Td80pyVkuu28lRJ/UYWwTRkd0PECNejYaGvBN6LjidbZE2nejTz31Pl0DGuZ
> 9zlCyNFQDvUAcrKgIB0iE0qgNNzGgtmfgq+dvcu5+uFY0FLev8s7SZWCVcMf
> UUwGe+UldfDo9w5g2vo89jMFvG+SIA7Pmk3ZsSvt1NzQCAYABRsb4MXUwNJ8
> k/S8ZgtNr1GcDeTSH+C+SqOdGS4i+AXVr3+r01Jw+9CbIWerI9aFZ8iBifUf
> Amhz0DCqFe4m4ZHNp1HSaGaHtc1DZYiqaRggQ73FeIfGnyheNllJXx9hlJJF
> ioLHk84XoiRn4KgdATF6XXIi1lk7zp0KyvyIxpGX958Q8qqPc5AbVDg3Q8OY
> f0yb
> =w3HG
> -----END PGP SIGNATURE-----
>
>


-- 
Zuzendari Teknikoa / Director T?cnico
Binovo IT Human Project, S.L.
Telf. 943575997
       943493611
Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
www.binovo.es



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux