Re: mon db growing. over 500Gb

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

I also observed excessively growing mon DB in case of recovery. Luckily
we were able to solve it by exdending the mon db disk.

Without having the chance to re-check: The options nobackfill and
norecover might cause that behavior.It feelds like mon holds data that
cannot be flushed to an OSD.


rgds,

j.



On 11.03.21 10:47, Marc wrote:
> From what I have read here in the past, growing monitor db is related to not having pg's in  'clean active' state
>
>
>> -----Original Message-----
>> From: ricardo.re.azevedo@xxxxxxxxx <ricardo.re.azevedo@xxxxxxxxx>
>> Sent: 11 March 2021 00:59
>> To: ceph-users@xxxxxxx
>> Subject:  mon db growing. over 500Gb
>>
>> Hi all,
>>
>>
>>
>> I have a fairly pressing issue. I had a monitor fall out of quorum
>> because
>> it ran out of disk space during rebalancing from switching to upmap. I
>> noticed all my monitor store.db started taking up nearly all disk space
>> so I
>> set noout, nobackfill and norecover and shutdown all the monitor
>> daemons.
>> Each store.db was at:
>>
>>
>>
>> mon.a 89GB (the one that firt dropped out)
>>
>> mon.a 400GB
>>
>> mon.c 400GB
>>
>>
>> I tried setting mon_compact_on_start. This brought  mon.a down to 1GB.
>> Cool.
>> However, when I try it on the other monitors it increased the db size
>> ~1Gb/10s so I shut them down again.
>>
>> Any idea what is going on? Or how can I shrik back down the db?
>>
>>
>>
>> _______________________________________________
>> ceph-users mailing list -- ceph-users@xxxxxxx
>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
-- 
Andreas John
net-lab GmbH  |  Frankfurter Str. 99  |  63067 Offenbach
Geschaeftsfuehrer: Andreas John | AG Offenbach, HRB40832
Tel: +49 69 8570033-1 | Fax: -2 | http://www.net-lab.net

Facebook: https://www.facebook.com/netlabdotnet
Twitter: https://twitter.com/netlabdotnet
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux