>First of all - the cluster itself is nowhere near being filled (about >55% data is used), but the osds don't get filled equally. the most important things is why your data filled unequally。 I think maybe your pg_num do not set correctly. can you paste the output of :ceph osd dump|grep '^pool’ PS:in my opinion,adjust reweigh of osd is a temporary way.and stop the full osd isn't a good way,it may cause a data recovery. find why data distribution unequally —> solve it if it is configuration error —> if the cluster is stop write data,adjust mon_osd_full_ratio,os_backfill_full_ratio,maybe including reweight to let cluster rebalancing. -- hnuzhoulin2@xxxxxxxxx 在 2016年3月24日 19:54:39, Jacek Jarosiewicz (jjarosiewicz@xxxxxxxxxxxxx) 写到: > disk usage on the full osd is as below. What are the *_TEMP directories > for? How can I make sure which pg directories are safe to remove? > > [root@cf04 current]# du -hs * > 156G 0.14_head > 156G 0.21_head > 155G 0.32_head > 157G 0.3a_head > 155G 0.e_head > 156G 0.f_head > 40K 10.2_head > 4.0K 11.3_head > 218G 14.13_head > 218G 14.15_head > 218G 14.1b_head > 219G 14.1f_head > 9.1G 14.29_head > 219G 14.2a_head > 75G 14.2d_head > 125G 14.2e_head > 113G 14.32_head > 163G 14.33_head > 218G 14.35_head > 151G 14.39_head > 218G 14.3b_head > 103G 14.3d_head > 217G 14.3f_head > 219G 14.a_head > 773M 17.0_head > 814M 17.10_head > 4.0K 17.10_TEMP > 747M 17.19_head > 4.0K 17.19_TEMP > 669M 17.1b_head > 659M 17.1c_head > 638M 17.1f_head > 681M 17.30_head > 4.0K 17.30_TEMP > 721M 17.34_head > 695M 17.3d_head > 726M 17.3e_head > 734M 17.3f_head > 4.0K 17.3f_TEMP > 670M 17.d_head > 597M 17.e_head > 4.0K 17.e_TEMP > 4.0K 1.7_head > 34M 5.1_head > 34M 5.6_head > 4.0K 9.6_head > 4.0K commit_op_seq > 30M meta > 0 nosnap > 614M omap > > > > On 03/24/2016 10:11 AM, Jacek Jarosiewicz wrote: > > Hi! > > > > I have a problem with the osds getting full on our cluster. > > > > -- > Jacek Jarosiewicz > Administrator Systemów Informatycznych > > ---------------------------------------------------------------------------------------- > SUPERMEDIA Sp. z o.o. z siedzibą w Warszawie > ul. Senatorska 13/15, 00-075 Warszawa > Sąd Rejonowy dla m.st.Warszawy, XII Wydział Gospodarczy Krajowego > Rejestru Sądowego, > nr KRS 0000029537; kapitał zakładowy 44.556.000,00 zł > NIP: 957-05-49-503 > Adres korespondencyjny: ul. Jubilerska 10, 04-190 Warszawa > > ---------------------------------------------------------------------------------------- > SUPERMEDIA -> http://www.supermedia.pl > dostep do internetu - hosting - kolokacja - lacza - telefonia > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |