Hi sage, I have run the repair command, and the warning info disappears in the output of "ceph health detail", but the replicas isn't recovered in the "current" directory. In all, the ceph cluster status can recover (the pg's status recover from inconsistent to active and clean), but not the replica. I am sorry for not provide enough info I found in the ceph cluster. Thanks & Regards Li JiaMin -----邮件原件----- 发件人: Sage Weil [mailto:sage@xxxxxxxxxxx] 发送时间: 2014年3月24日 9:36 收件人: ljm李嘉敏 抄送: Kyle Bader; ceph-users@xxxxxxxxxxxxxx 主题: Re: 答复: why object can't be recovered when delete one replica When you do ceph pg scrub <pgid> it will notice the missing object (you should see it go by with ceph -w or the message in /var/log/ceph/ceph.log on a monitor node), and the PG will get an 'inconsistent' flag set. To trigger repair, you need to do ceph pg repair <pgid> sage On Mon, 24 Mar 2014, ljm李嘉敏 wrote: > Hi Kyle， > > Thank you very much for your explanation, I have triggered the > relative pg to scrub, but the secondary replica which I remove manually isn't recovered, it only shows that instructing pg xx.xxx on osd.x to scrub. > > PS: I use the ceph-deploy to deploy the ceph cluster, and the ceph.conf is the default configuration. > > Thanks & Regards > Li JiaMin > > -----邮件原件----- > 发件人: Kyle Bader [mailto:kyle.bader@xxxxxxxxx] > 发送时间: 2014年3月23日 10:05 > 收件人: ljm李嘉敏 > 抄送: ceph-users@xxxxxxxxxxxxxx > 主题: Re: why object can't be recovered when delete one > replica > > > I upload a file through swift API, then delete it in the “current” > > directory in the secondary OSD manually, why the object can’t be recovered? > > > > If I delete it in the primary OSD, the object is deleted directly in > > the pool .rgw.bucket and it can’t be recovered from the secondary OSD. > > > > Do anyone know this behavior? > > This is because the placement group containing that object likely needs to scrub (just a light scrub should do). The scrub will compare the two replicas, notice the replica is missing from the secondary and trigger recovery/backfill. Can you try scrubbing the placement group containing the removed object and let us know if it triggers recovery? > > -- > > Kyle > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |