Hi all, I used command 'ceph osd thrash ' command and after all osds are up and in, 3 pgs are in stale+down+peering state sudo ceph -s cluster 99ffc4a5-2811-4547-bd65-34c7d4c58758 health HEALTH_WARN 3 pgs down; 3 pgs peering; 3 pgs stale; 3 pgs stuck inactive; 3 pgs stuck stale; 3 pgs stuck unclean monmap e1: 3 mons at {rack2-ram-1=10.242.42.180:6789/0,rack2-ram-2=10.242.42.184:6789/0,rack2-ram-3=10.242.42.188:6789/0}, election epoch 2008, quorum 0,1,2 rack2-ram-1,rack2-ram-2,rack2-ram-3 osdmap e17031: 64 osds: 64 up, 64 in pgmap v76728: 2148 pgs, 2 pools, 4135 GB data, 1033 kobjects 12501 GB used, 10975 GB / 23476 GB avail 2145 active+clean 3 stale+down+peering sudo ceph health detail HEALTH_WARN 3 pgs down; 3 pgs peering; 3 pgs stale; 3 pgs stuck inactive; 3 pgs stuck stale; 3 pgs stuck unclean pg 0.4d is stuck inactive for 341048.948643, current state stale+down+peering, last acting [12,56,27] pg 0.49 is stuck inactive for 341048.948667, current state stale+down+peering, last acting [12,6,25] pg 0.1c is stuck inactive for 341048.949362, current state stale+down+peering, last acting [12,25,23] pg 0.4d is stuck unclean for 341048.948665, current state stale+down+peering, last acting [12,56,27] pg 0.49 is stuck unclean for 341048.948687, current state stale+down+peering, last acting [12,6,25] pg 0.1c is stuck unclean for 341048.949382, current state stale+down+peering, last acting [12,25,23] pg 0.4d is stuck stale for 339823.956929, current state stale+down+peering, last acting [12,56,27] pg 0.49 is stuck stale for 339823.956930, current state stale+down+peering, last acting [12,6,25] pg 0.1c is stuck stale for 339823.956925, current state stale+down+peering, last acting [12,25,23] Please, can anyone explain why pgs are in this state. Sahana Lokeshappa Test Development Engineer I SanDisk Corporation 3rd Floor, Bagmane Laurel, Bagmane Tech Park C V Raman nagar, Bangalore 560093 T: +918042422283 Sahana.Lokeshappa at SanDisk.com ________________________________ PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140922/9520c6f7/attachment.htm>