Re: [URGENT] My CEPH cluster is dying (due to "incomplete" PG)

[Chu Duc Minh <chu.ducminh@xxxxxxxxx>]

I have no choice except re-create this PG:
# ceph pg force_create_pg 6.9d8

But it still stuck at creating:
# ceph pg dump | grep creating
dumped all in format plain
6.9d8   0       0       0       0       0       0       0       0       creating        2014-11-09 03:27:23.611838      0'0     0:0     []     -1       []      -1      0'0     0.000000        0'0     0.000000

Do you have any suggestion?

Thank you very much indeed!

On Sun, Nov 9, 2014 at 12:52 AM, Chu Duc Minh <chu.ducminh@xxxxxxxxx> wrote:

My ceph cluster have a pg in state "incomplete" and i can not query them any more.

# ceph pg 6.9d8 query (hang forever)

All my volumes may be lost data because of this PG.

# ceph pg dump_stuck inactive
ok
pg_stat objects mip     degr    misp    unf     bytes   log     disklog state   state_stamp     v       reported        up      up_primary     acting   acting_primary  last_scrub      scrub_stamp     last_deep_scrub deep_scrub_stamp
6.9d8   3073    0       0       0       0       12678708736     4865    4865    incomplete      2014-11-09 00:07:20.838531      109334'8040089 110376:1118      [88,43,32]      88      [88,43,32]      88      91654'7460936   2014-10-10 10:36:25.433016      81667'5815892   2014-08-29 09:44:14.012219

My folders .../current/6.9d8_head still have data in some OSDs (osd.43), how i can force CEPH to use data in osd.43 for this PG? I tried repair, mark lost osd, v.v...

But i can't help.

Can you give me some suggesstions. My data is dying :(

Thank you very much!

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com