On Sat, Aug 5, 2017 at 1:21 AM, Marc Roos <M.Roos@xxxxxxxxxxxxxxxxx> wrote: > > I have got a placement group inconsistency, and saw some manual where > you can export and import this on another osd. But I am getting an > export error on every osd. > > What does this export_files error -5 actually mean? I thought 3 copies #define EIO 5 /* I/O error */ > should be enough to secure your data. > > >> PG_DAMAGED Possible data damage: 1 pg inconsistent >> pg 17.36 is active+clean+inconsistent, acting [9,0,12] > > >> 2017-08-04 05:39:51.534489 7f2f623d6700 -1 log_channel(cluster) log > [ERR] : 17.36 soid > 17:6ca1f70a:::rbd_data.1f114174b0dc51.0000000000000974:4: failed to pick > suitable object info >> 2017-08-04 05:41:12.715393 7f2f623d6700 -1 log_channel(cluster) log > [ERR] : 17.36 deep-scrub 3 errors >> 2017-08-04 15:21:12.445799 7f2f623d6700 -1 log_channel(cluster) log > [ERR] : 17.36 soid > 17:6ca1f70a:::rbd_data.1f114174b0dc51.0000000000000974:4: failed to pick > suitable object info >> 2017-08-04 15:22:35.646635 7f2f623d6700 -1 log_channel(cluster) log > [ERR] : 17.36 repair 3 errors, 0 fixed > > ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-12 --pgid 17.36 > --op export --file /tmp/recover.17.36 Can you run this command under strace like so? # strace -fvttyyTo /tmp/strace.out -s 1024 ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-12 --pgid 17.36 --op export --file /tmp/recover.17.36 Then see if you can find which syscall is returning EIO. # grep "= \-5" /tmp/strace.out > > ... > Read #17:6c9f811c:::rbd_data.1b42f52ae8944a.0000000000001a32:head# > Read #17:6ca035fc:::rbd_data.1fff61238e1f29.000000000000b31a:head# > Read #17:6ca0b4f8:::rbd_data.1fff61238e1f29.0000000000006fcc:head# > Read #17:6ca0ffbc:::rbd_data.1fff61238e1f29.000000000000a214:head# > Read #17:6ca10b29:::rbd_data.1fff61238e1f29.0000000000009923:head# > Read #17:6ca11ab9:::rbd_data.1fa8ef2ae8944a.00000000000011b4:head# > Read #17:6ca13bed:::rbd_data.1f114174b0dc51.00000000000002c6:head# > Read #17:6ca1a791:::rbd_data.1fff61238e1f29.000000000000f101:head# > Read #17:6ca1f70a:::rbd_data.1f114174b0dc51.0000000000000974:4# > export_files error -5 Running the command with "--debug" appended will give more output which may shed more light as well. > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Cheers, Brad _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |