"Numerical argument out of domain" error occurs during rbd export-diff | rbd import-diff

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello together,

I got an error message during execution of the following command line:
# rbd create backup/one-71-242-2 --object-size 32M --stripe-unit 4194304 --stripe-count 8 -s 1 # create an empty image
# rbd export-diff --no-progress --whole-object one_ssd/one-71-242-2@backup-20170206-0829 - | rbd import-diff - backup/one-71-242-2

The second command throws an error message (the full dump is shown at the end):
rbd: import-diff failed: (33) Numerical argument out of domain

Our cluster runs Ceph 10.2.5 on CentOS 7.3. The volumes were created by OpenNebula 5.2.1. The backup snapshot was created by myself.

Please have a look at the outputs of "ls -l" of boths pools:
# rbd ls -l backup | grep one-71
one-71-242-2                                256G                       2 
# rbd ls -l one_ssd | grep one-71
one-71                                     1024M                       2           
one-71@snap                                1024M                       2 yes       
one-71-242-2                                256G one_ssd/one-71@snap   2      excl 
one-71-242-2@backup-20170206-0829           256G one_ssd/one-71@snap   2 

I assume that the reason for the error message could be that the volume size of one-71@snap and its child one-71-242-2 is different.
I come to that assumption because volumes where child and parent have the same size work correctly.

Is it allowed to have a child that is larger than its parent?
If yes - why does that "export-diff | import-diff" thing doesn't work in that case - might this be a bug?

I really hope that someone in here can solve my problem.

Many thanks in advance

Bernhard J. M. Grün


Please have a look at the full dump of the error message:
terminate called after throwing an instance of 'ceph::buffer::end_of_buffer'
  what():  buffer::end_of_buffer
*** Caught signal (Aborted) **
 in thread 7f8e9ed3fd80 thread_name:rbd
 ceph version 10.2.5 (c461ee19ecbc0c5c330aca20f7392c9a00730367)
 1: (()+0x207bca) [0x557e3c567bca]
 2: (()+0xf370) [0x7f8e8b306370]
 3: (gsignal()+0x37) [0x7f8e893521d7]
 4: (abort()+0x148) [0x7f8e893538c8]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f8e89c569d5]
 6: (()+0x5e946) [0x7f8e89c54946]
 7: (()+0x5e973) [0x7f8e89c54973]
 8: (()+0x5eb93) [0x7f8e89c54b93]
 9: (()+0x1bb5ab) [0x7f8e953b25ab]
 10: (()+0x96017) [0x7f8e9528d017]
 11: (()+0x94f33) [0x7f8e9528bf33]
 12: (()+0x95910) [0x7f8e9528c910]
 13: (()+0xc6d83) [0x7f8e952bdd83]
 14: (librbd::Image::diff_iterate2(char const*, unsigned long, unsigned long, bool, bool, int (*)(unsigned long, unsigned long, int, void*), void*)+0x72) [0x7f8e952582d2]
 15: (rbd::action::export_diff::execute(boost::program_options::variables_map const&)+0x5ec) [0x557e3c4d1fec]
 16: (rbd::Shell::execute(std::vector<char const*, std::allocator<char const*> > const&)+0x87d) [0x557e3c4b188d]
 17: (main()+0x72) [0x557e3c480ab2]
 18: (__libc_start_main()+0xf5) [0x7f8e8933eb35]
 19: (()+0x13a9e9) [0x557e3c49a9e9]
2017-02-06 11:03:23.899821 7f8e9ed3fd80 -1 *** Caught signal (Aborted) **
 in thread 7f8e9ed3fd80 thread_name:rbd

 ceph version 10.2.5 (c461ee19ecbc0c5c330aca20f7392c9a00730367)
 1: (()+0x207bca) [0x557e3c567bca]
 2: (()+0xf370) [0x7f8e8b306370]
 3: (gsignal()+0x37) [0x7f8e893521d7]
 4: (abort()+0x148) [0x7f8e893538c8]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f8e89c569d5]
 6: (()+0x5e946) [0x7f8e89c54946]
 7: (()+0x5e973) [0x7f8e89c54973]
 8: (()+0x5eb93) [0x7f8e89c54b93]
 9: (()+0x1bb5ab) [0x7f8e953b25ab]
 10: (()+0x96017) [0x7f8e9528d017]
 11: (()+0x94f33) [0x7f8e9528bf33]
 12: (()+0x95910) [0x7f8e9528c910]
 13: (()+0xc6d83) [0x7f8e952bdd83]
 14: (librbd::Image::diff_iterate2(char const*, unsigned long, unsigned long, bool, bool, int (*)(unsigned long, unsigned long, int, void*), void*)+0x72) [0x7f8e952582d2]
 15: (rbd::action::export_diff::execute(boost::program_options::variables_map const&)+0x5ec) [0x557e3c4d1fec]
 16: (rbd::Shell::execute(std::vector<char const*, std::allocator<char const*> > const&)+0x87d) [0x557e3c4b188d]
 17: (main()+0x72) [0x557e3c480ab2]
 18: (__libc_start_main()+0xf5) [0x7f8e8933eb35]
 19: (()+0x13a9e9) [0x557e3c49a9e9]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
  -145> 2017-02-06 11:03:23.757730 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command perfcounters_dump hook 0x557e46911510
  -144> 2017-02-06 11:03:23.757739 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command 1 hook 0x557e46911510
  -143> 2017-02-06 11:03:23.757743 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command perf dump hook 0x557e46911510
  -142> 2017-02-06 11:03:23.757757 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command perfcounters_schema hook 0x557e46911510
  -141> 2017-02-06 11:03:23.757765 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command 2 hook 0x557e46911510
  -140> 2017-02-06 11:03:23.757772 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command perf schema hook 0x557e46911510
  -139> 2017-02-06 11:03:23.757778 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command perf reset hook 0x557e46911510
  -138> 2017-02-06 11:03:23.757783 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command config show hook 0x557e46911510
  -137> 2017-02-06 11:03:23.757788 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command config set hook 0x557e46911510
  -136> 2017-02-06 11:03:23.757793 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command config get hook 0x557e46911510
  -135> 2017-02-06 11:03:23.757798 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command config diff hook 0x557e46911510
  -134> 2017-02-06 11:03:23.757805 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command log flush hook 0x557e46911510
  -133> 2017-02-06 11:03:23.757810 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command log dump hook 0x557e46911510
  -132> 2017-02-06 11:03:23.757814 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command log reopen hook 0x557e46911510
  -131> 2017-02-06 11:03:23.799295 7f8e9ed3fd80  5 asok(0x557e4690c760) init /var/run/ceph/rbd-client-3024846.asok
  -130> 2017-02-06 11:03:23.799323 7f8e9ed3fd80  5 asok(0x557e4690c760) bind_and_listen /var/run/ceph/rbd-client-3024846.asok
  -129> 2017-02-06 11:03:23.799472 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command 0 hook 0x557e46965770
  -128> 2017-02-06 11:03:23.799489 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command version hook 0x557e46965770
  -127> 2017-02-06 11:03:23.799500 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command git_version hook 0x557e46965770
  -126> 2017-02-06 11:03:23.799510 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command help hook 0x557e46917b10
  -125> 2017-02-06 11:03:23.799519 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command get_command_descriptions hook 0x557e469665b0
  -124> 2017-02-06 11:03:23.799704 7f8e9ed3fd80 10 monclient(hunting): build_initial_monmap
  -123> 2017-02-06 11:03:23.799712 7f8e838d2700  5 asok(0x557e4690c760) entry start
  -122> 2017-02-06 11:03:23.799775 7f8e9ed3fd80  1 librados: starting msgr at :/0
  -121> 2017-02-06 11:03:23.799785 7f8e9ed3fd80  1 librados: starting objecter
  -120> 2017-02-06 11:03:23.799869 7f8e9ed3fd80  5 asok(0x557e4690c760) register_command objecter_requests hook 0x557e469659e0
  -119> 2017-02-06 11:03:23.799978 7f8e9ed3fd80  1 -- :/0 messenger.start
  -118> 2017-02-06 11:03:23.800022 7f8e9ed3fd80  1 librados: setting wanted keys
  -117> 2017-02-06 11:03:23.800030 7f8e9ed3fd80  1 librados: calling monclient init
  -116> 2017-02-06 11:03:23.800037 7f8e9ed3fd80 10 monclient(hunting): init
  -115> 2017-02-06 11:03:23.800050 7f8e9ed3fd80  5 adding auth protocol: cephx
  -114> 2017-02-06 11:03:23.800060 7f8e9ed3fd80 10 monclient(hunting): auth_supported 2 method cephx
  -113> 2017-02-06 11:03:23.800239 7f8e9ed3fd80  2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
  -112> 2017-02-06 11:03:23.800320 7f8e9ed3fd80 10 monclient(hunting): _reopen_session rank -1 name 
  -111> 2017-02-06 11:03:23.800379 7f8e9ed3fd80 10 monclient(hunting): picked mon.noname-b con 0x557e4696e530 addr 172.21.65.2:6789/0
  -110> 2017-02-06 11:03:23.800400 7f8e9ed3fd80 10 monclient(hunting): _send_mon_message to mon.noname-b at 172.21.65.2:6789/0
  -109> 2017-02-06 11:03:23.800409 7f8e9ed3fd80  1 -- :/190112429 --> 172.21.65.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x557e46972300 con 0x557e4696e530
  -108> 2017-02-06 11:03:23.800425 7f8e9ed3fd80 10 monclient(hunting): renew_subs
  -107> 2017-02-06 11:03:23.800433 7f8e9ed3fd80 10 monclient(hunting): authenticate will time out at 2017-02-06 11:08:23.800432
  -106> 2017-02-06 11:03:23.801289 7f8e9ed37700  1 -- 172.21.65.1:0/190112429 learned my addr 172.21.65.1:0/190112429
  -105> 2017-02-06 11:03:23.801909 7f8e73fff700  2 -- 172.21.65.1:0/190112429 >> 172.21.65.2:6789/0 pipe(0x557e4696d270 sd=6 :40852 s=2 pgs=1925625 cs=1 l=1 c=0x557e4696e530).reader got KEEPALIVE_ACK
  -104> 2017-02-06 11:03:23.802343 7f8e828d0700  1 -- 172.21.65.1:0/190112429 <== mon.1 172.21.65.2:6789/0 1 ==== mon_map magic: 0 v1 ==== 485+0+0 (1435797232 0 0) 0x7f8e6c000cf0 con 0x557e4696e530
  -103> 2017-02-06 11:03:23.802361 7f8e828d0700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
  -102> 2017-02-06 11:03:23.802373 7f8e828d0700 10 monclient(hunting):  got monmap 7, mon.noname-b is now rank -1
  -101> 2017-02-06 11:03:23.802375 7f8e828d0700 10 monclient(hunting): dump:
epoch 7
fsid c3a5b21e-e6e0-407d-9e2f-d059b7e6054d
last_changed 2016-06-22 16:03:15.584307
created 0.000000
0: 172.21.65.1:6789/0 mon.ose01
1: 172.21.65.2:6789/0 mon.ose02
2: 172.21.65.3:6789/0 mon.ose03

  -100> 2017-02-06 11:03:23.802392 7f8e828d0700  1 -- 172.21.65.1:0/190112429 <== mon.1 172.21.65.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2659275662 0 0) 0x7f8e6c0011b0 con 0x557e4696e530
   -99> 2017-02-06 11:03:23.802418 7f8e828d0700 10 monclient(hunting): my global_id is 35091814
   -98> 2017-02-06 11:03:23.802479 7f8e828d0700 10 monclient(hunting): _send_mon_message to mon.ose02 at 172.21.65.2:6789/0
   -97> 2017-02-06 11:03:23.802486 7f8e828d0700  1 -- 172.21.65.1:0/190112429 --> 172.21.65.2:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0 0x7f8e78001740 con 0x557e4696e530
   -96> 2017-02-06 11:03:23.803176 7f8e828d0700  1 -- 172.21.65.1:0/190112429 <== mon.1 172.21.65.2:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4016940263 0 0) 0x7f8e6c0011b0 con 0x557e4696e530
   -95> 2017-02-06 11:03:23.803264 7f8e828d0700 10 monclient(hunting): _send_mon_message to mon.ose02 at 172.21.65.2:6789/0
   -94> 2017-02-06 11:03:23.803268 7f8e828d0700  1 -- 172.21.65.1:0/190112429 --> 172.21.65.2:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+0 0x7f8e78001bc0 con 0x557e4696e530
   -93> 2017-02-06 11:03:23.804022 7f8e828d0700  1 -- 172.21.65.1:0/190112429 <== mon.1 172.21.65.2:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 393+0+0 (3362220796 0 0) 0x7f8e6c000a30 con 0x557e4696e530
   -92> 2017-02-06 11:03:23.804150 7f8e828d0700  1 monclient(hunting): found mon.ose02
   -91> 2017-02-06 11:03:23.804155 7f8e828d0700 10 monclient: _send_mon_message to mon.ose02 at 172.21.65.2:6789/0
   -90> 2017-02-06 11:03:23.804160 7f8e828d0700  1 -- 172.21.65.1:0/190112429 --> 172.21.65.2:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x557e46973640 con 0x557e4696e530
   -89> 2017-02-06 11:03:23.804214 7f8e9ed3fd80  5 monclient: authenticate success, global_id 35091814
   -88> 2017-02-06 11:03:23.804248 7f8e9ed3fd80 10 monclient: renew_subs
   -87> 2017-02-06 11:03:23.804253 7f8e9ed3fd80 10 monclient: _send_mon_message to mon.ose02 at 172.21.65.2:6789/0
   -86> 2017-02-06 11:03:23.804262 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.65.2:6789/0 -- mon_subscribe({osdmap=0}) v2 -- ?+0 0x557e46973640 con 0x557e4696e530
   -85> 2017-02-06 11:03:23.804318 7f8e9ed3fd80 10 monclient: renew_subs - empty
   -84> 2017-02-06 11:03:23.804357 7f8e9ed3fd80  1 librados: init done
   -83> 2017-02-06 11:03:23.805124 7f8e828d0700  1 -- 172.21.65.1:0/190112429 <== mon.1 172.21.65.2:6789/0 5 ==== mon_map magic: 0 v1 ==== 485+0+0 (1435797232 0 0) 0x7f8e6c0014d0 con 0x557e4696e530
   -82> 2017-02-06 11:03:23.805140 7f8e828d0700 10 monclient: handle_monmap mon_map magic: 0 v1
   -81> 2017-02-06 11:03:23.805154 7f8e828d0700 10 monclient:  got monmap 7, mon.ose02 is now rank 1
   -80> 2017-02-06 11:03:23.805158 7f8e828d0700 10 monclient: dump:
epoch 7
fsid c3a5b21e-e6e0-407d-9e2f-d059b7e6054d
last_changed 2016-06-22 16:03:15.584307
created 0.000000
0: 172.21.65.1:6789/0 mon.ose01
1: 172.21.65.2:6789/0 mon.ose02
2: 172.21.65.3:6789/0 mon.ose03

   -79> 2017-02-06 11:03:23.805179 7f8e828d0700  1 -- 172.21.65.1:0/190112429 <== mon.1 172.21.65.2:6789/0 6 ==== osd_map(27766..27766 src has 27266..27766) v3 ==== 65769+0+0 (168325178 0 0) 0x7f8e6c0117e0 con 0x557e4696e530
   -78> 2017-02-06 11:03:23.805893 7f8e9ed3fd80  5 librbd::AioImageRequestWQ: 0x557e469752f0 : ictx=0x557e46972c10
   -77> 2017-02-06 11:03:23.806094 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:1 32.77c0ed87 rbd_id.one-71-242-2 [stat] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46979260 con 0x557e46977d10
   -76> 2017-02-06 11:03:23.807863 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 1 ==== osd_op_reply(1 rbd_id.one-71-242-2 [stat] v0'0 uv285915 _ondisk_ = 0) v7 ==== 139+0+16 (1337240616 0 2390466895) 0x7f8e5c000b50 con 0x557e46977d10
   -75> 2017-02-06 11:03:23.807972 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:2 32.77c0ed87 rbd_id.one-71-242-2 [call rbd.get_id] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60002040 con 0x557e46977d10
   -74> 2017-02-06 11:03:23.808723 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 2 ==== osd_op_reply(2 rbd_id.one-71-242-2 [call] v0'0 uv285915 _ondisk_ = 0) v7 ==== 139+0+18 (1929283202 0 3593870133) 0x7f8e5c000b50 con 0x557e46977d10
   -73> 2017-02-06 11:03:23.808827 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:3 32.51093944 rbd_header.ed8ed82eb141f2 [call rbd.get_size,call rbd.get_object_prefix] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60004720 con 0x557e46977d10
   -72> 2017-02-06 11:03:23.809916 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 3 ==== osd_op_reply(3 rbd_header.ed8ed82eb141f2 [call,call] v0'0 uv407888 _ondisk_ = 0) v7 ==== 187+0+36 (2929487975 0 2264900370) 0x7f8e5c0015e0 con 0x557e46977d10
   -71> 2017-02-06 11:03:23.810186 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:4 32.51093944 rbd_header.ed8ed82eb141f2 [call rbd.get_stripe_unit_count] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60002700 con 0x557e46977d10
   -70> 2017-02-06 11:03:23.810977 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 4 ==== osd_op_reply(4 rbd_header.ed8ed82eb141f2 [call] v0'0 uv0 _ondisk_ = -8 ((8) Exec format error)) v7 ==== 145+0+0 (1608767793 0 0) 0x7f8e5c000b50 con 0x557e46977d10
   -69> 2017-02-06 11:03:23.811086 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:5 32.51093944 rbd_header.ed8ed82eb141f2 [call rbd.metadata_list] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60001fc0 con 0x557e46977d10
   -68> 2017-02-06 11:03:23.811732 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 5 ==== osd_op_reply(5 rbd_header.ed8ed82eb141f2 [call] v0'0 uv407888 _ondisk_ = 0) v7 ==== 145+0+4 (3405215210 0 0) 0x7f8e5c000b50 con 0x557e46977d10
   -67> 2017-02-06 11:03:23.811952 7f8e736fd700  5 asok(0x557e4690c760) register_command rbd cache flush one_ssd/one-71-242-2 hook 0x7f8e600023e0
   -66> 2017-02-06 11:03:23.811968 7f8e736fd700  5 asok(0x557e4690c760) register_command rbd cache invalidate one_ssd/one-71-242-2 hook 0x7f8e600023e0
   -65> 2017-02-06 11:03:23.812158 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:6 32.51093944 rbd_header.ed8ed82eb141f2 [call rbd.get_size,call rbd.get_features,call rbd.get_snapcontext,call rbd.get_parent,call lock.get_info] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60003480 con 0x557e46977d10
   -64> 2017-02-06 11:03:23.813558 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 6 ==== osd_op_reply(6 rbd_header.ed8ed82eb141f2 [call,call,call,call,call] v0'0 uv407888 _ondisk_ = 0) v7 ==== 313+0+407 (2497506489 0 174525283) 0x7f8e5c001de0 con 0x557e46977d10
   -63> 2017-02-06 11:03:23.813790 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:7 32.51093944 rbd_header.ed8ed82eb141f2 [call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60001060 con 0x557e46977d10
   -62> 2017-02-06 11:03:23.815507 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 7 ==== osd_op_reply(7 rbd_header.ed8ed82eb141f2 [call,call,call,call,call,call,call,call,call,call,call,call,call,call,call] v0'0 uv407888 _ondisk_ = 0) v7 ==== 733+0+120 (3529476298 0 0) 0x7f8e5c001f30 con 0x557e46977d10
   -61> 2017-02-06 11:03:23.816007 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:8 32.51093944 rbd_header.ed8ed82eb141f2 [call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60029460 con 0x557e46977d10
   -60> 2017-02-06 11:03:23.821589 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 8 ==== osd_op_reply(8 rbd_header.ed8ed82eb141f2 [call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call,call] v0'0 uv407888 _ondisk_ = 0) v7 ==== 2455+0+1064 (3210192285 0 4040199148) 0x7f8e5c002a70 con 0x557e46977d10
   -59> 2017-02-06 11:03:23.821764 7f8e736fd700  5 librbd::AioImageRequestWQ: 0x7f8e60003b10 : ictx=0x7f8e60025040
   -58> 2017-02-06 11:03:23.821858 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.4:6801/1802 -- osd_op(client.35091814.0:9 32.30a98c1c rbd_directory [call rbd.dir_get_name] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e60029050 con 0x7f8e60028ae0
   -57> 2017-02-06 11:03:23.824582 7f8e713f6700  1 -- 172.21.65.1:0/190112429 <== osd.24 172.21.64.4:6801/1802 1 ==== osd_op_reply(9 rbd_directory [call] v0'0 uv393036 _ondisk_ = 0) v7 ==== 133+0+10 (447862770 0 1689180814) 0x7f8e58000b40 con 0x7f8e60028ae0
   -56> 2017-02-06 11:03:23.825395 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:10 32.7b9a3496 rbd_header.ed8df73d1b58ba [call rbd.get_size,call rbd.get_object_prefix] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e6000b340 con 0x7f8e60029260
   -55> 2017-02-06 11:03:23.828296 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 1 ==== osd_op_reply(10 rbd_header.ed8df73d1b58ba [call,call] v0'0 uv287316 _ondisk_ = 0) v7 ==== 187+0+36 (1313425072 0 2180769045) 0x7f8e50000b90 con 0x7f8e60029260
   -54> 2017-02-06 11:03:23.828402 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:11 32.7b9a3496 rbd_header.ed8df73d1b58ba [call rbd.get_stripe_unit_count] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e6000b340 con 0x7f8e60029260
   -53> 2017-02-06 11:03:23.829178 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 2 ==== osd_op_reply(11 rbd_header.ed8df73d1b58ba [call] v0'0 uv0 _ondisk_ = -8 ((8) Exec format error)) v7 ==== 145+0+0 (2669338456 0 0) 0x7f8e50000b90 con 0x7f8e60029260
   -52> 2017-02-06 11:03:23.829287 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:12 32.7b9a3496 rbd_header.ed8df73d1b58ba [call rbd.metadata_list] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e6000d8d0 con 0x7f8e60029260
   -51> 2017-02-06 11:03:23.829872 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 3 ==== osd_op_reply(12 rbd_header.ed8df73d1b58ba [call] v0'0 uv287316 _ondisk_ = 0) v7 ==== 145+0+4 (554899329 0 0) 0x7f8e50000b90 con 0x7f8e60029260
   -50> 2017-02-06 11:03:23.830072 7f8e736fd700  5 asok(0x557e4690c760) register_command rbd cache flush one_ssd/one-71 hook 0x7f8e60001230
   -49> 2017-02-06 11:03:23.830087 7f8e736fd700  5 asok(0x557e4690c760) register_command rbd cache invalidate one_ssd/one-71 hook 0x7f8e60001230
   -48> 2017-02-06 11:03:23.830269 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:13 32.7b9a3496 rbd_header.ed8df73d1b58ba [call rbd.get_size,call rbd.get_features,call rbd.get_snapcontext,call rbd.get_parent,call lock.get_info] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e6000d420 con 0x7f8e60029260
   -47> 2017-02-06 11:03:23.831538 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 4 ==== osd_op_reply(13 rbd_header.ed8df73d1b58ba [call,call,call,call,call] v0'0 uv287316 _ondisk_ = 0) v7 ==== 313+0+96 (57106587 0 2547946546) 0x7f8e50000b90 con 0x7f8e60029260
   -46> 2017-02-06 11:03:23.831660 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:14 32.7b9a3496 rbd_header.ed8df73d1b58ba [call rbd.get_flags,call rbd.get_flags] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e6000d420 con 0x7f8e60029260
   -45> 2017-02-06 11:03:23.832472 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 5 ==== osd_op_reply(14 rbd_header.ed8df73d1b58ba [call,call] v0'0 uv287316 _ondisk_ = 0) v7 ==== 187+0+16 (3054283575 0 0) 0x7f8e50000b90 con 0x7f8e60029260
   -44> 2017-02-06 11:03:23.832595 7f8e736fd700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:15 32.7b9a3496 rbd_header.ed8df73d1b58ba [call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e6000d420 con 0x7f8e60029260
   -43> 2017-02-06 11:03:23.833754 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 6 ==== osd_op_reply(15 rbd_header.ed8df73d1b58ba [call,call,call,call] v0'0 uv287316 _ondisk_ = 0) v7 ==== 271+0+46 (261674289 0 2611169876) 0x7f8e50000b90 con 0x7f8e60029260
   -42> 2017-02-06 11:03:23.833928 7f8e72efc700  5 librbd::AioImageRequestWQ: block_writes: 0x7f8e60025040, num=1
   -41> 2017-02-06 11:03:23.834072 7f8e72efc700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.7:6800/1807 -- osd_op(client.35091814.0:16 32.b03dfd23 rbd_object_map.ed8df73d1b58ba.000000000000030a [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e64005740 con 0x7f8e640041c0
   -40> 2017-02-06 11:03:23.836111 7f8e4befe700  1 -- 172.21.65.1:0/190112429 <== osd.30 172.21.64.7:6800/1807 1 ==== osd_op_reply(16 rbd_object_map.ed8df73d1b58ba.000000000000030a [call] v0'0 uv324043 _ondisk_ = 0) v7 ==== 166+0+86 (4202350621 0 1106831654) 0x7f8e3c000ba0 con 0x7f8e640041c0
   -39> 2017-02-06 11:03:23.836198 7f8e736fd700  5 librbd::AioImageRequestWQ: unblock_writes: 0x7f8e60025040, num=0
   -38> 2017-02-06 11:03:23.836279 7f8e9ed3fd80  5 librbd::AioImageRequestWQ: block_writes: 0x557e46972c10, num=1
   -37> 2017-02-06 11:03:23.836386 7f8e72efc700  1 -- 172.21.65.1:0/190112429 --> 172.21.64.4:6800/1806 -- osd_op(client.35091814.0:17 32.8d8bece8 rbd_object_map.ed8ed82eb141f2.00000000000008c0 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x7f8e64009e00 con 0x7f8e640089a0
   -36> 2017-02-06 11:03:23.838119 7f8e4bcfc700  1 -- 172.21.65.1:0/190112429 <== osd.25 172.21.64.4:6800/1806 1 ==== osd_op_reply(17 rbd_object_map.ed8ed82eb141f2.00000000000008c0 [call] v0'0 uv544595 _ondisk_ = 0) v7 ==== 166+0+16406 (3354187100 0 69417572) 0x7f8e34000c70 con 0x7f8e640089a0
   -35> 2017-02-06 11:03:23.838183 7f8e736fd700  5 librbd::AioImageRequestWQ: unblock_writes: 0x557e46972c10, num=0
   -34> 2017-02-06 11:03:23.838286 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.4:6800/1806 -- osd_op(client.35091814.0:18 32.5328d145 rbd_object_map.ed8ed82eb141f2.0000000000000487 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e4697a8a0 con 0x7f8e640089a0
   -33> 2017-02-06 11:03:23.839013 7f8e4bcfc700  1 -- 172.21.65.1:0/190112429 <== osd.25 172.21.64.4:6800/1806 2 ==== osd_op_reply(18 rbd_object_map.ed8ed82eb141f2.0000000000000487 [call] v0'0 uv370000 _ondisk_ = 0) v7 ==== 166+0+16406 (4198135652 0 2308955940) 0x7f8e34000c70 con 0x7f8e640089a0
   -32> 2017-02-06 11:03:23.845699 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.7:6801/1804 -- osd_op(client.35091814.0:19 32.6737e650 rbd_object_map.ed8ed82eb141f2.00000000000004f6 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46981dd0 con 0x557e469808c0
   -31> 2017-02-06 11:03:23.847703 7f8e4bafa700  1 -- 172.21.65.1:0/190112429 <== osd.31 172.21.64.7:6801/1804 1 ==== osd_op_reply(19 rbd_object_map.ed8ed82eb141f2.00000000000004f6 [call] v0'0 uv404010 _ondisk_ = 0) v7 ==== 166+0+16406 (2590378551 0 37434965) 0x7f8e2c000c70 con 0x557e469808c0
   -30> 2017-02-06 11:03:23.851327 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:20 32.176502bd rbd_object_map.ed8ed82eb141f2.000000000000053a [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46981ec0 con 0x7f8e60029260
   -29> 2017-02-06 11:03:23.852160 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 7 ==== osd_op_reply(20 rbd_object_map.ed8ed82eb141f2.000000000000053a [call] v0'0 uv359772 _ondisk_ = 0) v7 ==== 166+0+16406 (3036234060 0 553002438) 0x7f8e50002270 con 0x7f8e60029260
   -28> 2017-02-06 11:03:23.854806 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.8:6801/1800 -- osd_op(client.35091814.0:21 32.1eea62ba rbd_object_map.ed8ed82eb141f2.0000000000000595 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e469857d0 con 0x557e46979340
   -27> 2017-02-06 11:03:23.856690 7f8e4b8f8700  1 -- 172.21.65.1:0/190112429 <== osd.33 172.21.64.8:6801/1800 1 ==== osd_op_reply(21 rbd_object_map.ed8ed82eb141f2.0000000000000595 [call] v0'0 uv344028 _ondisk_ = 0) v7 ==== 166+0+16406 (3380603426 0 2113928645) 0x7f8e24000c70 con 0x557e46979340
   -26> 2017-02-06 11:03:23.859596 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.4:6800/1806 -- osd_op(client.35091814.0:22 32.947d35e5 rbd_object_map.ed8ed82eb141f2.00000000000005f2 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e469860e0 con 0x7f8e640089a0
   -25> 2017-02-06 11:03:23.860413 7f8e4bcfc700  1 -- 172.21.65.1:0/190112429 <== osd.25 172.21.64.4:6800/1806 3 ==== osd_op_reply(22 rbd_object_map.ed8ed82eb141f2.00000000000005f2 [call] v0'0 uv357406 _ondisk_ = 0) v7 ==== 166+0+16406 (87037524 0 509653243) 0x7f8e34000c70 con 0x7f8e640089a0
   -24> 2017-02-06 11:03:23.863046 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.8:6800/1803 -- osd_op(client.35091814.0:23 32.211174a4 rbd_object_map.ed8ed82eb141f2.0000000000000616 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46989360 con 0x557e469859e0
   -23> 2017-02-06 11:03:23.864990 7f8e4b6f6700  1 -- 172.21.65.1:0/190112429 <== osd.32 172.21.64.8:6800/1803 1 ==== osd_op_reply(23 rbd_object_map.ed8ed82eb141f2.0000000000000616 [call] v0'0 uv412508 _ondisk_ = 0) v7 ==== 166+0+16406 (1436515654 0 3585550870) 0x7f8e1c000c70 con 0x557e469859e0
   -22> 2017-02-06 11:03:23.868401 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.8:6800/1803 -- osd_op(client.35091814.0:24 32.ccf5b7f6 rbd_object_map.ed8ed82eb141f2.000000000000069d [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46989b10 con 0x557e469859e0
   -21> 2017-02-06 11:03:23.869300 7f8e4b6f6700  1 -- 172.21.65.1:0/190112429 <== osd.32 172.21.64.8:6800/1803 2 ==== osd_op_reply(24 rbd_object_map.ed8ed82eb141f2.000000000000069d [call] v0'0 uv593096 _ondisk_ = 0) v7 ==== 166+0+16406 (1961873630 0 3534980034) 0x7f8e1c005800 con 0x557e469859e0
   -20> 2017-02-06 11:03:23.871870 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:25 32.20ad0573 rbd_object_map.ed8ed82eb141f2.000000000000072d [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46989b10 con 0x7f8e60029260
   -19> 2017-02-06 11:03:23.872688 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 8 ==== osd_op_reply(25 rbd_object_map.ed8ed82eb141f2.000000000000072d [call] v0'0 uv393111 _ondisk_ = 0) v7 ==== 166+0+16406 (3501220571 0 317976655) 0x7f8e50002a60 con 0x7f8e60029260
   -18> 2017-02-06 11:03:23.876203 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6801/2475 -- osd_op(client.35091814.0:26 32.199323bd rbd_object_map.ed8ed82eb141f2.00000000000007c4 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46989b10 con 0x7f8e60029260
   -17> 2017-02-06 11:03:23.877025 7f8e711f4700  1 -- 172.21.65.1:0/190112429 <== osd.29 172.21.64.6:6801/2475 9 ==== osd_op_reply(26 rbd_object_map.ed8ed82eb141f2.00000000000007c4 [call] v0'0 uv513867 _ondisk_ = 0) v7 ==== 166+0+16406 (1697814196 0 1720041406) 0x7f8e50002a60 con 0x7f8e60029260
   -16> 2017-02-06 11:03:23.879467 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.3:6802/4095 -- osd_op(client.35091814.0:27 32.a0143dd rbd_object_map.ed8ed82eb141f2.0000000000000822 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46989b10 con 0x557e46977d10
   -15> 2017-02-06 11:03:23.880308 7f8e725fa700  1 -- 172.21.65.1:0/190112429 <== osd.22 172.21.64.3:6802/4095 9 ==== osd_op_reply(27 rbd_object_map.ed8ed82eb141f2.0000000000000822 [call] v0'0 uv360012 _ondisk_ = 0) v7 ==== 166+0+16406 (4150347141 0 1576531577) 0x7f8e5c0008c0 con 0x557e46977d10
   -14> 2017-02-06 11:03:23.882850 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.7:6801/1804 -- osd_op(client.35091814.0:28 32.f2f5a7cb rbd_object_map.ed8ed82eb141f2.0000000000000836 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e46989b10 con 0x557e469808c0
   -13> 2017-02-06 11:03:23.883690 7f8e4bafa700  1 -- 172.21.65.1:0/190112429 <== osd.31 172.21.64.7:6801/1804 2 ==== osd_op_reply(28 rbd_object_map.ed8ed82eb141f2.0000000000000836 [call] v0'0 uv423588 _ondisk_ = 0) v7 ==== 166+0+16406 (2497921964 0 3149556466) 0x7f8e2c005820 con 0x557e469808c0
   -12> 2017-02-06 11:03:23.886194 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.6:6800/2470 -- osd_op(client.35091814.0:29 32.a765dbb3 rbd_object_map.ed8ed82eb141f2.000000000000084a [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e4698dfa0 con 0x557e4697a8a0
   -11> 2017-02-06 11:03:23.887979 7f8e4b4f4700  1 -- 172.21.65.1:0/190112429 <== osd.28 172.21.64.6:6800/2470 1 ==== osd_op_reply(29 rbd_object_map.ed8ed82eb141f2.000000000000084a [call] v0'0 uv392190 _ondisk_ = 0) v7 ==== 166+0+16406 (787230570 0 4229771760) 0x7f8e14000c70 con 0x557e4697a8a0
   -10> 2017-02-06 11:03:23.890480 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.4:6800/1806 -- osd_op(client.35091814.0:30 32.75e697c1 rbd_object_map.ed8ed82eb141f2.000000000000085e [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e4698e6b0 con 0x7f8e640089a0
    -9> 2017-02-06 11:03:23.891169 7f8e4bcfc700  1 -- 172.21.65.1:0/190112429 <== osd.25 172.21.64.4:6800/1806 4 ==== osd_op_reply(30 rbd_object_map.ed8ed82eb141f2.000000000000085e [call] v0'0 uv549500 _ondisk_ = 0) v7 ==== 166+0+16406 (1435006777 0 3488558166) 0x7f8e34000c70 con 0x7f8e640089a0
    -8> 2017-02-06 11:03:23.893707 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.4:6800/1806 -- osd_op(client.35091814.0:31 32.8d8bece8 rbd_object_map.ed8ed82eb141f2.00000000000008c0 [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e4698e6b0 con 0x7f8e640089a0
    -7> 2017-02-06 11:03:23.895089 7f8e4bcfc700  1 -- 172.21.65.1:0/190112429 <== osd.25 172.21.64.4:6800/1806 5 ==== osd_op_reply(31 rbd_object_map.ed8ed82eb141f2.00000000000008c0 [call] v0'0 uv544595 _ondisk_ = 0) v7 ==== 166+0+16406 (3354187100 0 69417572) 0x7f8e34000c70 con 0x7f8e640089a0
    -6> 2017-02-06 11:03:23.897539 7f8e9ed3fd80  5 librbd::DiffIterate: fast diff enabled
    -5> 2017-02-06 11:03:23.897550 7f8e9ed3fd80  5 librbd::DiffIterate: diff_iterate from 0 to 2240 size from 0 to 274877906944
    -4> 2017-02-06 11:03:23.897598 7f8e9ed3fd80  1 -- 172.21.65.1:0/190112429 --> 172.21.64.7:6800/1807 -- osd_op(client.35091814.0:32 32.b03dfd23 rbd_object_map.ed8df73d1b58ba.000000000000030a [call rbd.object_map_load] snapc 0=[] ack+read+known_if_redirected e27766) v7 -- ?+0 0x557e4698f420 con 0x7f8e640041c0
    -3> 2017-02-06 11:03:23.898469 7f8e4befe700  1 -- 172.21.65.1:0/190112429 <== osd.30 172.21.64.7:6800/1807 2 ==== osd_op_reply(32 rbd_object_map.ed8df73d1b58ba.000000000000030a [call] v0'0 uv324043 _ondisk_ = 0) v7 ==== 166+0+86 (4202350621 0 1106831654) 0x7f8e3c000ba0 con 0x7f8e640041c0
    -2> 2017-02-06 11:03:23.898573 7f8e9ed3fd80  5 librbd::DiffIterate: fast diff enabled
    -1> 2017-02-06 11:03:23.898582 7f8e9ed3fd80  5 librbd::DiffIterate: diff_iterate from 0 to 778 size from 0 to 1073741824
     0> 2017-02-06 11:03:23.899821 7f8e9ed3fd80 -1 *** Caught signal (Aborted) **
 in thread 7f8e9ed3fd80 thread_name:rbd

 ceph version 10.2.5 (c461ee19ecbc0c5c330aca20f7392c9a00730367)
 1: (()+0x207bca) [0x557e3c567bca]
 2: (()+0xf370) [0x7f8e8b306370]
 3: (gsignal()+0x37) [0x7f8e893521d7]
 4: (abort()+0x148) [0x7f8e893538c8]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f8e89c569d5]
 6: (()+0x5e946) [0x7f8e89c54946]
 7: (()+0x5e973) [0x7f8e89c54973]
 8: (()+0x5eb93) [0x7f8e89c54b93]
 9: (()+0x1bb5ab) [0x7f8e953b25ab]
 10: (()+0x96017) [0x7f8e9528d017]
 11: (()+0x94f33) [0x7f8e9528bf33]
 12: (()+0x95910) [0x7f8e9528c910]
 13: (()+0xc6d83) [0x7f8e952bdd83]
 14: (librbd::Image::diff_iterate2(char const*, unsigned long, unsigned long, bool, bool, int (*)(unsigned long, unsigned long, int, void*), void*)+0x72) [0x7f8e952582d2]
 15: (rbd::action::export_diff::execute(boost::program_options::variables_map const&)+0x5ec) [0x557e3c4d1fec]
 16: (rbd::Shell::execute(std::vector<char const*, std::allocator<char const*> > const&)+0x87d) [0x557e3c4b188d]
 17: (main()+0x72) [0x557e3c480ab2]
 18: (__libc_start_main()+0xf5) [0x7f8e8933eb35]
 19: (()+0x13a9e9) [0x557e3c49a9e9]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
   0/ 5 none
   0/ 1 lockdep
   0/ 1 context
   1/ 1 crush
   1/ 5 mds
   1/ 5 mds_balancer
   1/ 5 mds_locker
   1/ 5 mds_log
   1/ 5 mds_log_expire
   1/ 5 mds_migrator
   0/ 1 buffer
   0/ 1 timer
   0/ 1 filer
   0/ 1 striper
   0/ 1 objecter
   0/ 5 rados
   0/ 5 rbd
   0/ 5 rbd_mirror
   0/ 5 rbd_replay
   0/ 5 journaler
   0/ 5 objectcacher
   0/ 5 client
   0/ 5 osd
   0/ 5 optracker
   0/ 5 objclass
   1/ 3 filestore
   1/ 3 journal
   0/ 5 ms
   1/ 5 mon
   0/10 monc
   1/ 5 paxos
   0/ 5 tp
   1/ 5 auth
   1/ 5 crypto
   1/ 1 finisher
   1/ 5 heartbeatmap
   1/ 5 perfcounter
   1/ 5 rgw
   1/10 civetweb
   1/ 5 javaclient
   1/ 5 asok
   1/ 1 throttle
   0/ 0 refs
   1/ 5 xio
   1/ 5 compressor
   1/ 5 newstore
   1/ 5 bluestore
   1/ 5 bluefs
   1/ 3 bdev
   1/ 5 kstore
   4/ 5 rocksdb
   4/ 5 leveldb
   1/ 5 kinetic
   1/ 5 fuse
  -2/-2 (syslog threshold)
  99/99 (stderr threshold)
  max_recent       500
  max_new         1000
  log_file 
--- end dump of recent events ---
Importing image diff: 0% complete...failed.
--
Freundliche Grüße

Bernhard J. M. Grün, Püttlingen, Deutschland
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux