Hi folks, some volumes in my ceph cluster have problem and I can NOT delete it by rbd command. When i show info or try to delete it, rbd comand crash.
Command i used:# rbd -p volumes info volume-e110b0a5-5116-46f2-99c7-84bb546f15c2
# rbd -p volumes rm volume-e110b0a5-5116-46f2-99c7-84bb546f15c2
I attach crash-dump log in this email, pls help me investigate it.
root@ceph-mon-02:~# rbd -p volumes info volume-e110b0a5-5116-46f2-99c7-84bb546f15c2 [331/331]
2014-11-07 18:53:28.075090 7fa78f90d780 -1 librbd::ImageCtx: error reading immutable metadata: (2) No such file or directory
2014-11-07 18:53:28.075397 7fa78f90d780 -1 librbd: error opening parent image: (2) No such file or directory
./log/SubsystemMap.h: In function 'bool ceph::log::SubsystemMap::should_gather(unsigned int, int)' thread 7fa78f90d780 time 2014-11-07 18:53:28.
075425
./log/SubsystemMap.h: 62: FAILED assert(sub < m_subsys.size())
ceph version 0.87-6-gdba7def (dba7defc623474ad17263c9fccfec60fe7a439f0)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f) [0x7fa78c9f39ff]
2: (()+0x2eca0) [0x7fa78edf8ca0]
3: (()+0x36679) [0x7fa78ee00679]
4: (librbd::close_image(librbd::ImageCtx*)+0x36) [0x7fa78ee13146]
5: (librbd::open_parent(librbd::ImageCtx*)+0x663) [0x7fa78ee1a7f3]
6: (librbd::refresh_parent(librbd::ImageCtx*)+0x138) [0x7fa78ee1aca8]
7: (librbd::ictx_refresh(librbd::ImageCtx*)+0xa41) [0x7fa78ee0e361]
8: (librbd::open_image(librbd::ImageCtx*)+0x1a4) [0x7fa78ee19fc4]
9: (librbd::RBD::open_read_only(librados::IoCtx&, librbd::Image&, char const*, char const*)+0x8a) [0x7fa78edf989a]
10: (main()+0x14b3) [0x40e0b3]
11: (__libc_start_main()+0xed) [0x7fa78bad276d]
12: rbd() [0x413d49]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-11-07 18:53:28.076481 7fa78f90d780 -1 ./log/SubsystemMap.h: In function 'bool ceph::log::SubsystemMap::should_gather(unsigned int, int)' th
read 7fa78f90d780 time 2014-11-07 18:53:28.075425
./log/SubsystemMap.h: 62: FAILED assert(sub < m_subsys.size())
ceph version 0.87-6-gdba7def (dba7defc623474ad17263c9fccfec60fe7a439f0)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f) [0x7fa78c9f39ff]
2: (()+0x2eca0) [0x7fa78edf8ca0]
3: (()+0x36679) [0x7fa78ee00679]
4: (librbd::close_image(librbd::ImageCtx*)+0x36) [0x7fa78ee13146]
5: (librbd::open_parent(librbd::ImageCtx*)+0x663) [0x7fa78ee1a7f3]
6: (librbd::refresh_parent(librbd::ImageCtx*)+0x138) [0x7fa78ee1aca8]
7: (librbd::ictx_refresh(librbd::ImageCtx*)+0xa41) [0x7fa78ee0e361]
8: (librbd::open_image(librbd::ImageCtx*)+0x1a4) [0x7fa78ee19fc4]
9: (librbd::RBD::open_read_only(librados::IoCtx&, librbd::Image&, char const*, char const*)+0x8a) [0x7fa78edf989a]
10: (main()+0x14b3) [0x40e0b3]
11: (__libc_start_main()+0xed) [0x7fa78bad276d]
12: rbd() [0x413d49]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- begin dump of recent events ---
-82> 2014-11-07 18:53:27.989029 7fa78f90d780 5 asok(0x23d6c60) register_command perfcounters_dump hook 0x23d8af0
-81> 2014-11-07 18:53:27.989059 7fa78f90d780 5 asok(0x23d6c60) register_command 1 hook 0x23d8af0
-80> 2014-11-07 18:53:27.989063 7fa78f90d780 5 asok(0x23d6c60) register_command perf dump hook 0x23d8af0
-79> 2014-11-07 18:53:27.989069 7fa78f90d780 5 asok(0x23d6c60) register_command perfcounters_schema hook 0x23d8af0
-78> 2014-11-07 18:53:27.989074 7fa78f90d780 5 asok(0x23d6c60) register_command 2 hook 0x23d8af0
-77> 2014-11-07 18:53:27.989082 7fa78f90d780 5 asok(0x23d6c60) register_command perf schema hook 0x23d8af0
-76> 2014-11-07 18:53:27.989092 7fa78f90d780 5 asok(0x23d6c60) register_command config show hook 0x23d8af0
-75> 2014-11-07 18:53:27.989095 7fa78f90d780 5 asok(0x23d6c60) register_command config set hook 0x23d8af0
-74> 2014-11-07 18:53:27.989102 7fa78f90d780 5 asok(0x23d6c60) register_command config get hook 0x23d8af0
-73> 2014-11-07 18:53:27.989107 7fa78f90d780 5 asok(0x23d6c60) register_command config diff hook 0x23d8af0
-72> 2014-11-07 18:53:27.989110 7fa78f90d780 5 asok(0x23d6c60) register_command log flush hook 0x23d8af0
-71> 2014-11-07 18:53:27.989116 7fa78f90d780 5 asok(0x23d6c60) register_command log dump hook 0x23d8af0
-70> 2014-11-07 18:53:27.989120 7fa78f90d780 5 asok(0x23d6c60) register_command log reopen hook 0x23d8af0
-69> 2014-11-07 18:53:27.995981 7fa78f90d780 10 monclient(hunting): build_initial_monmap
-68> 2014-11-07 18:53:27.996113 7fa78f90d780 1 librados: starting msgr at :/0
-67> 2014-11-07 18:53:27.996121 7fa78f90d780 1 librados: starting objecter
-66> 2014-11-07 18:53:27.996189 7fa78f90d780 5 asok(0x23d6c60) register_command objecter_requests hook 0x2404300
-65> 2014-11-07 18:53:27.996256 7fa78f90d780 1 -- :/0 messenger.start
-64> 2014-11-07 18:53:27.996335 7fa78f90d780 1 librados: setting wanted keys
-63> 2014-11-07 18:53:27.996338 7fa78f90d780 1 librados: calling monclient init
-62> 2014-11-07 18:53:27.996339 7fa78f90d780 10 monclient(hunting): init
-61> 2014-11-07 18:53:27.996343 7fa78f90d780 5 adding auth protocol: cephx
-60> 2014-11-07 18:53:27.996349 7fa78f90d780 10 monclient(hunting): auth_supported 2 method cephx
-59> 2014-11-07 18:53:27.996477 7fa78f90d780 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-58> 2014-11-07 18:53:27.996568 7fa78f90d780 10 monclient(hunting): _reopen_session rank -1 name
-57> 2014-11-07 18:53:27.996607 7fa78f90d780 10 monclient(hunting): picked mon.a con 0x2409270 addr 172.30.5.201:6789/0
-56> 2014-11-07 18:53:27.996631 7fa78f90d780 10 monclient(hunting): _send_mon_message to mon.a at 172.30.5.201:6789/0
-55> 2014-11-07 18:53:27.996635 7fa78f90d780 1 -- :/1014641 --> 172.30.5.201:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x2409590 co
n 0x2409270
-54> 2014-11-07 18:53:27.996646 7fa78f90d780 10 monclient(hunting): renew_subs
-53> 2014-11-07 18:53:27.996649 7fa78f90d780 10 monclient(hunting): authenticate will time out at 2014-11-07 18:58:27.996649
-52> 2014-11-07 18:53:27.997225 7fa78f905700 1 -- 172.30.5.202:0/1014641 learned my addr 172.30.5.202:0/1014641
-51> 2014-11-07 18:53:28.045772 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 1 ==== mon_map magic: 0 v1 ==== 473+0
+0 (529329527 0 0) 0x7fa778000bd0 con 0x2409270
-50> 2014-11-07 18:53:28.045827 7fa7884c1700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-49> 2014-11-07 18:53:28.045846 7fa7884c1700 10 monclient(hunting): got monmap 1, mon.a is now rank 0
-48> 2014-11-07 18:53:28.045872 7fa7884c1700 10 monclient(hunting): dump:
epoch 1
fsid ad1bff62-a261-4330-a826-c77ecc0aef88
last_changed 2013-07-20 10:37:49.223588
created 2013-07-20 10:37:49.223588
0: 172.30.5.201:6789/0 mon.a
1: 172.30.5.202:6789/0 mon.b
2: 172.30.5.203:6789/0 mon.c
-47> 2014-11-07 18:53:28.045990 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 2 ==== auth_reply(proto 2 0 (0) Succe
ss) v1 ==== 33+0+0 (3039365740 0 0) 0x7fa7780010d0 con 0x2409270
-46> 2014-11-07 18:53:28.046032 7fa7884c1700 10 monclient(hunting): my global_id is 14624589
-45> 2014-11-07 18:53:28.046189 7fa7884c1700 10 monclient(hunting): _send_mon_message to mon.a at 172.30.5.201:6789/0
-44> 2014-11-07 18:53:28.046200 7fa7884c1700 1 -- 172.30.5.202:0/1014641 --> 172.30.5.201:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0
0x7fa77c0015c0 con 0x2409270
-43> 2014-11-07 18:53:28.047003 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 3 ==== auth_reply(proto 2 0 (0) Succe
ss) v1 ==== 206+0+0 (1374442048 0 0) 0x7fa7780010d0 con 0x2409270
-42> 2014-11-07 18:53:28.047151 7fa7884c1700 10 monclient(hunting): _send_mon_message to mon.a at 172.30.5.201:6789/0
-41> 2014-11-07 18:53:28.047163 7fa7884c1700 1 -- 172.30.5.202:0/1014641 --> 172.30.5.201:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+
0 0x7fa77c0037b0 con 0x2409270
-40> 2014-11-07 18:53:28.048308 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 4 ==== auth_reply(proto 2 0 (0) Succe
ss) v1 ==== 393+0+0 (243434801 0 0) 0x7fa7780008c0 con 0x2409270
-39> 2014-11-07 18:53:28.048421 7fa7884c1700 1 monclient(hunting): found mon.a
-38> 2014-11-07 18:53:28.048427 7fa7884c1700 10 monclient: _send_mon_message to mon.a at 172.30.5.201:6789/0
-37> 2014-11-07 18:53:28.048433 7fa7884c1700 1 -- 172.30.5.202:0/1014641 --> 172.30.5.201:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x2
409b10 con 0x2409270
-36> 2014-11-07 18:53:28.048515 7fa78f90d780 5 monclient: authenticate success, global_id 14624589
-35> 2014-11-07 18:53:28.048572 7fa78f90d780 10 monclient: renew_subs
-34> 2014-11-07 18:53:28.048577 7fa78f90d780 10 monclient: _send_mon_message to mon.a at 172.30.5.201:6789/0
-33> 2014-11-07 18:53:28.048585 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.201:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -
- ?+0 0x2409b10 con 0x2409270
-32> 2014-11-07 18:53:28.048654 7fa78f90d780 10 monclient: renew_subs
-31> 2014-11-07 18:53:28.048662 7fa78f90d780 10 monclient: _send_mon_message to mon.a at 172.30.5.201:6789/0
-30> 2014-11-07 18:53:28.048667 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.201:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -
- ?+0 0x2409590 con 0x2409270
-29> 2014-11-07 18:53:28.048720 7fa78f90d780 1 librados: init done
-28> 2014-11-07 18:53:28.049362 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 5 ==== mon_map magic: 0 v1 ==== 473+0
+0 (529329527 0 0) 0x7fa7780013e0 con 0x2409270
-27> 2014-11-07 18:53:28.049389 7fa7884c1700 10 monclient: handle_monmap mon_map magic: 0 v1
-26> 2014-11-07 18:53:28.049400 7fa7884c1700 10 monclient: got monmap 1, mon.a is now rank 0
-25> 2014-11-07 18:53:28.049404 7fa7884c1700 10 monclient: dump:
epoch 1
fsid ad1bff62-a261-4330-a826-c77ecc0aef88
last_changed 2013-07-20 10:37:49.223588
created 2013-07-20 10:37:49.223588
0: 172.30.5.201:6789/0 mon.a
1: 172.30.5.202:6789/0 mon.b
2: 172.30.5.203:6789/0 mon.c
-24> 2014-11-07 18:53:28.049446 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 6 ==== mon_subscribe_ack(300s) v1 ===
= 20+0+0 (1127781482 0 0) 0x7fa778001690 con 0x2409270
-23> 2014-11-07 18:53:28.049456 7fa7884c1700 10 monclient: handle_subscribe_ack sent 2014-11-07 18:53:27.996648 renew after 2014-11-07 18:55:
57.996648
-22> 2014-11-07 18:53:28.053390 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 7 ==== osd_map(107891..107891 src has
104696..107891) v3 ==== 94983+0+0 (4159756214 0 0) 0x7fa7780008c0 con 0x2409270
-21> 2014-11-07 18:53:28.054176 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 8 ==== mon_subscribe_ack(300s) v1 ===
= 20+0+0 (1127781482 0 0) 0x7fa778018720 con 0x2409270
-20> 2014-11-07 18:53:28.054198 7fa7884c1700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring
-19> 2014-11-07 18:53:28.054413 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.9:6809/5470 -- osd_op(client.14624589.0:1 volume-e110b
0a5-5116-46f2-99c7-84bb546f15c2.rbd [stat] 6.483695ad ack+read+known_if_redirected e107891) v4 -- ?+0 0x240b690 con 0x240b340
-18> 2014-11-07 18:53:28.056325 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 9 ==== osd_map(107891..107891 src has
104696..107891) v3 ==== 94983+0+0 (4159756214 0 0) 0x7fa7780008c0 con 0x2409270
-17> 2014-11-07 18:53:28.056392 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== mon.0 172.30.5.201:6789/0 10 ==== mon_subscribe_ack(300s) v1 ==
== 20+0+0 (1127781482 0 0) 0x7fa778001360 con 0x2409270
-16> 2014-11-07 18:53:28.056410 7fa7884c1700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring
-15> 2014-11-07 18:53:28.057444 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.120 172.30.5.9:6809/5470 1 ==== osd_op_reply(1 volume-e110b
0a5-5116-46f2-99c7-84bb546f15c2.rbd [stat] v0'0 uv0 ack = -2 ((2) No such file or directory)) v6 ==== 214+0+0 (2636296231 0 0) 0x7fa768000ac0 co
n 0x240b340
-14> 2014-11-07 18:53:28.057713 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.8:6826/2576 -- osd_op(client.14624589.0:2 rbd_id.volum
e-e110b0a5-5116-46f2-99c7-84bb546f15c2 [stat] 6.f07a48d1 ack+read+known_if_redirected e107891) v4 -- ?+0 0x240ee50 con 0x240eb00
-13> 2014-11-07 18:53:28.061188 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.104 172.30.5.8:6826/2576 1 ==== osd_op_reply(2 rbd_id.volum
e-e110b0a5-5116-46f2-99c7-84bb546f15c2 [stat] v0'0 uv350832 ondisk = 0) v6 ==== 217+0+16 (1227454565 0 1081342870) 0x7fa760000c40 con 0x240eb00
-12> 2014-11-07 18:53:28.061332 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.8:6826/2576 -- osd_op(client.14624589.0:3 rbd_id.volum
e-e110b0a5-5116-46f2-99c7-84bb546f15c2 [call rbd.get_id] 6.f07a48d1 ack+read+known_if_redirected e107891) v4 -- ?+0 0x240f340 con 0x240eb00
-11> 2014-11-07 18:53:28.063049 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.104 172.30.5.8:6826/2576 2 ==== osd_op_reply(3 rbd_id.volum
e-e110b0a5-5116-46f2-99c7-84bb546f15c2 [call] v0'0 uv350832 ondisk = 0) v6 ==== 217+0+18 (1459056198 0 4049412885) 0x7fa760000c40 con 0x240eb00
-10> 2014-11-07 18:53:28.063302 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.2:6801/26681 -- osd_op(client.14624589.0:4 rbd_header.
1eafb74b4cf40a [call rbd.get_size,call rbd.get_object_prefix] 6.e05afa74 ack+read+known_if_redirected e107891) v4 -- ?+0 0x24137b0 con 0x2413420
-9> 2014-11-07 18:53:28.067548 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.25 172.30.5.2:6801/26681 1 ==== osd_op_reply(4 rbd_header.1
eafb74b4cf40a [call,call] v0'0 uv1432237 ondisk = 0) v6 ==== 234+0+36 (3543297591 0 2052571780) 0x7fa758000c60 con 0x2413420
-8> 2014-11-07 18:53:28.067665 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.2:6801/26681 -- osd_op(client.14624589.0:5 rbd_header.
1eafb74b4cf40a [call rbd.get_stripe_unit_count] 6.e05afa74 ack+read+known_if_redirected e107891) v4 -- ?+0 0x24137b0 con 0x2413420
-7> 2014-11-07 18:53:28.069050 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.25 172.30.5.2:6801/26681 2 ==== osd_op_reply(5 rbd_header.1
eafb74b4cf40a [call] v0'0 uv0 ondisk = -8 ((8) Exec format error)) v6 ==== 192+0+0 (1561599827 0 0) 0x7fa758000c60 con 0x2413420
-6> 2014-11-07 18:53:28.069282 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.2:6801/26681 -- osd_op(client.14624589.0:6 rbd_header.
1eafb74b4cf40a [call rbd.get_size,call rbd.get_features,call rbd.get_snapcontext,call rbd.get_parent,call lock.get_info] 6.e05afa74 ack+read+kno
wn_if_redirected e107891) v4 -- ?+0 0x2415b80 con 0x2413420
-5> 2014-11-07 18:53:28.071591 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.25 172.30.5.2:6801/26681 3 ==== osd_op_reply(6 rbd_header.1
eafb74b4cf40a [call,call,call,call,call] v0'0 uv1432237 ondisk = 0) v6 ==== 360+0+94 (4140093860 0 32210181) 0x7fa7580017c0 con 0x2413420
-4> 2014-11-07 18:53:28.071871 7fa78f90d780 1 -- 172.30.5.202:0/1014641 --> 172.30.5.7:6811/19216 -- osd_op(client.14624589.0:7 rbd_header.
392dc32ae8944a [call rbd.get_size,call rbd.get_object_prefix] 6.7bac3f4c ack+read+known_if_redirected e107891) v4 -- ?+0 0x2417830 con 0x24174e0
-3> 2014-11-07 18:53:28.074989 7fa7884c1700 1 -- 172.30.5.202:0/1014641 <== osd.88 172.30.5.7:6811/19216 1 ==== osd_op_reply(7 rbd_header.3
92dc32ae8944a [call,call] v0'0 uv0 ack = -2 ((2) No such file or directory)) v6 ==== 234+0+0 (347836844 0 0) 0x7fa750000ae0 con 0x24174e0
-2> 2014-11-07 18:53:28.075090 7fa78f90d780 -1 librbd::ImageCtx: error reading immutable metadata: (2) No such file or directory
-1> 2014-11-07 18:53:28.075397 7fa78f90d780 -1 librbd: error opening parent image: (2) No such file or directory
0> 2014-11-07 18:53:28.076481 7fa78f90d780 -1 ./log/SubsystemMap.h: In function 'bool ceph::log::SubsystemMap::should_gather(unsigned int,
int)' thread 7fa78f90d780 time 2014-11-07 18:53:28.075425
./log/SubsystemMap.h: 62: FAILED assert(sub < m_subsys.size())
ceph version 0.87-6-gdba7def (dba7defc623474ad17263c9fccfec60fe7a439f0)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f) [0x7fa78c9f39ff]
2: (()+0x2eca0) [0x7fa78edf8ca0]
3: (()+0x36679) [0x7fa78ee00679]
4: (librbd::close_image(librbd::ImageCtx*)+0x36) [0x7fa78ee13146]
5: (librbd::open_parent(librbd::ImageCtx*)+0x663) [0x7fa78ee1a7f3]
6: (librbd::refresh_parent(librbd::ImageCtx*)+0x138) [0x7fa78ee1aca8]
7: (librbd::ictx_refresh(librbd::ImageCtx*)+0xa41) [0x7fa78ee0e361]
8: (librbd::open_image(librbd::ImageCtx*)+0x1a4) [0x7fa78ee19fc4]
9: (librbd::RBD::open_read_only(librados::IoCtx&, librbd::Image&, char const*, char const*)+0x8a) [0x7fa78edf989a]
10: (main()+0x14b3) [0x40e0b3]
11: (__libc_start_main()+0xed) [0x7fa78bad276d]
12: rbd() [0x413d49]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file
--- end dump of recent events ---
terminate called after throwing an instance of 'ceph::FailedAssertion'
*** Caught signal (Aborted) **
in thread 7fa78f90d780
ceph version 0.87-6-gdba7def (dba7defc623474ad17263c9fccfec60fe7a439f0)
1: rbd() [0x421ae5]
2: (()+0xfcb0) [0x7fa78c59acb0]
3: (gsignal()+0x35) [0x7fa78bae70d5]
4: (abort()+0x17b) [0x7fa78baea83b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fa78c13d69d]
6: (()+0xb5846) [0x7fa78c13b846]
7: (()+0xb5873) [0x7fa78c13b873]
8: (()+0xb596e) [0x7fa78c13b96e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x259) [0x7fa78c9f3bd9]
10: (()+0x2eca0) [0x7fa78edf8ca0]
11: (()+0x36679) [0x7fa78ee00679]
12: (librbd::close_image(librbd::ImageCtx*)+0x36) [0x7fa78ee13146]
13: (librbd::open_parent(librbd::ImageCtx*)+0x663) [0x7fa78ee1a7f3]
14: (librbd::refresh_parent(librbd::ImageCtx*)+0x138) [0x7fa78ee1aca8]
15: (librbd::ictx_refresh(librbd::ImageCtx*)+0xa41) [0x7fa78ee0e361]
16: (librbd::open_image(librbd::ImageCtx*)+0x1a4) [0x7fa78ee19fc4]
17: (librbd::RBD::open_read_only(librados::IoCtx&, librbd::Image&, char const*, char const*)+0x8a) [0x7fa78edf989a]
18: (main()+0x14b3) [0x40e0b3]
19: (__libc_start_main()+0xed) [0x7fa78bad276d]
20: rbd() [0x413d49]
2014-11-07 18:53:28.083180 7fa78f90d780 -1 *** Caught signal (Aborted) **
in thread 7fa78f90d780
ceph version 0.87-6-gdba7def (dba7defc623474ad17263c9fccfec60fe7a439f0)
1: rbd() [0x421ae5]
2: (()+0xfcb0) [0x7fa78c59acb0]
3: (gsignal()+0x35) [0x7fa78bae70d5]
4: (abort()+0x17b) [0x7fa78baea83b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fa78c13d69d]
6: (()+0xb5846) [0x7fa78c13b846]
7: (()+0xb5873) [0x7fa78c13b873]
8: (()+0xb596e) [0x7fa78c13b96e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x259) [0x7fa78c9f3bd9]
10: (()+0x2eca0) [0x7fa78edf8ca0]
11: (()+0x36679) [0x7fa78ee00679]
12: (librbd::close_image(librbd::ImageCtx*)+0x36) [0x7fa78ee13146]
13: (librbd::open_parent(librbd::ImageCtx*)+0x663) [0x7fa78ee1a7f3]
14: (librbd::refresh_parent(librbd::ImageCtx*)+0x138) [0x7fa78ee1aca8]
15: (librbd::ictx_refresh(librbd::ImageCtx*)+0xa41) [0x7fa78ee0e361]
16: (librbd::open_image(librbd::ImageCtx*)+0x1a4) [0x7fa78ee19fc4]
17: (librbd::RBD::open_read_only(librados::IoCtx&, librbd::Image&, char const*, char const*)+0x8a) [0x7fa78edf989a]
18: (main()+0x14b3) [0x40e0b3]
19: (__libc_start_main()+0xed) [0x7fa78bad276d]
20: rbd() [0x413d49]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- begin dump of recent events ---
0> 2014-11-07 18:53:28.083180 7fa78f90d780 -1 *** Caught signal (Aborted) **
in thread 7fa78f90d780
ceph version 0.87-6-gdba7def (dba7defc623474ad17263c9fccfec60fe7a439f0)
1: rbd() [0x421ae5]
2: (()+0xfcb0) [0x7fa78c59acb0]
3: (gsignal()+0x35) [0x7fa78bae70d5]
4: (abort()+0x17b) [0x7fa78baea83b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fa78c13d69d]
6: (()+0xb5846) [0x7fa78c13b846]
7: (()+0xb5873) [0x7fa78c13b873]
8: (()+0xb596e) [0x7fa78c13b96e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x259) [0x7fa78c9f3bd9]
10: (()+0x2eca0) [0x7fa78edf8ca0]
11: (()+0x36679) [0x7fa78ee00679]
12: (librbd::close_image(librbd::ImageCtx*)+0x36) [0x7fa78ee13146]
13: (librbd::open_parent(librbd::ImageCtx*)+0x663) [0x7fa78ee1a7f3]
14: (librbd::refresh_parent(librbd::ImageCtx*)+0x138) [0x7fa78ee1aca8]
15: (librbd::ictx_refresh(librbd::ImageCtx*)+0xa41) [0x7fa78ee0e361]
16: (librbd::open_image(librbd::ImageCtx*)+0x1a4) [0x7fa78ee19fc4]
17: (librbd::RBD::open_read_only(librados::IoCtx&, librbd::Image&, char const*, char const*)+0x8a) [0x7fa78edf989a]
18: (main()+0x14b3) [0x40e0b3]
19: (__libc_start_main()+0xed) [0x7fa78bad276d]
20: rbd() [0x413d49]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file
--- end dump of recent events ---
Aborted
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
