osd won't start

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



hello
    one of my osd refuses to start, it wouldn't be a problem if it wouldn't have unreplicated data on it :(


when i launch it manually i got this trace

ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60)
 1: /usr/bin/ceph-osd() [0x99b742]
 2: (()+0xf030) [0x7f97e1a06030]
 3: (gsignal()+0x35) [0x7f97e0122475]
 4: (abort()+0x180) [0x7f97e01256f0]
 5: (_gnu_cxx::_verbose_terminate_handler()+0x11d) [0x7f97e097789d]
 6: (()+0x63996) [0x7f97e0975996]
 7: (()+0x639c3) [0x7f97e09759c3]
 8: (()+0x63bee) [0x7f97e0975bee]
 9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x127) [0xa5d9e7]
 10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x2c) [0xa2f84c]
 11: (OSDMap::decode(ceph::buffer::list&)+0x3e) [0xa3015e]
 12: (OSDService::try_get_map(unsigned int)+0x38b) [0x722a2b]
 13: (OSDService::get_map(unsigned int)+0x16) [0x77a206]
 14: (OSD::init()+0x15b2) [0x73bd82]
 15: (main()+0x238a) [0x6eaa1a]
 16: (__libc_start_main()+0xfd) [0x7f97e010eead]
 17: /usr/bin/ceph-osd() [0x6edd39]

i use GPT partitioned disks, /dev/sdb1 is journal (1024M size) the rest of the disk is OSD. formated as xfs
ceph version is emperor, running on amd64's debian wheezy

attached is the complete log


thanks!
-- 
1AE0 322E B8F7 4717 BDEA BF1D 44BB 1BA7 9F6C 6333
2014-03-25 18:29:23.677844 7f97e2276780  0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process ceph-osd, pid 65741
2014-03-25 18:29:23.683463 7f97e2276780  1 filestore(/var/lib/ceph/osd/ceph-3) mount detected xfs
2014-03-25 18:29:23.683467 7f97e2276780  1 filestore(/var/lib/ceph/osd/ceph-3)  disabling 'filestore replica fadvise' due to known issues with fadvise(DONTNEED) on xfs
2014-03-25 18:29:23.748068 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is supported and appears to work
2014-03-25 18:29:23.748085 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
2014-03-25 18:29:23.889524 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: syscall(SYS_syncfs, fd) fully supported
2014-03-25 18:29:23.990423 7f97e2276780  0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
2014-03-25 18:29:23.999776 7f97e2276780  0 journal  kernel version is 3.2.0
2014-03-25 18:29:23.999898 7f97e2276780  1 journal _open /dev/sdb1 fd 20: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
2014-03-25 18:29:24.002763 7f97e2276780  0 journal  kernel version is 3.2.0
2014-03-25 18:29:24.002885 7f97e2276780  1 journal _open /dev/sdb1 fd 20: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
2014-03-25 18:29:24.003379 7f97e2276780  1 journal close /dev/sdb1
2014-03-25 18:29:24.004299 7f97e2276780  2 osd.3 0 mounting /var/lib/ceph/osd/ceph-3 /dev/sdb1
2014-03-25 18:29:24.004343 7f97e2276780  1 filestore(/var/lib/ceph/osd/ceph-3) mount detected xfs
2014-03-25 18:29:24.073316 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is supported and appears to work
2014-03-25 18:29:24.073329 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
2014-03-25 18:29:24.264846 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: syscall(SYS_syncfs, fd) fully supported
2014-03-25 18:29:24.365600 7f97e2276780  0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
2014-03-25 18:29:24.372059 7f97e2276780  0 journal  kernel version is 3.2.0
2014-03-25 18:29:24.372163 7f97e2276780  1 journal _open /dev/sdb1 fd 21: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
2014-03-25 18:29:24.374885 7f97e2276780  0 journal  kernel version is 3.2.0
2014-03-25 18:29:24.375003 7f97e2276780  1 journal _open /dev/sdb1 fd 21: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
2014-03-25 18:29:24.375223 7f97e2276780  2 osd.3 0 boot
2014-03-25 18:29:24.375334 7f97e2276780 10 osd.3 0 read_superblock sb(783a2063-32c7-420e-b9cc-d0f8f837f89c osd.3 884cec29-b65e-4b17-af78-3cc3af071614 e1065 [502,1065] lci=[761,1065])
2014-03-25 18:29:24.375401 7f97e2276780 10 open_all_classes
2014-03-25 18:29:24.375456 7f97e2276780 10 open_all_classes found log
2014-03-25 18:29:24.375470 7f97e2276780 10 _get_class adding new class name log 0x305e028
2014-03-25 18:29:24.375473 7f97e2276780 10 _load_class log from /usr/lib/rados-classes/libcls_log.so
2014-03-25 18:29:24.375785 7f97e2276780 10 register_class log status 3
2014-03-25 18:29:24.375786 7f97e2276780 10 register_cxx_method log.add flags 3 0x7f97d410b4d0
2014-03-25 18:29:24.375792 7f97e2276780 10 register_cxx_method log.list flags 1 0x7f97d410c6a0
2014-03-25 18:29:24.375794 7f97e2276780 10 register_cxx_method log.trim flags 3 0x7f97d410bf40
2014-03-25 18:29:24.375795 7f97e2276780 10 register_cxx_method log.info flags 1 0x7f97d410b080
2014-03-25 18:29:24.375797 7f97e2276780 10 _load_class log success
2014-03-25 18:29:24.375799 7f97e2276780 10 open_all_classes found rbd
2014-03-25 18:29:24.375801 7f97e2276780 10 _get_class adding new class name rbd 0x305e108
2014-03-25 18:29:24.375803 7f97e2276780 10 _load_class rbd from /usr/lib/rados-classes/libcls_rbd.so
2014-03-25 18:29:24.376018 7f97e2276780 10 register_class rbd status 3
2014-03-25 18:29:24.376023 7f97e2276780 10 register_cxx_method rbd.create flags 3 0x7f97d3cf6670
2014-03-25 18:29:24.376026 7f97e2276780 10 register_cxx_method rbd.get_features flags 1 0x7f97d3cfb450
2014-03-25 18:29:24.376027 7f97e2276780 10 register_cxx_method rbd.get_size flags 1 0x7f97d3cfafe0
2014-03-25 18:29:24.376029 7f97e2276780 10 register_cxx_method rbd.set_size flags 3 0x7f97d3cf5fe0
2014-03-25 18:29:24.376030 7f97e2276780 10 register_cxx_method rbd.get_snapcontext flags 1 0x7f97d3cf74b0
2014-03-25 18:29:24.376032 7f97e2276780 10 register_cxx_method rbd.get_object_prefix flags 1 0x7f97d3cf33e0
2014-03-25 18:29:24.376035 7f97e2276780 10 register_cxx_method rbd.get_snapshot_name flags 1 0x7f97d3cfa180
2014-03-25 18:29:24.376037 7f97e2276780 10 register_cxx_method rbd.snapshot_add flags 3 0x7f97d3cfb7f0
2014-03-25 18:29:24.376039 7f97e2276780 10 register_cxx_method rbd.snapshot_remove flags 3 0x7f97d3cf9f60
2014-03-25 18:29:24.376040 7f97e2276780 10 register_cxx_method rbd.get_all_features flags 1 0x7f97d3cf1890
2014-03-25 18:29:24.376046 7f97e2276780 10 register_cxx_method rbd.copyup flags 3 0x7f97d3cf1810
2014-03-25 18:29:24.376047 7f97e2276780 10 register_cxx_method rbd.get_parent flags 1 0x7f97d3cfa390
2014-03-25 18:29:24.376049 7f97e2276780 10 register_cxx_method rbd.set_parent flags 3 0x7f97d3cf5950
2014-03-25 18:29:24.376050 7f97e2276780 10 register_cxx_method rbd.remove_parent flags 3 0x7f97d3cf3a30
2014-03-25 18:29:24.376052 7f97e2276780 10 register_cxx_method rbd.set_protection_status flags 3 0x7f97d3cfa880
2014-03-25 18:29:24.376053 7f97e2276780 10 register_cxx_method rbd.get_protection_status flags 1 0x7f97d3cface0
2014-03-25 18:29:24.376055 7f97e2276780 10 register_cxx_method rbd.get_stripe_unit_count flags 1 0x7f97d3cf3f70
2014-03-25 18:29:24.376061 7f97e2276780 10 register_cxx_method rbd.set_stripe_unit_count flags 3 0x7f97d3cf53c0
2014-03-25 18:29:24.376062 7f97e2276780 10 register_cxx_method rbd.add_child flags 3 0x7f97d3cf7ce0
2014-03-25 18:29:24.376064 7f97e2276780 10 register_cxx_method rbd.remove_child flags 3 0x7f97d3cf8100
2014-03-25 18:29:24.376065 7f97e2276780 10 register_cxx_method rbd.get_children flags 1 0x7f97d3cf7a20
2014-03-25 18:29:24.376067 7f97e2276780 10 register_cxx_method rbd.get_id flags 1 0x7f97d3cf5120
2014-03-25 18:29:24.376068 7f97e2276780 10 register_cxx_method rbd.set_id flags 3 0x7f97d3cf71f0
2014-03-25 18:29:24.376070 7f97e2276780 10 register_cxx_method rbd.dir_get_id flags 1 0x7f97d3cf3130
2014-03-25 18:29:24.376072 7f97e2276780 10 register_cxx_method rbd.dir_get_name flags 1 0x7f97d3cf2e90
2014-03-25 18:29:24.376076 7f97e2276780 10 register_cxx_method rbd.dir_list flags 1 0x7f97d3cf8f90
2014-03-25 18:29:24.376078 7f97e2276780 10 register_cxx_method rbd.dir_add_image flags 3 0x7f97d3cf8ae0
2014-03-25 18:29:24.376079 7f97e2276780 10 register_cxx_method rbd.dir_remove_image flags 3 0x7f97d3cf2cc0
2014-03-25 18:29:24.376081 7f97e2276780 10 register_cxx_method rbd.dir_rename_image flags 3 0x7f97d3cf8d00
2014-03-25 18:29:24.376082 7f97e2276780 10 register_cxx_method rbd.snap_list flags 1 0x7f97d3cf4870
2014-03-25 18:29:24.376084 7f97e2276780 10 register_cxx_method rbd.snap_add flags 3 0x7f97d3cf4b30
2014-03-25 18:29:24.376085 7f97e2276780 10 register_cxx_method rbd.snap_remove flags 3 0x7f97d3cf4200
2014-03-25 18:29:24.376087 7f97e2276780 10 _load_class rbd success
2014-03-25 18:29:24.376089 7f97e2276780 10 open_all_classes found lock
2014-03-25 18:29:24.376091 7f97e2276780 10 _get_class adding new class name lock 0x305e488
2014-03-25 18:29:24.376093 7f97e2276780 10 _load_class lock from /usr/lib/rados-classes/libcls_lock.so
2014-03-25 18:29:24.376218 7f97e2276780 10 register_class lock status 3
2014-03-25 18:29:24.376221 7f97e2276780 10 register_cxx_method lock.lock flags 3 0x7f97d3ae75a0
2014-03-25 18:29:24.376223 7f97e2276780 10 register_cxx_method lock.unlock flags 3 0x7f97d3ae7210
2014-03-25 18:29:24.376225 7f97e2276780 10 register_cxx_method lock.break_lock flags 3 0x7f97d3ae6ea0
2014-03-25 18:29:24.376226 7f97e2276780 10 register_cxx_method lock.get_info flags 1 0x7f97d3ae5f90
2014-03-25 18:29:24.376228 7f97e2276780 10 register_cxx_method lock.list_locks flags 1 0x7f97d3ae4cc0
2014-03-25 18:29:24.376229 7f97e2276780 10 _load_class lock success
2014-03-25 18:29:24.376231 7f97e2276780 10 open_all_classes found hello
2014-03-25 18:29:24.376233 7f97e2276780 10 _get_class adding new class name hello 0x305e3a8
2014-03-25 18:29:24.376234 7f97e2276780 10 _load_class hello from /usr/lib/rados-classes/libcls_hello.so
2014-03-25 18:29:24.376334 7f97e2276780  0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
2014-03-25 18:29:24.376338 7f97e2276780 10 register_class hello status 3
2014-03-25 18:29:24.376339 7f97e2276780 10 register_cxx_method hello.say_hello flags 1 0x7f97d38de1d0
2014-03-25 18:29:24.376341 7f97e2276780 10 register_cxx_method hello.record_hello flags 2 0x7f97d38df120
2014-03-25 18:29:24.376343 7f97e2276780 10 register_cxx_method hello.writes_dont_return_data flags 2 0x7f97d38de4a0
2014-03-25 18:29:24.376344 7f97e2276780 10 register_cxx_method hello.replay flags 1 0x7f97d38de1a0
2014-03-25 18:29:24.376346 7f97e2276780 10 register_cxx_method hello.turn_it_to_11 flags 3 0x7f97d38de730
2014-03-25 18:29:24.376348 7f97e2276780 10 register_cxx_method hello.bad_reader flags 2 0x7f97d38de190
2014-03-25 18:29:24.376349 7f97e2276780 10 register_cxx_method hello.bad_writer flags 1 0x7f97d38de180
2014-03-25 18:29:24.376350 7f97e2276780 10 _load_class hello success
2014-03-25 18:29:24.376356 7f97e2276780 10 open_all_classes found version
2014-03-25 18:29:24.376358 7f97e2276780 10 _get_class adding new class name version 0x305e2c8
2014-03-25 18:29:24.376360 7f97e2276780 10 _load_class version from /usr/lib/rados-classes/libcls_version.so
2014-03-25 18:29:24.376457 7f97e2276780 10 register_class version status 3
2014-03-25 18:29:24.376458 7f97e2276780 10 register_cxx_method version.set flags 3 0x7f97d36d8de0
2014-03-25 18:29:24.376460 7f97e2276780 10 register_cxx_method version.inc flags 3 0x7f97d36d9bc0
2014-03-25 18:29:24.376462 7f97e2276780 10 register_cxx_method version.inc_conds flags 3 0x7f97d36d9bc0
2014-03-25 18:29:24.376463 7f97e2276780 10 register_cxx_method version.read flags 1 0x7f97d36d8b40
2014-03-25 18:29:24.376465 7f97e2276780 10 register_cxx_method version.check_conds flags 1 0x7f97d36d91e0
2014-03-25 18:29:24.376467 7f97e2276780 10 _load_class version success
2014-03-25 18:29:24.376468 7f97e2276780 10 open_all_classes found kvs
2014-03-25 18:29:24.376470 7f97e2276780 10 _get_class adding new class name kvs 0x305e808
2014-03-25 18:29:24.376472 7f97e2276780 10 _load_class kvs from /usr/lib/rados-classes/libcls_kvs.so
2014-03-25 18:29:24.376626 7f97e2276780 10 register_class kvs status 3
2014-03-25 18:29:24.376631 7f97e2276780 10 register_cxx_method kvs.get_idata_from_key flags 1 0x7f97d34c92f0
2014-03-25 18:29:24.376634 7f97e2276780 10 register_cxx_method kvs.get_next_idata flags 1 0x7f97d34ca530
2014-03-25 18:29:24.376635 7f97e2276780 10 register_cxx_method kvs.get_prev_idata flags 1 0x7f97d34c8950
2014-03-25 18:29:24.376636 7f97e2276780 10 register_cxx_method kvs.read_many flags 1 0x7f97d34c6230
2014-03-25 18:29:24.376638 7f97e2276780 10 register_cxx_method kvs.check_writable flags 3 0x7f97d34c5600
2014-03-25 18:29:24.376640 7f97e2276780 10 register_cxx_method kvs.assert_size_in_bound flags 2 0x7f97d34c58a0
2014-03-25 18:29:24.376641 7f97e2276780 10 register_cxx_method kvs.omap_insert flags 2 0x7f97d34c77b0
2014-03-25 18:29:24.376643 7f97e2276780 10 register_cxx_method kvs.create_with_omap flags 2 0x7f97d34c81e0
2014-03-25 18:29:24.376644 7f97e2276780 10 register_cxx_method kvs.omap_remove flags 2 0x7f97d34c5a90
2014-03-25 18:29:24.376645 7f97e2276780 10 register_cxx_method kvs.maybe_read_for_balance flags 1 0x7f97d34c6e80
2014-03-25 18:29:24.376649 7f97e2276780 10 _load_class kvs success
2014-03-25 18:29:24.376651 7f97e2276780 10 open_all_classes found rgw
2014-03-25 18:29:24.376653 7f97e2276780 10 _get_class adding new class name rgw 0x305e648
2014-03-25 18:29:24.376655 7f97e2276780 10 _load_class rgw from /usr/lib/rados-classes/libcls_rgw.so
2014-03-25 18:29:24.380284 7f97e2276780 10 register_class rgw status 3
2014-03-25 18:29:24.380286 7f97e2276780 10 register_cxx_method rgw.bucket_init_index flags 3 0x7f97d31e63f0
2014-03-25 18:29:24.380288 7f97e2276780 10 register_cxx_method rgw.bucket_set_tag_timeout flags 3 0x7f97d31e7280
2014-03-25 18:29:24.380289 7f97e2276780 10 register_cxx_method rgw.bucket_list flags 1 0x7f97d31ec180
2014-03-25 18:29:24.380291 7f97e2276780 10 register_cxx_method rgw.bucket_check_index flags 1 0x7f97d31ec060
2014-03-25 18:29:24.380292 7f97e2276780 10 register_cxx_method rgw.bucket_rebuild_index flags 3 0x7f97d31ebf40
2014-03-25 18:29:24.380294 7f97e2276780 10 register_cxx_method rgw.bucket_prepare_op flags 3 0x7f97d31e8fb0
2014-03-25 18:29:24.380295 7f97e2276780 10 register_cxx_method rgw.bucket_complete_op flags 3 0x7f97d31e7600
2014-03-25 18:29:24.380296 7f97e2276780 10 register_cxx_method rgw.bi_log_list flags 1 0x7f97d31ea8c0
2014-03-25 18:29:24.380303 7f97e2276780 10 register_cxx_method rgw.bi_log_trim flags 3 0x7f97d31ea5f0
2014-03-25 18:29:24.380304 7f97e2276780 10 register_cxx_method rgw.dir_suggest_changes flags 3 0x7f97d31e8140
2014-03-25 18:29:24.380305 7f97e2276780 10 register_cxx_method rgw.user_usage_log_add flags 3 0x7f97d31ecde0
2014-03-25 18:29:24.380307 7f97e2276780 10 register_cxx_method rgw.user_usage_log_read flags 1 0x7f97d31e7000
2014-03-25 18:29:24.380310 7f97e2276780 10 register_cxx_method rgw.user_usage_log_trim flags 3 0x7f97d31e6e40
2014-03-25 18:29:24.380312 7f97e2276780 10 register_cxx_method rgw.gc_set_entry flags 3 0x7f97d31e5fd0
2014-03-25 18:29:24.380313 7f97e2276780 10 register_cxx_method rgw.gc_defer_entry flags 3 0x7f97d31e5e30
2014-03-25 18:29:24.380315 7f97e2276780 10 register_cxx_method rgw.gc_list flags 1 0x7f97d31e9610
2014-03-25 18:29:24.380316 7f97e2276780 10 register_cxx_method rgw.gc_remove flags 3 0x7f97d31e60d0
2014-03-25 18:29:24.380318 7f97e2276780 10 _load_class rgw success
2014-03-25 18:29:24.380319 7f97e2276780 10 open_all_classes found replica_log
2014-03-25 18:29:24.380321 7f97e2276780 10 _get_class adding new class name replica_log 0x305e568
2014-03-25 18:29:24.380323 7f97e2276780 10 _load_class replica_log from /usr/lib/rados-classes/libcls_replica_log.so
2014-03-25 18:29:24.380435 7f97e2276780 10 register_class replica_log status 3
2014-03-25 18:29:24.380436 7f97e2276780 10 register_cxx_method replica_log.set flags 3 0x7f97d2ec4d60
2014-03-25 18:29:24.380439 7f97e2276780 10 register_cxx_method replica_log.get flags 1 0x7f97d2ec5800
2014-03-25 18:29:24.380440 7f97e2276780 10 register_cxx_method replica_log.delete flags 3 0x7f97d2ec47f0
2014-03-25 18:29:24.380441 7f97e2276780 10 _load_class replica_log success
2014-03-25 18:29:24.380443 7f97e2276780 10 open_all_classes found refcount
2014-03-25 18:29:24.380445 7f97e2276780 10 _get_class adding new class name refcount 0x305ec68
2014-03-25 18:29:24.380447 7f97e2276780 10 _load_class refcount from /usr/lib/rados-classes/libcls_refcount.so
2014-03-25 18:29:24.383489 7f97e2276780 10 register_class refcount status 3
2014-03-25 18:29:24.383491 7f97e2276780 10 register_cxx_method refcount.get flags 3 0x7f97d2c01be0
2014-03-25 18:29:24.383494 7f97e2276780 10 register_cxx_method refcount.put flags 3 0x7f97d2c01770
2014-03-25 18:29:24.383495 7f97e2276780 10 register_cxx_method refcount.set flags 3 0x7f97d2c00740
2014-03-25 18:29:24.383496 7f97e2276780 10 register_cxx_method refcount.read flags 1 0x7f97d2c01270
2014-03-25 18:29:24.383498 7f97e2276780 10 _load_class refcount success
2014-03-25 18:29:24.383500 7f97e2276780 10 open_all_classes found statelog
2014-03-25 18:29:24.383502 7f97e2276780 10 _get_class adding new class name statelog 0x305eb88
2014-03-25 18:29:24.383503 7f97e2276780 10 _load_class statelog from /usr/lib/rados-classes/libcls_statelog.so
2014-03-25 18:29:24.383621 7f97e2276780 10 register_class statelog status 3
2014-03-25 18:29:24.383623 7f97e2276780 10 register_cxx_method statelog.add flags 3 0x7f97d28e87b0
2014-03-25 18:29:24.383625 7f97e2276780 10 register_cxx_method statelog.list flags 1 0x7f97d28e8bc0
2014-03-25 18:29:24.383626 7f97e2276780 10 register_cxx_method statelog.remove flags 3 0x7f97d28e78e0
2014-03-25 18:29:24.383628 7f97e2276780 10 register_cxx_method statelog.check_state flags 1 0x7f97d28e7ff0
2014-03-25 18:29:24.383629 7f97e2276780 10 _load_class statelog success
2014-03-25 18:29:24.383652 7f97e2276780 20 osd.3 0 get_map 1065 - loading and decoding 0x3058000
2014-03-25 18:29:24.383698 7f97e2276780 10 osd.3 0 add_map_bl 1065 0 bytes
2014-03-25 18:29:24.386206 7f97e2276780 -1 *** Caught signal (Aborted) **
 in thread 7f97e2276780

 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60)
 1: /usr/bin/ceph-osd() [0x99b742]
 2: (()+0xf030) [0x7f97e1a06030]
 3: (gsignal()+0x35) [0x7f97e0122475]
 4: (abort()+0x180) [0x7f97e01256f0]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f97e097789d]
 6: (()+0x63996) [0x7f97e0975996]
 7: (()+0x639c3) [0x7f97e09759c3]
 8: (()+0x63bee) [0x7f97e0975bee]
 9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x127) [0xa5d9e7]
 10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x2c) [0xa2f84c]
 11: (OSDMap::decode(ceph::buffer::list&)+0x3e) [0xa3015e]
 12: (OSDService::try_get_map(unsigned int)+0x38b) [0x722a2b]
 13: (OSDService::get_map(unsigned int)+0x16) [0x77a206]
 14: (OSD::init()+0x15b2) [0x73bd82]
 15: (main()+0x238a) [0x6eaa1a]
 16: (__libc_start_main()+0xfd) [0x7f97e010eead]
 17: /usr/bin/ceph-osd() [0x6edd39]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
  -224> 2014-03-25 18:29:23.676042 7f97e2276780  5 asok(0x2fda1c0) register_command perfcounters_dump hook 0x2fca010
  -223> 2014-03-25 18:29:23.676077 7f97e2276780  5 asok(0x2fda1c0) register_command 1 hook 0x2fca010
  -222> 2014-03-25 18:29:23.676082 7f97e2276780  5 asok(0x2fda1c0) register_command perf dump hook 0x2fca010
  -221> 2014-03-25 18:29:23.676089 7f97e2276780  5 asok(0x2fda1c0) register_command perfcounters_schema hook 0x2fca010
  -220> 2014-03-25 18:29:23.676093 7f97e2276780  5 asok(0x2fda1c0) register_command 2 hook 0x2fca010
  -219> 2014-03-25 18:29:23.676097 7f97e2276780  5 asok(0x2fda1c0) register_command perf schema hook 0x2fca010
  -218> 2014-03-25 18:29:23.676100 7f97e2276780  5 asok(0x2fda1c0) register_command config show hook 0x2fca010
  -217> 2014-03-25 18:29:23.676105 7f97e2276780  5 asok(0x2fda1c0) register_command config set hook 0x2fca010
  -216> 2014-03-25 18:29:23.676109 7f97e2276780  5 asok(0x2fda1c0) register_command config get hook 0x2fca010
  -215> 2014-03-25 18:29:23.676112 7f97e2276780  5 asok(0x2fda1c0) register_command log flush hook 0x2fca010
  -214> 2014-03-25 18:29:23.676116 7f97e2276780  5 asok(0x2fda1c0) register_command log dump hook 0x2fca010
  -213> 2014-03-25 18:29:23.676120 7f97e2276780  5 asok(0x2fda1c0) register_command log reopen hook 0x2fca010
  -212> 2014-03-25 18:29:23.677844 7f97e2276780  0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process ceph-osd, pid 65741
  -211> 2014-03-25 18:29:23.680868 7f97e2276780  1 -- 10.17.10.61:0/0 learned my addr 10.17.10.61:0/0
  -210> 2014-03-25 18:29:23.680884 7f97e2276780  1 accepter.accepter.bind my_inst.addr is 10.17.10.61:6800/65741 need_addr=0
  -209> 2014-03-25 18:29:23.680898 7f97e2276780  1 -- 10.17.19.61:0/0 learned my addr 10.17.19.61:0/0
  -208> 2014-03-25 18:29:23.680903 7f97e2276780  1 accepter.accepter.bind my_inst.addr is 10.17.19.61:6800/65741 need_addr=0
  -207> 2014-03-25 18:29:23.680914 7f97e2276780  1 -- 10.17.19.61:0/0 learned my addr 10.17.19.61:0/0
  -206> 2014-03-25 18:29:23.680919 7f97e2276780  1 accepter.accepter.bind my_inst.addr is 10.17.19.61:6801/65741 need_addr=0
  -205> 2014-03-25 18:29:23.680939 7f97e2276780  1 -- 10.17.10.61:0/0 learned my addr 10.17.10.61:0/0
  -204> 2014-03-25 18:29:23.680944 7f97e2276780  1 accepter.accepter.bind my_inst.addr is 10.17.10.61:6801/65741 need_addr=0
  -203> 2014-03-25 18:29:23.680957 7f97e2276780  1 -- 10.17.10.61:0/0 learned my addr 10.17.10.61:0/0
  -202> 2014-03-25 18:29:23.680962 7f97e2276780  1 accepter.accepter.bind my_inst.addr is 10.17.10.61:6802/65741 need_addr=0
  -201> 2014-03-25 18:29:23.683201 7f97e2276780  5 asok(0x2fda1c0) init /var/run/ceph/ceph-osd.3.asok
  -200> 2014-03-25 18:29:23.683217 7f97e2276780  5 asok(0x2fda1c0) bind_and_listen /var/run/ceph/ceph-osd.3.asok
  -199> 2014-03-25 18:29:23.683247 7f97e2276780  5 asok(0x2fda1c0) register_command 0 hook 0x2fc80b8
  -198> 2014-03-25 18:29:23.683255 7f97e2276780  5 asok(0x2fda1c0) register_command version hook 0x2fc80b8
  -197> 2014-03-25 18:29:23.683258 7f97e2276780  5 asok(0x2fda1c0) register_command git_version hook 0x2fc80b8
  -196> 2014-03-25 18:29:23.683266 7f97e2276780  5 asok(0x2fda1c0) register_command help hook 0x2fca0d0
  -195> 2014-03-25 18:29:23.683269 7f97e2276780  5 asok(0x2fda1c0) register_command get_command_descriptions hook 0x2fca0c0
  -194> 2014-03-25 18:29:23.683306 7f97ddf35700  5 asok(0x2fda1c0) entry start
  -193> 2014-03-25 18:29:23.683463 7f97e2276780  1 filestore(/var/lib/ceph/osd/ceph-3) mount detected xfs
  -192> 2014-03-25 18:29:23.683467 7f97e2276780  1 filestore(/var/lib/ceph/osd/ceph-3)  disabling 'filestore replica fadvise' due to known issues with fadvise(DONTNEED) on xfs
  -191> 2014-03-25 18:29:23.748068 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is supported and appears to work
  -190> 2014-03-25 18:29:23.748085 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
  -189> 2014-03-25 18:29:23.889524 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: syscall(SYS_syncfs, fd) fully supported
  -188> 2014-03-25 18:29:23.990423 7f97e2276780  0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
  -187> 2014-03-25 18:29:23.997471 7f97e2276780  2 journal open /dev/sdb1 fsid 884cec29-b65e-4b17-af78-3cc3af071614 fs_op_seq 1520140
  -186> 2014-03-25 18:29:23.999776 7f97e2276780  0 journal  kernel version is 3.2.0
  -185> 2014-03-25 18:29:23.999898 7f97e2276780  1 journal _open /dev/sdb1 fd 20: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
  -184> 2014-03-25 18:29:24.000473 7f97e2276780  2 journal No further valid entries found, journal is most likely valid
  -183> 2014-03-25 18:29:24.000483 7f97e2276780  2 journal No further valid entries found, journal is most likely valid
  -182> 2014-03-25 18:29:24.000485 7f97e2276780  3 journal journal_replay: end of journal, done.
  -181> 2014-03-25 18:29:24.002763 7f97e2276780  0 journal  kernel version is 3.2.0
  -180> 2014-03-25 18:29:24.002885 7f97e2276780  1 journal _open /dev/sdb1 fd 20: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
  -179> 2014-03-25 18:29:24.003250 7f97dab1c700  1 FileStore::op_tp worker finish
  -178> 2014-03-25 18:29:24.003278 7f97da31b700  1 FileStore::op_tp worker finish
  -177> 2014-03-25 18:29:24.003379 7f97e2276780  1 journal close /dev/sdb1
  -176> 2014-03-25 18:29:24.003934 7f97e2276780 10 monclient(hunting): build_initial_monmap
  -175> 2014-03-25 18:29:24.004006 7f97e2276780  5 adding auth protocol: cephx
  -174> 2014-03-25 18:29:24.004014 7f97e2276780  5 adding auth protocol: cephx
  -173> 2014-03-25 18:29:24.004164 7f97e2276780  1 -- 10.17.10.61:6800/65741 messenger.start
  -172> 2014-03-25 18:29:24.004180 7f97e2276780  1 -- :/0 messenger.start
  -171> 2014-03-25 18:29:24.004188 7f97e2276780  1 -- 10.17.10.61:6801/65741 messenger.start
  -170> 2014-03-25 18:29:24.004196 7f97e2276780  1 -- 10.17.19.61:6801/65741 messenger.start
  -169> 2014-03-25 18:29:24.004230 7f97e2276780  1 -- 10.17.19.61:6800/65741 messenger.start
  -168> 2014-03-25 18:29:24.004252 7f97e2276780  1 -- 10.17.10.61:6802/65741 messenger.start
  -167> 2014-03-25 18:29:24.004299 7f97e2276780  2 osd.3 0 mounting /var/lib/ceph/osd/ceph-3 /dev/sdb1
  -166> 2014-03-25 18:29:24.004343 7f97e2276780  1 filestore(/var/lib/ceph/osd/ceph-3) mount detected xfs
  -165> 2014-03-25 18:29:24.073316 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is supported and appears to work
  -164> 2014-03-25 18:29:24.073329 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
  -163> 2014-03-25 18:29:24.264846 7f97e2276780  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-3) detect_features: syscall(SYS_syncfs, fd) fully supported
  -162> 2014-03-25 18:29:24.365600 7f97e2276780  0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
  -161> 2014-03-25 18:29:24.369681 7f97e2276780  2 journal open /dev/sdb1 fsid 884cec29-b65e-4b17-af78-3cc3af071614 fs_op_seq 1520140
  -160> 2014-03-25 18:29:24.372059 7f97e2276780  0 journal  kernel version is 3.2.0
  -159> 2014-03-25 18:29:24.372163 7f97e2276780  1 journal _open /dev/sdb1 fd 21: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
  -158> 2014-03-25 18:29:24.372501 7f97e2276780  2 journal No further valid entries found, journal is most likely valid
  -157> 2014-03-25 18:29:24.372511 7f97e2276780  2 journal No further valid entries found, journal is most likely valid
  -156> 2014-03-25 18:29:24.372512 7f97e2276780  3 journal journal_replay: end of journal, done.
  -155> 2014-03-25 18:29:24.374885 7f97e2276780  0 journal  kernel version is 3.2.0
  -154> 2014-03-25 18:29:24.375003 7f97e2276780  1 journal _open /dev/sdb1 fd 21: 1073741824 bytes, block size 4096 bytes, directio = 1, aio = 1
  -153> 2014-03-25 18:29:24.375223 7f97e2276780  2 osd.3 0 boot
  -152> 2014-03-25 18:29:24.375334 7f97e2276780 10 osd.3 0 read_superblock sb(783a2063-32c7-420e-b9cc-d0f8f837f89c osd.3 884cec29-b65e-4b17-af78-3cc3af071614 e1065 [502,1065] lci=[761,1065])
  -151> 2014-03-25 18:29:24.375401 7f97e2276780 10 open_all_classes
  -150> 2014-03-25 18:29:24.375456 7f97e2276780 10 open_all_classes found log
  -149> 2014-03-25 18:29:24.375470 7f97e2276780 10 _get_class adding new class name log 0x305e028
  -148> 2014-03-25 18:29:24.375473 7f97e2276780 10 _load_class log from /usr/lib/rados-classes/libcls_log.so
  -147> 2014-03-25 18:29:24.375778 7f97e2276780  1 <cls> cls/log/cls_log.cc:312: Loaded log class!
  -146> 2014-03-25 18:29:24.375785 7f97e2276780 10 register_class log status 3
  -145> 2014-03-25 18:29:24.375786 7f97e2276780 10 register_cxx_method log.add flags 3 0x7f97d410b4d0
  -144> 2014-03-25 18:29:24.375792 7f97e2276780 10 register_cxx_method log.list flags 1 0x7f97d410c6a0
  -143> 2014-03-25 18:29:24.375794 7f97e2276780 10 register_cxx_method log.trim flags 3 0x7f97d410bf40
  -142> 2014-03-25 18:29:24.375795 7f97e2276780 10 register_cxx_method log.info flags 1 0x7f97d410b080
  -141> 2014-03-25 18:29:24.375797 7f97e2276780 10 _load_class log success
  -140> 2014-03-25 18:29:24.375799 7f97e2276780 10 open_all_classes found rbd
  -139> 2014-03-25 18:29:24.375801 7f97e2276780 10 _get_class adding new class name rbd 0x305e108
  -138> 2014-03-25 18:29:24.375803 7f97e2276780 10 _load_class rbd from /usr/lib/rados-classes/libcls_rbd.so
  -137> 2014-03-25 18:29:24.376018 7f97e2276780 10 register_class rbd status 3
  -136> 2014-03-25 18:29:24.376023 7f97e2276780 10 register_cxx_method rbd.create flags 3 0x7f97d3cf6670
  -135> 2014-03-25 18:29:24.376026 7f97e2276780 10 register_cxx_method rbd.get_features flags 1 0x7f97d3cfb450
  -134> 2014-03-25 18:29:24.376027 7f97e2276780 10 register_cxx_method rbd.get_size flags 1 0x7f97d3cfafe0
  -133> 2014-03-25 18:29:24.376029 7f97e2276780 10 register_cxx_method rbd.set_size flags 3 0x7f97d3cf5fe0
  -132> 2014-03-25 18:29:24.376030 7f97e2276780 10 register_cxx_method rbd.get_snapcontext flags 1 0x7f97d3cf74b0
  -131> 2014-03-25 18:29:24.376032 7f97e2276780 10 register_cxx_method rbd.get_object_prefix flags 1 0x7f97d3cf33e0
  -130> 2014-03-25 18:29:24.376035 7f97e2276780 10 register_cxx_method rbd.get_snapshot_name flags 1 0x7f97d3cfa180
  -129> 2014-03-25 18:29:24.376037 7f97e2276780 10 register_cxx_method rbd.snapshot_add flags 3 0x7f97d3cfb7f0
  -128> 2014-03-25 18:29:24.376039 7f97e2276780 10 register_cxx_method rbd.snapshot_remove flags 3 0x7f97d3cf9f60
  -127> 2014-03-25 18:29:24.376040 7f97e2276780 10 register_cxx_method rbd.get_all_features flags 1 0x7f97d3cf1890
  -126> 2014-03-25 18:29:24.376046 7f97e2276780 10 register_cxx_method rbd.copyup flags 3 0x7f97d3cf1810
  -125> 2014-03-25 18:29:24.376047 7f97e2276780 10 register_cxx_method rbd.get_parent flags 1 0x7f97d3cfa390
  -124> 2014-03-25 18:29:24.376049 7f97e2276780 10 register_cxx_method rbd.set_parent flags 3 0x7f97d3cf5950
  -123> 2014-03-25 18:29:24.376050 7f97e2276780 10 register_cxx_method rbd.remove_parent flags 3 0x7f97d3cf3a30
  -122> 2014-03-25 18:29:24.376052 7f97e2276780 10 register_cxx_method rbd.set_protection_status flags 3 0x7f97d3cfa880
  -121> 2014-03-25 18:29:24.376053 7f97e2276780 10 register_cxx_method rbd.get_protection_status flags 1 0x7f97d3cface0
  -120> 2014-03-25 18:29:24.376055 7f97e2276780 10 register_cxx_method rbd.get_stripe_unit_count flags 1 0x7f97d3cf3f70
  -119> 2014-03-25 18:29:24.376061 7f97e2276780 10 register_cxx_method rbd.set_stripe_unit_count flags 3 0x7f97d3cf53c0
  -118> 2014-03-25 18:29:24.376062 7f97e2276780 10 register_cxx_method rbd.add_child flags 3 0x7f97d3cf7ce0
  -117> 2014-03-25 18:29:24.376064 7f97e2276780 10 register_cxx_method rbd.remove_child flags 3 0x7f97d3cf8100
  -116> 2014-03-25 18:29:24.376065 7f97e2276780 10 register_cxx_method rbd.get_children flags 1 0x7f97d3cf7a20
  -115> 2014-03-25 18:29:24.376067 7f97e2276780 10 register_cxx_method rbd.get_id flags 1 0x7f97d3cf5120
  -114> 2014-03-25 18:29:24.376068 7f97e2276780 10 register_cxx_method rbd.set_id flags 3 0x7f97d3cf71f0
  -113> 2014-03-25 18:29:24.376070 7f97e2276780 10 register_cxx_method rbd.dir_get_id flags 1 0x7f97d3cf3130
  -112> 2014-03-25 18:29:24.376072 7f97e2276780 10 register_cxx_method rbd.dir_get_name flags 1 0x7f97d3cf2e90
  -111> 2014-03-25 18:29:24.376076 7f97e2276780 10 register_cxx_method rbd.dir_list flags 1 0x7f97d3cf8f90
  -110> 2014-03-25 18:29:24.376078 7f97e2276780 10 register_cxx_method rbd.dir_add_image flags 3 0x7f97d3cf8ae0
  -109> 2014-03-25 18:29:24.376079 7f97e2276780 10 register_cxx_method rbd.dir_remove_image flags 3 0x7f97d3cf2cc0
  -108> 2014-03-25 18:29:24.376081 7f97e2276780 10 register_cxx_method rbd.dir_rename_image flags 3 0x7f97d3cf8d00
  -107> 2014-03-25 18:29:24.376082 7f97e2276780 10 register_cxx_method rbd.snap_list flags 1 0x7f97d3cf4870
  -106> 2014-03-25 18:29:24.376084 7f97e2276780 10 register_cxx_method rbd.snap_add flags 3 0x7f97d3cf4b30
  -105> 2014-03-25 18:29:24.376085 7f97e2276780 10 register_cxx_method rbd.snap_remove flags 3 0x7f97d3cf4200
  -104> 2014-03-25 18:29:24.376087 7f97e2276780 10 _load_class rbd success
  -103> 2014-03-25 18:29:24.376089 7f97e2276780 10 open_all_classes found lock
  -102> 2014-03-25 18:29:24.376091 7f97e2276780 10 _get_class adding new class name lock 0x305e488
  -101> 2014-03-25 18:29:24.376093 7f97e2276780 10 _load_class lock from /usr/lib/rados-classes/libcls_lock.so
  -100> 2014-03-25 18:29:24.376218 7f97e2276780 10 register_class lock status 3
   -99> 2014-03-25 18:29:24.376221 7f97e2276780 10 register_cxx_method lock.lock flags 3 0x7f97d3ae75a0
   -98> 2014-03-25 18:29:24.376223 7f97e2276780 10 register_cxx_method lock.unlock flags 3 0x7f97d3ae7210
   -97> 2014-03-25 18:29:24.376225 7f97e2276780 10 register_cxx_method lock.break_lock flags 3 0x7f97d3ae6ea0
   -96> 2014-03-25 18:29:24.376226 7f97e2276780 10 register_cxx_method lock.get_info flags 1 0x7f97d3ae5f90
   -95> 2014-03-25 18:29:24.376228 7f97e2276780 10 register_cxx_method lock.list_locks flags 1 0x7f97d3ae4cc0
   -94> 2014-03-25 18:29:24.376229 7f97e2276780 10 _load_class lock success
   -93> 2014-03-25 18:29:24.376231 7f97e2276780 10 open_all_classes found hello
   -92> 2014-03-25 18:29:24.376233 7f97e2276780 10 _get_class adding new class name hello 0x305e3a8
   -91> 2014-03-25 18:29:24.376234 7f97e2276780 10 _load_class hello from /usr/lib/rados-classes/libcls_hello.so
   -90> 2014-03-25 18:29:24.376334 7f97e2276780  0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
   -89> 2014-03-25 18:29:24.376338 7f97e2276780 10 register_class hello status 3
   -88> 2014-03-25 18:29:24.376339 7f97e2276780 10 register_cxx_method hello.say_hello flags 1 0x7f97d38de1d0
   -87> 2014-03-25 18:29:24.376341 7f97e2276780 10 register_cxx_method hello.record_hello flags 2 0x7f97d38df120
   -86> 2014-03-25 18:29:24.376343 7f97e2276780 10 register_cxx_method hello.writes_dont_return_data flags 2 0x7f97d38de4a0
   -85> 2014-03-25 18:29:24.376344 7f97e2276780 10 register_cxx_method hello.replay flags 1 0x7f97d38de1a0
   -84> 2014-03-25 18:29:24.376346 7f97e2276780 10 register_cxx_method hello.turn_it_to_11 flags 3 0x7f97d38de730
   -83> 2014-03-25 18:29:24.376348 7f97e2276780 10 register_cxx_method hello.bad_reader flags 2 0x7f97d38de190
   -82> 2014-03-25 18:29:24.376349 7f97e2276780 10 register_cxx_method hello.bad_writer flags 1 0x7f97d38de180
   -81> 2014-03-25 18:29:24.376350 7f97e2276780 10 _load_class hello success
   -80> 2014-03-25 18:29:24.376356 7f97e2276780 10 open_all_classes found version
   -79> 2014-03-25 18:29:24.376358 7f97e2276780 10 _get_class adding new class name version 0x305e2c8
   -78> 2014-03-25 18:29:24.376360 7f97e2276780 10 _load_class version from /usr/lib/rados-classes/libcls_version.so
   -77> 2014-03-25 18:29:24.376453 7f97e2276780  1 <cls> cls/version/cls_version.cc:227: Loaded version class!
   -76> 2014-03-25 18:29:24.376457 7f97e2276780 10 register_class version status 3
   -75> 2014-03-25 18:29:24.376458 7f97e2276780 10 register_cxx_method version.set flags 3 0x7f97d36d8de0
   -74> 2014-03-25 18:29:24.376460 7f97e2276780 10 register_cxx_method version.inc flags 3 0x7f97d36d9bc0
   -73> 2014-03-25 18:29:24.376462 7f97e2276780 10 register_cxx_method version.inc_conds flags 3 0x7f97d36d9bc0
   -72> 2014-03-25 18:29:24.376463 7f97e2276780 10 register_cxx_method version.read flags 1 0x7f97d36d8b40
   -71> 2014-03-25 18:29:24.376465 7f97e2276780 10 register_cxx_method version.check_conds flags 1 0x7f97d36d91e0
   -70> 2014-03-25 18:29:24.376467 7f97e2276780 10 _load_class version success
   -69> 2014-03-25 18:29:24.376468 7f97e2276780 10 open_all_classes found kvs
   -68> 2014-03-25 18:29:24.376470 7f97e2276780 10 _get_class adding new class name kvs 0x305e808
   -67> 2014-03-25 18:29:24.376472 7f97e2276780 10 _load_class kvs from /usr/lib/rados-classes/libcls_kvs.so
   -66> 2014-03-25 18:29:24.376626 7f97e2276780 10 register_class kvs status 3
   -65> 2014-03-25 18:29:24.376631 7f97e2276780 10 register_cxx_method kvs.get_idata_from_key flags 1 0x7f97d34c92f0
   -64> 2014-03-25 18:29:24.376634 7f97e2276780 10 register_cxx_method kvs.get_next_idata flags 1 0x7f97d34ca530
   -63> 2014-03-25 18:29:24.376635 7f97e2276780 10 register_cxx_method kvs.get_prev_idata flags 1 0x7f97d34c8950
   -62> 2014-03-25 18:29:24.376636 7f97e2276780 10 register_cxx_method kvs.read_many flags 1 0x7f97d34c6230
   -61> 2014-03-25 18:29:24.376638 7f97e2276780 10 register_cxx_method kvs.check_writable flags 3 0x7f97d34c5600
   -60> 2014-03-25 18:29:24.376640 7f97e2276780 10 register_cxx_method kvs.assert_size_in_bound flags 2 0x7f97d34c58a0
   -59> 2014-03-25 18:29:24.376641 7f97e2276780 10 register_cxx_method kvs.omap_insert flags 2 0x7f97d34c77b0
   -58> 2014-03-25 18:29:24.376643 7f97e2276780 10 register_cxx_method kvs.create_with_omap flags 2 0x7f97d34c81e0
   -57> 2014-03-25 18:29:24.376644 7f97e2276780 10 register_cxx_method kvs.omap_remove flags 2 0x7f97d34c5a90
   -56> 2014-03-25 18:29:24.376645 7f97e2276780 10 register_cxx_method kvs.maybe_read_for_balance flags 1 0x7f97d34c6e80
   -55> 2014-03-25 18:29:24.376649 7f97e2276780 10 _load_class kvs success
   -54> 2014-03-25 18:29:24.376651 7f97e2276780 10 open_all_classes found rgw
   -53> 2014-03-25 18:29:24.376653 7f97e2276780 10 _get_class adding new class name rgw 0x305e648
   -52> 2014-03-25 18:29:24.376655 7f97e2276780 10 _load_class rgw from /usr/lib/rados-classes/libcls_rgw.so
   -51> 2014-03-25 18:29:24.380276 7f97e2276780  1 <cls> cls/rgw/cls_rgw.cc:1596: Loaded rgw class!
   -50> 2014-03-25 18:29:24.380284 7f97e2276780 10 register_class rgw status 3
   -49> 2014-03-25 18:29:24.380286 7f97e2276780 10 register_cxx_method rgw.bucket_init_index flags 3 0x7f97d31e63f0
   -48> 2014-03-25 18:29:24.380288 7f97e2276780 10 register_cxx_method rgw.bucket_set_tag_timeout flags 3 0x7f97d31e7280
   -47> 2014-03-25 18:29:24.380289 7f97e2276780 10 register_cxx_method rgw.bucket_list flags 1 0x7f97d31ec180
   -46> 2014-03-25 18:29:24.380291 7f97e2276780 10 register_cxx_method rgw.bucket_check_index flags 1 0x7f97d31ec060
   -45> 2014-03-25 18:29:24.380292 7f97e2276780 10 register_cxx_method rgw.bucket_rebuild_index flags 3 0x7f97d31ebf40
   -44> 2014-03-25 18:29:24.380294 7f97e2276780 10 register_cxx_method rgw.bucket_prepare_op flags 3 0x7f97d31e8fb0
   -43> 2014-03-25 18:29:24.380295 7f97e2276780 10 register_cxx_method rgw.bucket_complete_op flags 3 0x7f97d31e7600
   -42> 2014-03-25 18:29:24.380296 7f97e2276780 10 register_cxx_method rgw.bi_log_list flags 1 0x7f97d31ea8c0
   -41> 2014-03-25 18:29:24.380303 7f97e2276780 10 register_cxx_method rgw.bi_log_trim flags 3 0x7f97d31ea5f0
   -40> 2014-03-25 18:29:24.380304 7f97e2276780 10 register_cxx_method rgw.dir_suggest_changes flags 3 0x7f97d31e8140
   -39> 2014-03-25 18:29:24.380305 7f97e2276780 10 register_cxx_method rgw.user_usage_log_add flags 3 0x7f97d31ecde0
   -38> 2014-03-25 18:29:24.380307 7f97e2276780 10 register_cxx_method rgw.user_usage_log_read flags 1 0x7f97d31e7000
   -37> 2014-03-25 18:29:24.380310 7f97e2276780 10 register_cxx_method rgw.user_usage_log_trim flags 3 0x7f97d31e6e40
   -36> 2014-03-25 18:29:24.380312 7f97e2276780 10 register_cxx_method rgw.gc_set_entry flags 3 0x7f97d31e5fd0
   -35> 2014-03-25 18:29:24.380313 7f97e2276780 10 register_cxx_method rgw.gc_defer_entry flags 3 0x7f97d31e5e30
   -34> 2014-03-25 18:29:24.380315 7f97e2276780 10 register_cxx_method rgw.gc_list flags 1 0x7f97d31e9610
   -33> 2014-03-25 18:29:24.380316 7f97e2276780 10 register_cxx_method rgw.gc_remove flags 3 0x7f97d31e60d0
   -32> 2014-03-25 18:29:24.380318 7f97e2276780 10 _load_class rgw success
   -31> 2014-03-25 18:29:24.380319 7f97e2276780 10 open_all_classes found replica_log
   -30> 2014-03-25 18:29:24.380321 7f97e2276780 10 _get_class adding new class name replica_log 0x305e568
   -29> 2014-03-25 18:29:24.380323 7f97e2276780 10 _load_class replica_log from /usr/lib/rados-classes/libcls_replica_log.so
   -28> 2014-03-25 18:29:24.380431 7f97e2276780  1 <cls> cls/replica_log/cls_replica_log.cc:141: Loaded replica log class!
   -27> 2014-03-25 18:29:24.380435 7f97e2276780 10 register_class replica_log status 3
   -26> 2014-03-25 18:29:24.380436 7f97e2276780 10 register_cxx_method replica_log.set flags 3 0x7f97d2ec4d60
   -25> 2014-03-25 18:29:24.380439 7f97e2276780 10 register_cxx_method replica_log.get flags 1 0x7f97d2ec5800
   -24> 2014-03-25 18:29:24.380440 7f97e2276780 10 register_cxx_method replica_log.delete flags 3 0x7f97d2ec47f0
   -23> 2014-03-25 18:29:24.380441 7f97e2276780 10 _load_class replica_log success
   -22> 2014-03-25 18:29:24.380443 7f97e2276780 10 open_all_classes found refcount
   -21> 2014-03-25 18:29:24.380445 7f97e2276780 10 _get_class adding new class name refcount 0x305ec68
   -20> 2014-03-25 18:29:24.380447 7f97e2276780 10 _load_class refcount from /usr/lib/rados-classes/libcls_refcount.so
   -19> 2014-03-25 18:29:24.383482 7f97e2276780  1 <cls> cls/refcount/cls_refcount.cc:231: Loaded refcount class!
   -18> 2014-03-25 18:29:24.383489 7f97e2276780 10 register_class refcount status 3
   -17> 2014-03-25 18:29:24.383491 7f97e2276780 10 register_cxx_method refcount.get flags 3 0x7f97d2c01be0
   -16> 2014-03-25 18:29:24.383494 7f97e2276780 10 register_cxx_method refcount.put flags 3 0x7f97d2c01770
   -15> 2014-03-25 18:29:24.383495 7f97e2276780 10 register_cxx_method refcount.set flags 3 0x7f97d2c00740
   -14> 2014-03-25 18:29:24.383496 7f97e2276780 10 register_cxx_method refcount.read flags 1 0x7f97d2c01270
   -13> 2014-03-25 18:29:24.383498 7f97e2276780 10 _load_class refcount success
   -12> 2014-03-25 18:29:24.383500 7f97e2276780 10 open_all_classes found statelog
   -11> 2014-03-25 18:29:24.383502 7f97e2276780 10 _get_class adding new class name statelog 0x305eb88
   -10> 2014-03-25 18:29:24.383503 7f97e2276780 10 _load_class statelog from /usr/lib/rados-classes/libcls_statelog.so
    -9> 2014-03-25 18:29:24.383616 7f97e2276780  1 <cls> cls/statelog/cls_statelog.cc:306: Loaded log class!
    -8> 2014-03-25 18:29:24.383621 7f97e2276780 10 register_class statelog status 3
    -7> 2014-03-25 18:29:24.383623 7f97e2276780 10 register_cxx_method statelog.add flags 3 0x7f97d28e87b0
    -6> 2014-03-25 18:29:24.383625 7f97e2276780 10 register_cxx_method statelog.list flags 1 0x7f97d28e8bc0
    -5> 2014-03-25 18:29:24.383626 7f97e2276780 10 register_cxx_method statelog.remove flags 3 0x7f97d28e78e0
    -4> 2014-03-25 18:29:24.383628 7f97e2276780 10 register_cxx_method statelog.check_state flags 1 0x7f97d28e7ff0
    -3> 2014-03-25 18:29:24.383629 7f97e2276780 10 _load_class statelog success
    -2> 2014-03-25 18:29:24.383652 7f97e2276780 20 osd.3 0 get_map 1065 - loading and decoding 0x3058000
    -1> 2014-03-25 18:29:24.383698 7f97e2276780 10 osd.3 0 add_map_bl 1065 0 bytes
     0> 2014-03-25 18:29:24.386206 7f97e2276780 -1 *** Caught signal (Aborted) **
 in thread 7f97e2276780

 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60)
 1: /usr/bin/ceph-osd() [0x99b742]
 2: (()+0xf030) [0x7f97e1a06030]
 3: (gsignal()+0x35) [0x7f97e0122475]
 4: (abort()+0x180) [0x7f97e01256f0]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f97e097789d]
 6: (()+0x63996) [0x7f97e0975996]
 7: (()+0x639c3) [0x7f97e09759c3]
 8: (()+0x63bee) [0x7f97e0975bee]
 9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x127) [0xa5d9e7]
 10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x2c) [0xa2f84c]
 11: (OSDMap::decode(ceph::buffer::list&)+0x3e) [0xa3015e]
 12: (OSDService::try_get_map(unsigned int)+0x38b) [0x722a2b]
 13: (OSDService::get_map(unsigned int)+0x16) [0x77a206]
 14: (OSD::init()+0x15b2) [0x73bd82]
 15: (main()+0x238a) [0x6eaa1a]
 16: (__libc_start_main()+0xfd) [0x7f97e010eead]
 17: /usr/bin/ceph-osd() [0x6edd39]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
   0/ 5 none
   0/ 1 lockdep
   0/ 1 context
   1/ 1 crush
   1/ 5 mds
   1/ 5 mds_balancer
   1/ 5 mds_locker
   1/ 5 mds_log
   1/ 5 mds_log_expire
   1/ 5 mds_migrator
   0/ 1 buffer
   0/ 1 timer
   0/ 1 filer
   0/ 1 striper
   0/ 1 objecter
   0/ 5 rados
   0/ 5 rbd
   0/ 5 journaler
   0/ 5 objectcacher
   0/ 5 client
  20/20 osd
   0/ 5 optracker
   0/ 5 objclass
   1/ 3 filestore
   1/ 3 journal
   0/ 5 ms
   1/ 5 mon
   0/10 monc
   0/ 0 paxos
   0/ 5 tp
   1/ 5 auth
   1/ 5 crypto
   1/ 1 finisher
   1/ 5 heartbeatmap
   1/ 5 perfcounter
   1/ 5 rgw
   1/ 5 javaclient
   1/ 5 asok
   1/ 1 throttle
  -2/-2 (syslog threshold)
  -1/-1 (stderr threshold)
  max_recent     10000
  max_new         1000
  log_file /var/log/ceph/ceph-osd.3.log
--- end dump of recent events ---
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux