Re: upgrade Hammer>Jewel>Luminous OSD fail to start

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thank you all for your suggestions:


This is what i followed for the upgrade:

Hammer to Jewel:
apt-get dist-upgrade on each node seperately.
stopped monitor process;
stopped osd;
changed permission to ceph:ceph recursively for /var/lib/ceph/
restarted monitor process;
restarted osd;
ceph osd set require_jewel_osds;

ceph osd set sortbitwise;


verified with
ceph -s
rados bench

Jewel to Luminous
apt-get dist-upgrade on each node.
stopped monitor process;
stopped osd process;
restarted monitor;
restarted osd process;

Result:
osd is not coming up

Steps tried to resolve:
rebooted all nodes;


upgrade from Hammer to Jewel was almost smooth but Jewel to Luminous OSD is not coming up.

Any suggestions on where to check for clue.


Regards,
Kev

On Wed, Sep 13, 2017 at 1:17 AM, Lincoln Bryant <lincolnb@xxxxxxxxxxxx> wrote:
Did you set the sortbitwise flag, fix OSD ownership (or use the "setuser match path" option) and such after upgrading from Hammer to Jewel? I am not sure if that matters here, but it might help if you elaborate on your upgrade process a bit.

--Lincoln

> On Sep 12, 2017, at 2:22 PM, kevin parrikar <kevin.parker092@xxxxxxxxx> wrote:
>
> Can some one please help me on this.I have no idea how to bring up the cluster to operational state.
>
> Thanks,
> Kev
>
> On Tue, Sep 12, 2017 at 11:12 AM, kevin parrikar <kevin.parker092@xxxxxxxxx> wrote:
> hello All,
> I am trying to upgrade a small test setup having one monitor and one osd node which is in hammer release .
>
>
> I updating from hammer to jewel using package update commands and things are working.
> How ever after updating from Jewel to Luminous, i am facing issues with osd failing to start .
>
> upgraded packages on both nodes and i can see in "ceph mon versions" is successful
>
>  ceph mon versions
> {
>     "ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)": 1
> }
>
> but  ceph osd versions returns empty strig
>
>
> ceph osd versions
> {}
>
>
> dpkg --list|grep ceph
> ii  ceph                                 12.2.0-1trusty                             amd64        distributed storage and file system
> ii  ceph-base                            12.2.0-1trusty                             amd64        common ceph daemon libraries and management tools
> ii  ceph-common                          12.2.0-1trusty                             amd64        common utilities to mount and interact with a ceph storage cluster
> ii  ceph-deploy                          1.5.38                                     all          Ceph-deploy is an easy to use configuration tool
> ii  ceph-mgr                             12.2.0-1trusty                             amd64        manager for the ceph distributed storage system
> ii  ceph-mon                             12.2.0-1trusty                             amd64        monitor server for the ceph storage system
> ii  ceph-osd                             12.2.0-1trusty                             amd64        OSD server for the ceph storage system
> ii  libcephfs1                           10.2.9-1trusty                             amd64        Ceph distributed file system client library
> ii  libcephfs2                           12.2.0-1trusty                             amd64        Ceph distributed file system client library
> ii  python-cephfs                        12.2.0-1trusty                             amd64        Python 2 libraries for the Ceph libcephfs library
>
> from OSD log:
>
> 2017-09-12 05:38:10.618023 7fc307a10d00  0 set uid:gid to 64045:64045 (ceph:ceph)
> 2017-09-12 05:38:10.618618 7fc307a10d00  0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 21513
> 2017-09-12 05:38:10.624473 7fc307a10d00  0 pidfile_write: ignore empty --pid-file
> 2017-09-12 05:38:10.633099 7fc307a10d00  0 load: jerasure load: lrc load: isa
> 2017-09-12 05:38:10.633657 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) backend xfs (magic 0x58465342)
> 2017-09-12 05:38:10.635164 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) backend xfs (magic 0x58465342)
> 2017-09-12 05:38:10.637503 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
> 2017-09-12 05:38:10.637833 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
> 2017-09-12 05:38:10.637923 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: splice() is disabled via 'filestore splice' config option
> 2017-09-12 05:38:10.639047 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
> 2017-09-12 05:38:10.639501 7fc307a10d00  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_feature: extsize is disabled by conf
> 2017-09-12 05:38:10.640417 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) start omap initiation
> 2017-09-12 05:38:10.640842 7fc307a10d00  1 leveldb: Recovering log #102
> 2017-09-12 05:38:10.642690 7fc307a10d00  1 leveldb: Delete type=0 #102
>
> 2017-09-12 05:38:10.643128 7fc307a10d00  1 leveldb: Delete type=3 #101
>
> 2017-09-12 05:38:10.649616 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) mount(1758): enabling WRITEAHEAD journal mode: checkpoint is not enabled
> 2017-09-12 05:38:10.654071 7fc307a10d00 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
> 2017-09-12 05:38:10.654590 7fc307a10d00  1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 28: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
> 2017-09-12 05:38:10.655353 7fc307a10d00  1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 28: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
> 2017-09-12 05:38:10.656985 7fc307a10d00  1 filestore(/var/lib/ceph/osd/ceph-0) upgrade(1365)
> 2017-09-12 05:38:10.657798 7fc307a10d00  0 _get_class not permitted to load sdk
> 2017-09-12 05:38:10.658675 7fc307a10d00  0 _get_class not permitted to load lua
> 2017-09-12 05:38:10.658931 7fc307a10d00  0 <cls> /build/ceph-12.2.0/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
> 2017-09-12 05:38:10.659320 7fc307a10d00  0 <cls> /build/ceph-12.2.0/src/cls/hello/cls_hello.cc:296: loading cls_hello
> 2017-09-12 05:38:10.662854 7fc307a10d00  0 _get_class not permitted to load kvs
> 2017-09-12 05:38:10.663621 7fc307a10d00 -1 osd.0 0 failed to load OSD map for epoch 32, got 0 bytes
> 2017-09-12 05:38:10.666670 7fc307a10d00 -1 /build/ceph-12.2.0/src/osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7fc307a10d00 time 2017-09-12 05:38:10.663866
> /build/ceph-12.2.0/src/osd/OSD.h: 976: FAILED assert(ret)
>
>  ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
>  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x10e) [0xc2653bcb4e]
>  2: (OSDService::get_map(unsigned int)+0x3d) [0xc264ed0eed]
>  3: (OSD::init()+0x2032) [0xc264e873b2]
>  4: (main()+0x2ba8) [0xc264d8ef98]
>  5: (__libc_start_main()+0xf5) [0x7fc304f38f45]
>  6: (()+0x4b0006) [0xc264e2d006]
>  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
>    -91> 2017-09-12 05:38:10.609328 7fc307a10d00  5 asok(0xc26ea401c0) register_command perfcounters_dump hook 0xc26e9ec180
>    -90> 2017-09-12 05:38:10.609352 7fc307a10d00  5 asok(0xc26ea401c0) register_command 1 hook 0xc26e9ec180
>    -89> 2017-09-12 05:38:10.609356 7fc307a10d00  5 asok(0xc26ea401c0) register_command perf dump hook 0xc26e9ec180
>    -88> 2017-09-12 05:38:10.609359 7fc307a10d00  5 asok(0xc26ea401c0) register_command perfcounters_schema hook 0xc26e9ec180
>    -87> 2017-09-12 05:38:10.609362 7fc307a10d00  5 asok(0xc26ea401c0) register_command perf histogram dump hook 0xc26e9ec180
>    -86> 2017-09-12 05:38:10.609364 7fc307a10d00  5 asok(0xc26ea401c0) register_command 2 hook 0xc26e9ec180
>    -85> 2017-09-12 05:38:10.609366 7fc307a10d00  5 asok(0xc26ea401c0) register_command perf schema hook 0xc26e9ec180
>    -84> 2017-09-12 05:38:10.609368 7fc307a10d00  5 asok(0xc26ea401c0) register_command perf histogram schema hook 0xc26e9ec180
>    -83> 2017-09-12 05:38:10.609370 7fc307a10d00  5 asok(0xc26ea401c0) register_command perf reset hook 0xc26e9ec180
>    -82> 2017-09-12 05:38:10.609372 7fc307a10d00  5 asok(0xc26ea401c0) register_command config show hook 0xc26e9ec180
>    -81> 2017-09-12 05:38:10.609374 7fc307a10d00  5 asok(0xc26ea401c0) register_command config help hook 0xc26e9ec180
>    -80> 2017-09-12 05:38:10.609377 7fc307a10d00  5 asok(0xc26ea401c0) register_command config set hook 0xc26e9ec180
>    -79> 2017-09-12 05:38:10.609381 7fc307a10d00  5 asok(0xc26ea401c0) register_command config get hook 0xc26e9ec180
>    -78> 2017-09-12 05:38:10.609383 7fc307a10d00  5 asok(0xc26ea401c0) register_command config diff hook 0xc26e9ec180
>    -77> 2017-09-12 05:38:10.609385 7fc307a10d00  5 asok(0xc26ea401c0) register_command config diff get hook 0xc26e9ec180
>    -76> 2017-09-12 05:38:10.609388 7fc307a10d00  5 asok(0xc26ea401c0) register_command log flush hook 0xc26e9ec180
>    -75> 2017-09-12 05:38:10.609390 7fc307a10d00  5 asok(0xc26ea401c0) register_command log dump hook 0xc26e9ec180
>    -74> 2017-09-12 05:38:10.609392 7fc307a10d00  5 asok(0xc26ea401c0) register_command log reopen hook 0xc26e9ec180
>    -73> 2017-09-12 05:38:10.609400 7fc307a10d00  5 asok(0xc26ea401c0) register_command dump_mempools hook 0xc26ebc38e8
>    -72> 2017-09-12 05:38:10.618023 7fc307a10d00  0 set uid:gid to 64045:64045 (ceph:ceph)
>    -71> 2017-09-12 05:38:10.618618 7fc307a10d00  0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 21513
>    -70> 2017-09-12 05:38:10.623733 7fc301c39700  2 Event(0xc26ea2a080 nevent=5000 time_id=1).set_owner idx=2 owner=140475524945664
>    -69> 2017-09-12 05:38:10.623773 7fc30243a700  2 Event(0xc26ea29c80 nevent=5000 time_id=1).set_owner idx=1 owner=140475533338368
>    -68> 2017-09-12 05:38:10.623789 7fc302c3b700  2 Event(0xc26ea29880 nevent=5000 time_id=1).set_owner idx=0 owner=140475541731072
>    -67> 2017-09-12 05:38:10.624317 7fc307a10d00  1 -- 192.168.10.7:0/0 learned_addr learned my addr 192.168.10.7:0/0
>    -66> 2017-09-12 05:38:10.624330 7fc307a10d00  1 -- 192.168.10.7:6800/21513 _finish_bind bind my_inst.addr is 192.168.10.7:6800/21513
>    -65> 2017-09-12 05:38:10.624371 7fc307a10d00  1 -- 192.168.10.7:0/0 learned_addr learned my addr 192.168.10.7:0/0
>    -64> 2017-09-12 05:38:10.624376 7fc307a10d00  1 -- 192.168.10.7:6801/21513 _finish_bind bind my_inst.addr is 192.168.10.7:6801/21513
>    -63> 2017-09-12 05:38:10.624413 7fc307a10d00  1 -- 192.168.10.7:0/0 learned_addr learned my addr 192.168.10.7:0/0
>    -62> 2017-09-12 05:38:10.624418 7fc307a10d00  1 -- 192.168.10.7:6802/21513 _finish_bind bind my_inst.addr is 192.168.10.7:6802/21513
>    -61> 2017-09-12 05:38:10.624465 7fc307a10d00  1 -- 192.168.10.7:0/0 learned_addr learned my addr 192.168.10.7:0/0
>    -60> 2017-09-12 05:38:10.624470 7fc307a10d00  1 -- 192.168.10.7:6803/21513 _finish_bind bind my_inst.addr is 192.168.10.7:6803/21513
>    -59> 2017-09-12 05:38:10.624473 7fc307a10d00  0 pidfile_write: ignore empty --pid-file
>    -58> 2017-09-12 05:38:10.626638 7fc307a10d00  5 asok(0xc26ea401c0) init /var/run/ceph/ceph-osd.0.asok
>    -57> 2017-09-12 05:38:10.626659 7fc307a10d00  5 asok(0xc26ea401c0) bind_and_listen /var/run/ceph/ceph-osd.0.asok
>    -56> 2017-09-12 05:38:10.626809 7fc307a10d00  5 asok(0xc26ea401c0) register_command 0 hook 0xc26e9e8178
>    -55> 2017-09-12 05:38:10.626817 7fc307a10d00  5 asok(0xc26ea401c0) register_command version hook 0xc26e9e8178
>    -54> 2017-09-12 05:38:10.626821 7fc307a10d00  5 asok(0xc26ea401c0) register_command git_version hook 0xc26e9e8178
>    -53> 2017-09-12 05:38:10.626826 7fc307a10d00  5 asok(0xc26ea401c0) register_command help hook 0xc26e9ec620
>    -52> 2017-09-12 05:38:10.626830 7fc307a10d00  5 asok(0xc26ea401c0) register_command get_command_descriptions hook 0xc26e9ec630
>    -51> 2017-09-12 05:38:10.627035 7fc307a10d00 10 monclient: build_initial_monmap
>    -50> 2017-09-12 05:38:10.631362 7fc3004b9700  5 asok(0xc26ea401c0) entry start
> -49> 2017-09-12 05:38:10.633099 7fc307a10d00  0 load: jerasure load: lrc load: isa
>    -48> 2017-09-12 05:38:10.633416 7fc307a10d00  5 adding auth protocol: cephx
>    -47> 2017-09-12 05:38:10.633428 7fc307a10d00  5 adding auth protocol: cephx
>    -46> 2017-09-12 05:38:10.633657 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) backend xfs (magic 0x58465342)
>    -45> 2017-09-12 05:38:10.634003 7fc307a10d00  5 asok(0xc26ea401c0) register_command objecter_requests hook 0xc26e9ec6b0
>    -44> 2017-09-12 05:38:10.634495 7fc307a10d00  1 -- 192.168.10.7:6800/21513 start start
>    -43> 2017-09-12 05:38:10.634533 7fc307a10d00  1 -- - start start
>    -42> 2017-09-12 05:38:10.634541 7fc307a10d00  1 -- - start start
>    -41> 2017-09-12 05:38:10.634549 7fc307a10d00  1 -- 192.168.10.7:6803/21513 start start
>    -40> 2017-09-12 05:38:10.634558 7fc307a10d00  1 -- 192.168.10.7:6802/21513 start start
>    -39> 2017-09-12 05:38:10.634567 7fc307a10d00  1 -- 192.168.10.7:6801/21513 start start
>    -38> 2017-09-12 05:38:10.634575 7fc307a10d00  1 -- - start start
>    -37> 2017-09-12 05:38:10.634691 7fc307a10d00  2 osd.0 0 init /var/lib/ceph/osd/ceph-0 (looks like hdd)
>    -36> 2017-09-12 05:38:10.634707 7fc307a10d00  2 osd.0 0 journal /var/lib/ceph/osd/ceph-0/journal
>    -35> 2017-09-12 05:38:10.635164 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) backend xfs (magic 0x58465342)
>    -34> 2017-09-12 05:38:10.637503 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
>    -33> 2017-09-12 05:38:10.637833 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
>    -32> 2017-09-12 05:38:10.637923 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: splice() is disabled via 'filestore splice' config option
>    -31> 2017-09-12 05:38:10.639047 7fc307a10d00  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
>    -30> 2017-09-12 05:38:10.639501 7fc307a10d00  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_feature: extsize is disabled by conf
>    -29> 2017-09-12 05:38:10.640417 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) start omap initiation
>    -28> 2017-09-12 05:38:10.640842 7fc307a10d00  1 leveldb: Recovering log #102
>    -27> 2017-09-12 05:38:10.642690 7fc307a10d00  1 leveldb: Delete type=0 #102
>
>    -26> 2017-09-12 05:38:10.643128 7fc307a10d00  1 leveldb: Delete type=3 #101
>
>    -25> 2017-09-12 05:38:10.649616 7fc307a10d00  0 filestore(/var/lib/ceph/osd/ceph-0) mount(1758): enabling WRITEAHEAD journal mode: checkpoint is not enabled
>    -24> 2017-09-12 05:38:10.654012 7fc307a10d00  2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 98b01515-17b3-4feb-be80-efd53724bd53 fs_op_seq 8433
>    -23> 2017-09-12 05:38:10.654071 7fc307a10d00 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
>    -22> 2017-09-12 05:38:10.654590 7fc307a10d00  1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 28: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
>    -21> 2017-09-12 05:38:10.655322 7fc307a10d00  2 journal No further valid entries found, journal is most likely valid
>    -20> 2017-09-12 05:38:10.655332 7fc307a10d00  2 journal No further valid entries found, journal is most likely valid
>    -19> 2017-09-12 05:38:10.655333 7fc307a10d00  3 journal journal_replay: end of journal, done.
>    -18> 2017-09-12 05:38:10.655353 7fc307a10d00  1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 28: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
>    -17> 2017-09-12 05:38:10.656985 7fc307a10d00  1 filestore(/var/lib/ceph/osd/ceph-0) upgrade(1365)
>    -16> 2017-09-12 05:38:10.657383 7fc307a10d00  2 osd.0 0 journal looks like hdd
>    -15> 2017-09-12 05:38:10.657406 7fc307a10d00  2 osd.0 0 boot
>    -14> 2017-09-12 05:38:10.657798 7fc307a10d00  0 _get_class not permitted to load sdk
>    -13> 2017-09-12 05:38:10.658283 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/user/cls_user.cc:365: Loaded user class!
> -12> 2017-09-12 05:38:10.658675 7fc307a10d00  0 _get_class not permitted to load lua
>    -11> 2017-09-12 05:38:10.658931 7fc307a10d00  0 <cls> /build/ceph-12.2.0/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
>    -10> 2017-09-12 05:38:10.659320 7fc307a10d00  0 <cls> /build/ceph-12.2.0/src/cls/hello/cls_hello.cc:296: loading cls_hello
>     -9> 2017-09-12 05:38:10.659577 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/timeindex/cls_timeindex.cc:242: Loaded timeindex class!
>     -8> 2017-09-12 05:38:10.659683 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/version/cls_version.cc:214: Loaded version class!
>     -7> 2017-09-12 05:38:10.660926 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/rgw/cls_rgw.cc:3775: Loaded rgw class!
>     -6> 2017-09-12 05:38:10.661461 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/replica_log/cls_replica_log.cc:135: Loaded replica log class!
>     -5> 2017-09-12 05:38:10.662810 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/refcount/cls_refcount.cc:222: Loaded refcount class!
>     -4> 2017-09-12 05:38:10.662854 7fc307a10d00  0 _get_class not permitted to load kvs
>     -3> 2017-09-12 05:38:10.663355 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/log/cls_log.cc:299: Loaded log class!
>     -2> 2017-09-12 05:38:10.663535 7fc307a10d00  1 <cls> /build/ceph-12.2.0/src/cls/statelog/cls_statelog.cc:279: Loaded log class!
>     -1> 2017-09-12 05:38:10.663621 7fc307a10d00 -1 osd.0 0 failed to load OSD map for epoch 32, got 0 bytes
>      0> 2017-09-12 05:38:10.666670 7fc307a10d00 -1 /build/ceph-12.2.0/src/osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7fc307a10d00 time 2017-09-12 05:38:10.663866
> /build/ceph-12.2.0/src/osd/OSD.h: 976: FAILED assert(ret)
>
>  ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
>  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x10e) [0xc2653bcb4e]
>  2: (OSDService::get_map(unsigned int)+0x3d) [0xc264ed0eed]
>  3: (OSD::init()+0x2032) [0xc264e873b2]
>  4: (main()+0x2ba8) [0xc264d8ef98]
>  5: (__libc_start_main()+0xf5) [0x7fc304f38f45]
>  6: (()+0x4b0006) [0xc264e2d006]
>  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
>
> --- logging levels ---
>    0/ 5 none
>    0/ 1 lockdep
>    0/ 1 context
>    1/ 1 crush
>    1/ 5 mds
>    1/ 5 mds_balancer
>    1/ 5 mds_locker
>    1/ 5 mds_log
>    1/ 5 mds_log_expire
>    1/ 5 mds_migrator
>    0/ 1 buffer
>    0/ 1 timer
>    0/ 1 filer
>    0/ 1 striper
>    0/ 1 objecter
>    0/ 5 rados
>    0/ 5 rbd
> 0/ 5 rbd_mirror
>    0/ 5 rbd_replay
>    0/ 5 journaler
>    0/ 5 objectcacher
>    0/ 5 client
>    1/ 5 osd
>    0/ 5 optracker
>    0/ 5 objclass
>    1/ 3 filestore
>    1/ 3 journal
>    0/ 5 ms
>    1/ 5 mon
>    0/10 monc
>    1/ 5 paxos
>    0/ 5 tp
>    1/ 5 auth
>    1/ 5 crypto
>    1/ 1 finisher
>    1/ 5 heartbeatmap
>    1/ 5 perfcounter
>    1/ 5 rgw
>    1/10 civetweb
>    1/ 5 javaclient
>    1/ 5 asok
>    1/ 1 throttle
>    0/ 0 refs
>    1/ 5 xio
>    1/ 5 compressor
>    1/ 5 bluestore
>    1/ 5 bluefs
>    1/ 3 bdev
>    1/ 5 kstore
>    4/ 5 rocksdb
>    4/ 5 leveldb
>    4/ 5 memdb
>    1/ 5 kinetic
>    1/ 5 fuse
>    1/ 5 mgr
>    1/ 5 mgrc
>    1/ 5 dpdk
>    1/ 5 eventtrace
>   99/99 (syslog threshold)
>  -1/-1 (stderr threshold)
>   max_recent     10000
>   max_new         1000
>   log_file /var/log/ceph/ceph-osd.0.log
> --- end dump of recent events ---
> 2017-09-12 05:38:10.679335 7fc307a10d00 -1 *** Caught signal (Aborted) **
>  in thread 7fc307a10d00 thread_name:ceph-osd
>
>  ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
>  1: (()+0xa03229) [0xc265380229]
>  2: (()+0x10330) [0x7fc305f2d330]
>  3: (gsignal()+0x37) [0x7fc304f4dc37]
>  4: (abort()+0x148) [0x7fc304f51028]
>  5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x280) [0xc2653bccc0]
>  6: (OSDService::get_map(unsigned int)+0x3d) [0xc264ed0eed]
>  7: (OSD::init()+0x2032) [0xc264e873b2]
>  8: (main()+0x2ba8) [0xc264d8ef98]
>  9: (__libc_start_main()+0xf5) [0x7fc304f38f45]
>  10: (()+0x4b0006) [0xc264e2d006]
>  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
>
> --- begin dump of recent events ---
>      0> 2017-09-12 05:38:10.679335 7fc307a10d00 -1 *** Caught signal (Aborted) **
>  in thread 7fc307a10d00 thread_name:ceph-osd
>
>  ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
>  1: (()+0xa03229) [0xc265380229]
>  2: (()+0x10330) [0x7fc305f2d330]
>  3: (gsignal()+0x37) [0x7fc304f4dc37]
>  4: (abort()+0x148) [0x7fc304f51028]
>  5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x280) [0xc2653bccc0]
>  6: (OSDService::get_map(unsigned int)+0x3d) [0xc264ed0eed]
>  7: (OSD::init()+0x2032) [0xc264e873b2]
>  8: (main()+0x2ba8) [0xc264d8ef98]
>  9: (__libc_start_main()+0xf5) [0x7fc304f38f45]
>  10: (()+0x4b0006) [0xc264e2d006]
>  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
>
> --- logging levels ---
>    0/ 5 none
>    0/ 1 lockdep
>    0/ 1 context
>    1/ 1 crush
>
>
>
> can some one help me fix this issue..
>
> Regards,
> Kev
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux