This is a possible bug which was resolved. It was due to leveldb version. My node is already running on version 1.12. [root at gfsnode5 my-cluster]# rpm -qa | grep -i leveldb leveldb-1.12.0-3.el6.x86_64 [root at gfsnode5 my-cluster]# Thanks, Jimmy From: J L <jlu@xxxxxxxxxxxxx<mailto:jlu at yahoo-inc.com>> Date: Friday, May 2, 2014 at 11:21 AM To: "ceph-users at ceph.com<mailto:ceph-users at ceph.com>" <ceph-users at ceph.com<mailto:ceph-users at ceph.com>> Subject: ceph mom help Hello All, I am using ?ceph-deploy? to setup my ceph cluster with 3 nodes. I am getting an error when running ?sudo ceph-deploy mon create gfsnode5?. Would you someone please give me a pointer what the problem is? Thanks in advance! -Jimmy [cuser at gfsnode5 my-cluster]$ sudo ceph-deploy mon create gfsnode5 [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.1): /usr/bin/ceph-deploy mon create gfsnode5 [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts gfsnode5 [ceph_deploy.mon][DEBUG ] detecting platform for host gfsnode5 ... [gfsnode5][DEBUG ] connected to host: gfsnode5 [gfsnode5][DEBUG ] detect platform information from remote host [gfsnode5][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: Red Hat Enterprise Linux Server 6.5 Santiago [gfsnode5][DEBUG ] determining if provided host has same hostname in remote [gfsnode5][DEBUG ] get remote short hostname [gfsnode5][DEBUG ] deploying mon to gfsnode5 [gfsnode5][DEBUG ] get remote short hostname [gfsnode5][DEBUG ] remote hostname: gfsnode5 [gfsnode5][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [gfsnode5][DEBUG ] create the mon path if it does not exist [gfsnode5][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-gfsnode5/done [gfsnode5][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-gfsnode5/done [gfsnode5][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-gfsnode5.mon.keyring [gfsnode5][DEBUG ] create the monitor keyring file [gfsnode5][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i gfsnode5 --keyring /var/lib/ceph/tmp/ceph-gfsnode5.mon.keyring [gfsnode5][WARNIN] pthread lock: Invalid argument [gfsnode5][WARNIN] *** Caught signal (Aborted) ** [gfsnode5][WARNIN] in thread 7f22e8d737a0 [gfsnode5][WARNIN] ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60) [gfsnode5][WARNIN] 1: ceph-mon() [0x808571] [gfsnode5][WARNIN] 2: /lib64/libpthread.so.0() [0x34aec0f710] [gfsnode5][WARNIN] 3: (gsignal()+0x35) [0x34ae832925] [gfsnode5][WARNIN] 4: (abort()+0x175) [0x34ae834105] [gfsnode5][WARNIN] 5: /usr/lib64/libleveldb.so.1() [0x33bf034d71] [gfsnode5][WARNIN] 6: (leveldb::DBImpl::Get(leveldb::ReadOptions const&, leveldb::Slice const&, leveldb::Value*)+0x50) [0x33bf01a120] [gfsnode5][WARNIN] 7: (LevelDBStore::_get_iterator()+0x41) [0x7773b1] [gfsnode5][WARNIN] 8: (MonitorDBStore::exists(std::string const&, std::string const&)+0x28) [0x5276f8] [gfsnode5][WARNIN] 9: (Monitor::check_fsid()+0x73) [0x550bb3] [gfsnode5][WARNIN] 10: (Monitor::mkfs(ceph::buffer::list&)+0x47) [0x55f027] [gfsnode5][WARNIN] 11: (main()+0x11d7) [0x521f97] [gfsnode5][WARNIN] 12: (__libc_start_main()+0xfd) [0x34ae81ed1d] [gfsnode5][WARNIN] 13: ceph-mon() [0x51fa79] [gfsnode5][WARNIN] 2014-05-02 11:19:46.335854 7f22e8d737a0 -1 *** Caught signal (Aborted) ** [gfsnode5][WARNIN] in thread 7f22e8d737a0 [gfsnode5][WARNIN] [gfsnode5][WARNIN] ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60) [gfsnode5][WARNIN] 1: ceph-mon() [0x808571] [gfsnode5][WARNIN] 2: /lib64/libpthread.so.0() [0x34aec0f710] [gfsnode5][WARNIN] 3: (gsignal()+0x35) [0x34ae832925] [gfsnode5][WARNIN] 4: (abort()+0x175) [0x34ae834105] [gfsnode5][WARNIN] 5: /usr/lib64/libleveldb.so.1() [0x33bf034d71] [gfsnode5][WARNIN] 6: (leveldb::DBImpl::Get(leveldb::ReadOptions const&, leveldb::Slice const&, leveldb::Value*)+0x50) [0x33bf01a120] [gfsnode5][WARNIN] 7: (LevelDBStore::_get_iterator()+0x41) [0x7773b1] [gfsnode5][WARNIN] 8: (MonitorDBStore::exists(std::string const&, std::string const&)+0x28) [0x5276f8] [gfsnode5][WARNIN] 9: (Monitor::check_fsid()+0x73) [0x550bb3] [gfsnode5][WARNIN] 10: (Monitor::mkfs(ceph::buffer::list&)+0x47) [0x55f027] [gfsnode5][WARNIN] 11: (main()+0x11d7) [0x521f97] [gfsnode5][WARNIN] 12: (__libc_start_main()+0xfd) [0x34ae81ed1d] [gfsnode5][WARNIN] 13: ceph-mon() [0x51fa79] [gfsnode5][WARNIN] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. [gfsnode5][WARNIN] [gfsnode5][WARNIN] 0> 2014-05-02 11:19:46.335854 7f22e8d737a0 -1 *** Caught signal (Aborted) ** [gfsnode5][WARNIN] in thread 7f22e8d737a0 [gfsnode5][WARNIN] [gfsnode5][WARNIN] ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60) [gfsnode5][WARNIN] 1: ceph-mon() [0x808571] [gfsnode5][WARNIN] 2: /lib64/libpthread.so.0() [0x34aec0f710] [gfsnode5][WARNIN] 3: (gsignal()+0x35) [0x34ae832925] [gfsnode5][WARNIN] 4: (abort()+0x175) [0x34ae834105] [gfsnode5][WARNIN] 5: /usr/lib64/libleveldb.so.1() [0x33bf034d71] [gfsnode5][WARNIN] 6: (leveldb::DBImpl::Get(leveldb::ReadOptions const&, leveldb::Slice const&, leveldb::Value*)+0x50) [0x33bf01a120] [gfsnode5][WARNIN] 7: (LevelDBStore::_get_iterator()+0x41) [0x7773b1] [gfsnode5][WARNIN] 8: (MonitorDBStore::exists(std::string const&, std::string const&)+0x28) [0x5276f8] [gfsnode5][WARNIN] 9: (Monitor::check_fsid()+0x73) [0x550bb3] [gfsnode5][WARNIN] 10: (Monitor::mkfs(ceph::buffer::list&)+0x47) [0x55f027] [gfsnode5][WARNIN] 11: (main()+0x11d7) [0x521f97] [gfsnode5][WARNIN] 12: (__libc_start_main()+0xfd) [0x34ae81ed1d] [gfsnode5][WARNIN] 13: ceph-mon() [0x51fa79] [gfsnode5][WARNIN] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. [gfsnode5][WARNIN] [gfsnode5][DEBUG ] ceph-mon: mon.noname-a 10.218.50.56:6789/0 is local, renaming to mon.gfsnode5 [gfsnode5][DEBUG ] ceph-mon: set fsid to a1611f3c-c9dc-4426-9798-76b9d73c3b93 [gfsnode5][ERROR ] RuntimeError: command returned non-zero exit status: -6 [ceph_deploy.mon][ERROR ] Failed to execute command: ceph-mon --cluster ceph --mkfs -i gfsnode5 --keyring /var/lib/ceph/tmp/ceph-gfsnode5.mon.keyring [ceph_deploy][ERROR ] GenericError: Failed to create 1 monitors -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140502/7e9f64f4/attachment.htm>