Re: no osds in jewel

LOPEZ Jean-Charles <jelopez@xxxxxxxxxx> · Mon, 6 Jun 2016 08:55:12 -0700

Hi,
first I’f have one remark. You run both a ceph-deploy mon create-initial then a "ceph-deploy mon create + ceph-deploy gatherkeys". Choose one or the other not both.

Then, I notice that you are zapping and deploying using drive /dev/sda which is usually the system disks. So next question is: Is /dev/sda really empty and available for OSDs

I guess that what happened is that because sda is not free and empty, the zap failed as it does not have the force option and then the old create failed because sda could not be prepared/formatted.

Regards
JC

On Jun 5, 2016, at 10:22, Jaemyoun Lee <jaemyoun@xxxxxxxxx> wrote:

Hi, 
When I run below script to install Ceph (10.2.0), I met an error "no osds".
Hammer was installed by the script.
So I think I miss new thing, which was released since Hammer.

Do you know what I miss?

--- The script ---
#!/bin/sh

set -x

ceph-deploy new csElsa
echo "osd pool default size = 1" >> ceph.conf
ceph-deploy install csElsa csAnt csBull csCat
ceph-deploy mon create-initial
ceph-deploy mon create csElsa
ceph-deploy gatherkeys csElsa
ceph-deploy disk zap csAnt:sda
ceph-deploy disk zap csBull:sda
ceph-deploy disk zap csCat:sda
ceph-deploy osd create csAnt:sda csBull:sda csCat:sda
ceph-deploy admin csElsa csElsa csAnt csBull csCat
sudo chmod +r /etc/ceph/ceph.client.admin.keyring
ceph health
--- end ---

--- The result of "ceph -w" ---
# I blocked the IP
jae@csElsa:~/git/ceph$ ceph -w

    cluster 8b2816e9-1953-4157-aaf7-95e9e668fe46
     health HEALTH_ERR
            64 pgs are stuck inactive for more than 300 seconds
            64 pgs stuck inactive
            no osds
     monmap e1: 1 mons at {csElsa=1xx.1xx.2xx.1:6789/0}
            election epoch 3, quorum 0 csElsa
     osdmap e1: 0 osds: 0 up, 0 in
            flags sortbitwise
      pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
            0 kB used, 0 kB / 0 kB avail
                  64 creating

2016-06-06 01:59:08.054985 mon.0 [INF] from='client.? 1xx.1xx.2xx.1:0/1151111687' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.bootstrap-mds", "caps": ["mon", "allow profile bootstrap-mds"]}]': finished
--- end ---

Best regards,
Jae

-- 
  Jaemyoun Lee

  CPS Lab. (Cyber-Physical Systems Laboratory in Hanyang University) 
  E-mail : jaemyoun@xxxxxxxxxxxxx
  Website : http://cpslab.hanyang.ac.kr
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com