Hello!
I'm novice in ceph and I try to install my first cluster.
Follow command does not create the keys and monitors did not start.
Files /etc/hosts and /etc/ceph/ceph.conf I typed at the end of this letter.
What I do make not thus?
[ceph@ceph-vm05 ~]$ ceph-deploy --overwrite-conf mon create-initial
[ceph_deploy.conf][DEBUG ] found configuration file at:
/home/ceph/.cephdeploy.conf
[ceph_deploy.cli][INFO ] Invoked (1.5.11): /usr/bin/ceph-deploy
--overwrite-conf mon create-initial
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-vm01
ceph-vm02 ceph-vm03 ceph-vm04
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-vm01 ...
The authenticity of host 'ceph-vm01 (192.168.10.210)' can't be established.
RSA key fingerprint is b3:bb:81:9d:e7:a1:1b:b6:33:01:19:6c:d5:54:8d:25.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'ceph-vm01' (RSA) to the list of known hosts.
[ceph-vm01][DEBUG ] connected to host: ceph-vm01
[ceph-vm01][DEBUG ] detect platform information from remote host
[ceph-vm01][DEBUG ] detect machine type
[ceph_deploy.mon][INFO ] distro info: CentOS 6.6 Final
[ceph-vm01][DEBUG ] determining if provided host has same hostname in remote
[ceph-vm01][DEBUG ] get remote short hostname
[ceph-vm01][DEBUG ] deploying mon to ceph-vm01
[ceph-vm01][DEBUG ] get remote short hostname
[ceph-vm01][DEBUG ] remote hostname: ceph-vm01
[ceph-vm01][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-vm01][DEBUG ] create the mon path if it does not exist
[ceph-vm01][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-ceph-vm01/done
[ceph-vm01][DEBUG ] create a done file to avoid re-doing the mon deployment
[ceph-vm01][DEBUG ] create the init path if it does not exist
[ceph-vm01][DEBUG ] locating the `service` executable...
[ceph-vm01][INFO ] Running command: sudo /sbin/service ceph -c
/etc/ceph/ceph.conf start mon.ceph-vm01
[ceph-vm01][DEBUG ] === mon.ceph-vm01 ===
[ceph-vm01][DEBUG ] Starting Ceph mon.ceph-vm01 on ceph-vm01...
[ceph-vm01][DEBUG ] Starting ceph-create-keys on ceph-vm01...
[ceph-vm01][WARNIN] No data was received after 7 seconds, disconnecting...
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph-vm01][DEBUG ]
********************************************************************************
[ceph-vm01][DEBUG ] status for monitor: mon.ceph-vm01
[ceph-vm01][DEBUG ] {
[ceph-vm01][DEBUG ] "election_epoch": 0,
[ceph-vm01][DEBUG ] "extra_probe_peers": [
[ceph-vm01][DEBUG ] "192.168.10.212:6789/0",
[ceph-vm01][DEBUG ] "192.168.10.213:6789/0"
[ceph-vm01][DEBUG ] ],
[ceph-vm01][DEBUG ] "monmap": {
[ceph-vm01][DEBUG ] "created": "0.000000",
[ceph-vm01][DEBUG ] "epoch": 0,
[ceph-vm01][DEBUG ] "fsid": "c0d39a49-2656-4c61-8bde-de7be3b8b51d",
[ceph-vm01][DEBUG ] "modified": "0.000000",
[ceph-vm01][DEBUG ] "mons": [
[ceph-vm01][DEBUG ] {
[ceph-vm01][DEBUG ] "addr": "192.168.10.210:6789/0",
[ceph-vm01][DEBUG ] "name": "ceph-vm01",
[ceph-vm01][DEBUG ] "rank": 0
[ceph-vm01][DEBUG ] },
[ceph-vm01][DEBUG ] {
[ceph-vm01][DEBUG ] "addr": "0.0.0.0:0/1",
[ceph-vm01][DEBUG ] "name": "ceph-vm02",
[ceph-vm01][DEBUG ] "rank": 1
[ceph-vm01][DEBUG ] },
[ceph-vm01][DEBUG ] {
[ceph-vm01][DEBUG ] "addr": "0.0.0.0:0/2",
[ceph-vm01][DEBUG ] "name": "ceph-vm03",
[ceph-vm01][DEBUG ] "rank": 2
[ceph-vm01][DEBUG ] },
[ceph-vm01][DEBUG ] {
[ceph-vm01][DEBUG ] "addr": "0.0.0.0:0/3",
[ceph-vm01][DEBUG ] "name": "ceph-vm04",
[ceph-vm01][DEBUG ] "rank": 3
[ceph-vm01][DEBUG ] }
[ceph-vm01][DEBUG ] ]
[ceph-vm01][DEBUG ] },
[ceph-vm01][DEBUG ] "name": "ceph-vm01",
[ceph-vm01][DEBUG ] "outside_quorum": [
[ceph-vm01][DEBUG ] "ceph-vm01"
[ceph-vm01][DEBUG ] ],
[ceph-vm01][DEBUG ] "quorum": [],
[ceph-vm01][DEBUG ] "rank": 0,
[ceph-vm01][DEBUG ] "state": "probing",
[ceph-vm01][DEBUG ] "sync_provider": []
[ceph-vm01][DEBUG ] }
[ceph-vm01][DEBUG ]
********************************************************************************
[ceph-vm01][INFO ] monitor: mon.ceph-vm01 is running
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-vm02 ...
The authenticity of host 'ceph-vm02 (192.168.10.211)' can't be established.
RSA key fingerprint is e3:15:ee:13:78:6f:e1:c6:54:6b:0d:e0:30:c7:14:7a.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'ceph-vm02' (RSA) to the list of known hosts.
[ceph-vm02][DEBUG ] connected to host: ceph-vm02
[ceph-vm02][DEBUG ] detect platform information from remote host
[ceph-vm02][DEBUG ] detect machine type
[ceph_deploy.mon][INFO ] distro info: CentOS 6.6 Final
[ceph-vm02][DEBUG ] determining if provided host has same hostname in remote
[ceph-vm02][DEBUG ] get remote short hostname
[ceph-vm02][DEBUG ] deploying mon to ceph-vm02
[ceph-vm02][DEBUG ] get remote short hostname
[ceph-vm02][DEBUG ] remote hostname: ceph-vm02
[ceph-vm02][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-vm02][DEBUG ] create the mon path if it does not exist
[ceph-vm02][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-ceph-vm02/done
[ceph-vm02][DEBUG ] create a done file to avoid re-doing the mon deployment
[ceph-vm02][DEBUG ] create the init path if it does not exist
[ceph-vm02][DEBUG ] locating the `service` executable...
[ceph-vm02][INFO ] Running command: sudo /sbin/service ceph -c
/etc/ceph/ceph.conf start mon.ceph-vm02
[ceph-vm02][DEBUG ] === mon.ceph-vm02 ===
[ceph-vm02][DEBUG ] Starting Ceph mon.ceph-vm02 on ceph-vm02...
[ceph-vm02][DEBUG ] Starting ceph-create-keys on ceph-vm02...
[ceph-vm02][WARNIN] No data was received after 7 seconds, disconnecting...
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph-vm02][DEBUG ]
********************************************************************************
[ceph-vm02][DEBUG ] status for monitor: mon.ceph-vm02
[ceph-vm02][DEBUG ] {
[ceph-vm02][DEBUG ] "election_epoch": 0,
[ceph-vm02][DEBUG ] "extra_probe_peers": [
[ceph-vm02][DEBUG ] "192.168.10.212:6789/0",
[ceph-vm02][DEBUG ] "192.168.10.213:6789/0"
[ceph-vm02][DEBUG ] ],
[ceph-vm02][DEBUG ] "monmap": {
[ceph-vm02][DEBUG ] "created": "0.000000",
[ceph-vm02][DEBUG ] "epoch": 0,
[ceph-vm02][DEBUG ] "fsid": "c0d39a49-2656-4c61-8bde-de7be3b8b51d",
[ceph-vm02][DEBUG ] "modified": "0.000000",
[ceph-vm02][DEBUG ] "mons": [
[ceph-vm02][DEBUG ] {
[ceph-vm02][DEBUG ] "addr": "192.168.10.211:6789/0",
[ceph-vm02][DEBUG ] "name": "ceph-vm02",
[ceph-vm02][DEBUG ] "rank": 0
[ceph-vm02][DEBUG ] },
[ceph-vm02][DEBUG ] {
[ceph-vm02][DEBUG ] "addr": "0.0.0.0:0/1",
[ceph-vm02][DEBUG ] "name": "ceph-vm01",
[ceph-vm02][DEBUG ] "rank": 1
[ceph-vm02][DEBUG ] },
[ceph-vm02][DEBUG ] {
[ceph-vm02][DEBUG ] "addr": "0.0.0.0:0/2",
[ceph-vm02][DEBUG ] "name": "ceph-vm03",
[ceph-vm02][DEBUG ] "rank": 2
[ceph-vm02][DEBUG ] },
[ceph-vm02][DEBUG ] {
[ceph-vm02][DEBUG ] "addr": "0.0.0.0:0/3",
[ceph-vm02][DEBUG ] "name": "ceph-vm04",
[ceph-vm02][DEBUG ] "rank": 3
[ceph-vm02][DEBUG ] }
[ceph-vm02][DEBUG ] ]
[ceph-vm02][DEBUG ] },
[ceph-vm02][DEBUG ] "name": "ceph-vm02",
[ceph-vm02][DEBUG ] "outside_quorum": [
[ceph-vm02][DEBUG ] "ceph-vm02"
[ceph-vm02][DEBUG ] ],
[ceph-vm02][DEBUG ] "quorum": [],
[ceph-vm02][DEBUG ] "rank": 0,
[ceph-vm02][DEBUG ] "state": "probing",
[ceph-vm02][DEBUG ] "sync_provider": []
[ceph-vm02][DEBUG ] }
[ceph-vm02][DEBUG ]
********************************************************************************
[ceph-vm02][INFO ] monitor: mon.ceph-vm02 is running
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-vm03 ...
The authenticity of host 'ceph-vm03 (192.168.10.212)' can't be established.
RSA key fingerprint is d8:24:59:62:35:34:54:75:2d:82:0e:57:81:0d:15:dd.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'ceph-vm03' (RSA) to the list of known hosts.
[ceph-vm03][DEBUG ] connected to host: ceph-vm03
[ceph-vm03][DEBUG ] detect platform information from remote host
[ceph-vm03][DEBUG ] detect machine type
[ceph_deploy.mon][INFO ] distro info: CentOS 6.6 Final
[ceph-vm03][DEBUG ] determining if provided host has same hostname in remote
[ceph-vm03][DEBUG ] get remote short hostname
[ceph-vm03][DEBUG ] deploying mon to ceph-vm03
[ceph-vm03][DEBUG ] get remote short hostname
[ceph-vm03][DEBUG ] remote hostname: ceph-vm03
[ceph-vm03][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-vm03][DEBUG ] create the mon path if it does not exist
[ceph-vm03][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-ceph-vm03/done
[ceph-vm03][DEBUG ] create a done file to avoid re-doing the mon deployment
[ceph-vm03][DEBUG ] create the init path if it does not exist
[ceph-vm03][DEBUG ] locating the `service` executable...
[ceph-vm03][INFO ] Running command: sudo /sbin/service ceph -c
/etc/ceph/ceph.conf start mon.ceph-vm03
[ceph-vm03][DEBUG ] === mon.ceph-vm03 ===
[ceph-vm03][DEBUG ] Starting Ceph mon.ceph-vm03 on ceph-vm03...already
running
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph-vm03][DEBUG ]
********************************************************************************
[ceph-vm03][DEBUG ] status for monitor: mon.ceph-vm03
[ceph-vm03][DEBUG ] {
[ceph-vm03][DEBUG ] "election_epoch": 0,
[ceph-vm03][DEBUG ] "extra_probe_peers": [
[ceph-vm03][DEBUG ] "192.168.10.212:6789/0",
[ceph-vm03][DEBUG ] "192.168.10.213:6789/0"
[ceph-vm03][DEBUG ] ],
[ceph-vm03][DEBUG ] "monmap": {
[ceph-vm03][DEBUG ] "created": "0.000000",
[ceph-vm03][DEBUG ] "epoch": 0,
[ceph-vm03][DEBUG ] "fsid": "c0d39a49-2656-4c61-8bde-de7be3b8b51d",
[ceph-vm03][DEBUG ] "modified": "0.000000",
[ceph-vm03][DEBUG ] "mons": [
[ceph-vm03][DEBUG ] {
[ceph-vm03][DEBUG ] "addr": "0.0.0.0:0/1",
[ceph-vm03][DEBUG ] "name": "mon03",
[ceph-vm03][DEBUG ] "rank": 0
[ceph-vm03][DEBUG ] },
[ceph-vm03][DEBUG ] {
[ceph-vm03][DEBUG ] "addr": "0.0.0.0:0/2",
[ceph-vm03][DEBUG ] "name": "mon04",
[ceph-vm03][DEBUG ] "rank": 1
[ceph-vm03][DEBUG ] }
[ceph-vm03][DEBUG ] ]
[ceph-vm03][DEBUG ] },
[ceph-vm03][DEBUG ] "name": "ceph-vm03",
[ceph-vm03][DEBUG ] "outside_quorum": [],
[ceph-vm03][DEBUG ] "quorum": [],
[ceph-vm03][DEBUG ] "rank": -1,
[ceph-vm03][DEBUG ] "state": "probing",
[ceph-vm03][DEBUG ] "sync_provider": []
[ceph-vm03][DEBUG ] }
[ceph-vm03][DEBUG ]
********************************************************************************
[ceph-vm03][INFO ] monitor: mon.ceph-vm03 is currently at the state of
probing
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph-vm03][WARNIN] monitor ceph-vm03 does not exist in monmap
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-vm04 ...
The authenticity of host 'ceph-vm04 (192.168.10.213)' can't be established.
RSA key fingerprint is 83:2d:ed:12:56:a5:4b:89:92:bb:34:30:53:b9:44:f9.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'ceph-vm04' (RSA) to the list of known hosts.
[ceph-vm04][DEBUG ] connected to host: ceph-vm04
[ceph-vm04][DEBUG ] detect platform information from remote host
[ceph-vm04][DEBUG ] detect machine type
[ceph_deploy.mon][INFO ] distro info: CentOS 6.6 Final
[ceph-vm04][DEBUG ] determining if provided host has same hostname in remote
[ceph-vm04][DEBUG ] get remote short hostname
[ceph-vm04][DEBUG ] deploying mon to ceph-vm04
[ceph-vm04][DEBUG ] get remote short hostname
[ceph-vm04][DEBUG ] remote hostname: ceph-vm04
[ceph-vm04][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-vm04][DEBUG ] create the mon path if it does not exist
[ceph-vm04][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-ceph-vm04/done
[ceph-vm04][DEBUG ] create a done file to avoid re-doing the mon deployment
[ceph-vm04][DEBUG ] create the init path if it does not exist
[ceph-vm04][DEBUG ] locating the `service` executable...
[ceph-vm04][INFO ] Running command: sudo /sbin/service ceph -c
/etc/ceph/ceph.conf start mon.ceph-vm04
[ceph-vm04][DEBUG ] === mon.ceph-vm04 ===
[ceph-vm04][DEBUG ] Starting Ceph mon.ceph-vm04 on ceph-vm04...already
running
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph-vm04][DEBUG ]
********************************************************************************
[ceph-vm04][DEBUG ] status for monitor: mon.ceph-vm04
[ceph-vm04][DEBUG ] {
[ceph-vm04][DEBUG ] "election_epoch": 0,
[ceph-vm04][DEBUG ] "extra_probe_peers": [
[ceph-vm04][DEBUG ] "192.168.10.212:6789/0",
[ceph-vm04][DEBUG ] "192.168.10.213:6789/0"
[ceph-vm04][DEBUG ] ],
[ceph-vm04][DEBUG ] "monmap": {
[ceph-vm04][DEBUG ] "created": "0.000000",
[ceph-vm04][DEBUG ] "epoch": 0,
[ceph-vm04][DEBUG ] "fsid": "c0d39a49-2656-4c61-8bde-de7be3b8b51d",
[ceph-vm04][DEBUG ] "modified": "0.000000",
[ceph-vm04][DEBUG ] "mons": [
[ceph-vm04][DEBUG ] {
[ceph-vm04][DEBUG ] "addr": "0.0.0.0:0/1",
[ceph-vm04][DEBUG ] "name": "mon03",
[ceph-vm04][DEBUG ] "rank": 0
[ceph-vm04][DEBUG ] },
[ceph-vm04][DEBUG ] {
[ceph-vm04][DEBUG ] "addr": "0.0.0.0:0/2",
[ceph-vm04][DEBUG ] "name": "mon04",
[ceph-vm04][DEBUG ] "rank": 1
[ceph-vm04][DEBUG ] }
[ceph-vm04][DEBUG ] ]
[ceph-vm04][DEBUG ] },
[ceph-vm04][DEBUG ] "name": "ceph-vm04",
[ceph-vm04][DEBUG ] "outside_quorum": [],
[ceph-vm04][DEBUG ] "quorum": [],
[ceph-vm04][DEBUG ] "rank": -1,
[ceph-vm04][DEBUG ] "state": "probing",
[ceph-vm04][DEBUG ] "sync_provider": []
[ceph-vm04][DEBUG ] }
[ceph-vm04][DEBUG ]
********************************************************************************
[ceph-vm04][INFO ] monitor: mon.ceph-vm04 is currently at the state of
probing
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph-vm04][WARNIN] monitor ceph-vm04 does not exist in monmap
[ceph_deploy.mon][INFO ] processing monitor mon.ceph-vm01
[ceph-vm01][DEBUG ] connected to host: ceph-vm01
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm01 monitor is not yet in quorum,
tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm01 monitor is not yet in quorum,
tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm01 monitor is not yet in quorum,
tries left: 3
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm01 monitor is not yet in quorum,
tries left: 2
[ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
[ceph-vm01][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm01.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm01 monitor is not yet in quorum,
tries left: 1
[ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
[ceph_deploy.mon][INFO ] processing monitor mon.ceph-vm02
[ceph-vm02][DEBUG ] connected to host: ceph-vm02
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm02 monitor is not yet in quorum,
tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm02 monitor is not yet in quorum,
tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm02 monitor is not yet in quorum,
tries left: 3
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm02 monitor is not yet in quorum,
tries left: 2
[ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
[ceph-vm02][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm02.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm02 monitor is not yet in quorum,
tries left: 1
[ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
[ceph_deploy.mon][INFO ] processing monitor mon.ceph-vm03
[ceph-vm03][DEBUG ] connected to host: ceph-vm03
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm03 monitor is not yet in quorum,
tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm03 monitor is not yet in quorum,
tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm03 monitor is not yet in quorum,
tries left: 3
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm03 monitor is not yet in quorum,
tries left: 2
[ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
[ceph-vm03][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm03.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm03 monitor is not yet in quorum,
tries left: 1
[ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
[ceph_deploy.mon][INFO ] processing monitor mon.ceph-vm04
[ceph-vm04][DEBUG ] connected to host: ceph-vm04
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm04 monitor is not yet in quorum,
tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm04 monitor is not yet in quorum,
tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm04 monitor is not yet in quorum,
tries left: 3
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm04 monitor is not yet in quorum,
tries left: 2
[ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
[ceph-vm04][INFO ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.ceph-vm04.asok mon_status
[ceph_deploy.mon][WARNIN] mon.ceph-vm04 monitor is not yet in quorum,
tries left: 1
[ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
[ceph_deploy.mon][ERROR ] Some monitors have still not reached quorum:
[ceph_deploy.mon][ERROR ] ceph-vm03
[ceph_deploy.mon][ERROR ] ceph-vm02
[ceph_deploy.mon][ERROR ] ceph-vm01
[ceph_deploy.mon][ERROR ] ceph-vm04
cluster may not be in a healthy state
Unhandled exception in thread started by
Error in sys.excepthook:
Original exception was:
Then I try to run:
[ceph@ceph-vm05 ~]$ ceph-deploy gatherkeys ceph-vm01
[ceph_deploy.conf][DEBUG ] found configuration file at:
/home/ceph/.cephdeploy.conf
[ceph_deploy.cli][INFO ] Invoked (1.5.11): /usr/bin/ceph-deploy
gatherkeys ceph-vm01
[ceph_deploy.gatherkeys][DEBUG ] Checking ceph-vm01 for
/etc/ceph/ceph.client.admin.keyring
[ceph-vm01][DEBUG ] connected to host: ceph-vm01
[ceph-vm01][DEBUG ] detect platform information from remote host
[ceph-vm01][DEBUG ] detect machine type
[ceph-vm01][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN] Unable to find
/etc/ceph/ceph.client.admin.keyring on ['ceph-vm01']
[ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring
[ceph_deploy.gatherkeys][DEBUG ] Checking ceph-vm01 for
/var/lib/ceph/bootstrap-osd/ceph.keyring
[ceph-vm01][DEBUG ] connected to host: ceph-vm01
[ceph-vm01][DEBUG ] detect platform information from remote host
[ceph-vm01][DEBUG ] detect machine type
[ceph-vm01][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN] Unable to find
/var/lib/ceph/bootstrap-osd/ceph.keyring on ['ceph-vm01']
[ceph_deploy.gatherkeys][DEBUG ] Checking ceph-vm01 for
/var/lib/ceph/bootstrap-mds/ceph.keyring
[ceph-vm01][DEBUG ] connected to host: ceph-vm01
[ceph-vm01][DEBUG ] detect platform information from remote host
[ceph-vm01][DEBUG ] detect machine type
[ceph-vm01][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN] Unable to find
/var/lib/ceph/bootstrap-mds/ceph.keyring on ['ceph-vm01']
# more /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
192.168.10.214 ceph-vm00.2memory.ru adm
192.168.10.210 ceph-vm01.2memory.ru ceph-vm01 node01 mon01 osd01
192.168.10.211 ceph-vm02.2memory.ru ceph-vm02 node02 mon02 osd02
192.168.10.212 ceph-vm03.2memory.ru ceph-vm03 node03 mon03 osd03
192.168.10.213 ceph-vm04.2memory.ru ceph-vm04 node04 mon04 osd04
# more /etc/ceph/ceph.conf
[global]
auth_service_required = cephx
osd_pool_default_size = 2
filestore_xattr_use_omap = true
auth_client_required = cephx
auth_cluster_required = cephx
mon_host = 192.168.10.210,192.168.10.211,192.168.10.212
public_network = 192.168.10.0/24
mon_initial_members = ceph-vm01, ceph-vm02, ceph-vm03, ceph-vm04
fsid = abf84e50-c2dd-4a6d-aaff-e603056034e0
--
Best regards,
Konstantin Khatskevich
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
