Re: ceph-deploy mon create-initial errors on centos 7

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I have overwritten my ceph.conf file but still i got the same errors.
After that I purged all my nodes and deleted all keys so i start a new
deployment. When I deploy the initial monitors I again run into the
following errors;

[root@dumbo008 my-cluster]# ceph-deploy mon create-initial
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.37): /usr/bin/ceph-deploy mon
create-initial
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  subcommand                    : create-initial
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       :
<ceph_deploy.conf.cephdeploy.Conf instance at 0x106afc8>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  func                          : <function
mon at 0x10625f0>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  keyrings                      : None
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts dumbo007 dumbo008
[ceph_deploy.mon][DEBUG ] detecting platform for host dumbo007 ...
[dumbo007][DEBUG ] connected to host: dumbo007
[dumbo007][DEBUG ] detect platform information from remote host
[dumbo007][DEBUG ] detect machine type
[dumbo007][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.3.1611 Core
[dumbo007][DEBUG ] determining if provided host has same hostname in remote
[dumbo007][DEBUG ] get remote short hostname
[dumbo007][DEBUG ] deploying mon to dumbo007
[dumbo007][DEBUG ] get remote short hostname
[dumbo007][DEBUG ] remote hostname: dumbo007
[dumbo007][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[dumbo007][DEBUG ] create the mon path if it does not exist
[dumbo007][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-dumbo007/done
[dumbo007][DEBUG ] create a done file to avoid re-doing the mon deployment
[dumbo007][DEBUG ] create the init path if it does not exist
[dumbo007][INFO  ] Running command: systemctl enable ceph.target
[dumbo007][INFO  ] Running command: systemctl enable ceph-mon@dumbo007
[dumbo007][INFO  ] Running command: systemctl start ceph-mon@dumbo007
[dumbo007][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
/var/run/ceph/ceph-mon.dumbo007.asok mon_status
[dumbo007][ERROR ] admin_socket: exception getting command
descriptions: [Errno 111] Connection refused
[dumbo007][WARNIN] monitor: mon.dumbo007, might not be running yet
[dumbo007][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
/var/run/ceph/ceph-mon.dumbo007.asok mon_status
[dumbo007][ERROR ] admin_socket: exception getting command
descriptions: [Errno 111] Connection refused
[dumbo007][WARNIN] monitor dumbo007 does not exist in monmap
[dumbo007][WARNIN] neither `public_addr` nor `public_network` keys are
defined for monitors
[dumbo007][WARNIN] monitors may not be able to form quorum
[ceph_deploy.mon][DEBUG ] detecting platform for host dumbo008 ...
[dumbo008][DEBUG ] connected to host: dumbo008
[dumbo008][DEBUG ] detect platform information from remote host
[dumbo008][DEBUG ] detect machine type
[dumbo008][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.3.1611 Core
[dumbo008][DEBUG ] determining if provided host has same hostname in remote
[dumbo008][DEBUG ] get remote short hostname
[dumbo008][DEBUG ] deploying mon to dumbo008
[dumbo008][DEBUG ] get remote short hostname
[dumbo008][DEBUG ] remote hostname: dumbo008
[dumbo008][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[dumbo008][DEBUG ] create the mon path if it does not exist
[dumbo008][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-dumbo008/done
[dumbo008][DEBUG ] create a done file to avoid re-doing the mon deployment
[dumbo008][DEBUG ] create the init path if it does not exist
[dumbo008][INFO  ] Running command: systemctl enable ceph.target
[dumbo008][INFO  ] Running command: systemctl enable ceph-mon@dumbo008
[dumbo008][INFO  ] Running command: systemctl start ceph-mon@dumbo008
[dumbo008][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
/var/run/ceph/ceph-mon.dumbo008.asok mon_status
[dumbo008][ERROR ] admin_socket: exception getting command
descriptions: [Errno 111] Connection refused
[dumbo008][WARNIN] monitor: mon.dumbo008, might not be running yet
[dumbo008][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
/var/run/ceph/ceph-mon.dumbo008.asok mon_status
[dumbo008][ERROR ] admin_socket: exception getting command
descriptions: [Errno 111] Connection refused
[dumbo008][WARNIN] monitor dumbo008 does not exist in monmap
[dumbo008][WARNIN] neither `public_addr` nor `public_network` keys are
defined for monitors
[dumbo008][WARNIN] monitors may not be able to form quorum
[ceph_deploy.mon][INFO  ] processing monitor mon.dumbo007
[dumbo007][DEBUG ] connected to host: dumbo007
[dumbo007][DEBUG ] detect platform information from remote host
[dumbo007][DEBUG ] detect machine type
[dumbo007][DEBUG ] find the location of an executable
[dumbo007][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
/var/run/ceph/ceph-mon.dumbo007.asok mon_status
[dumbo007][ERROR ] admin_socket: exception getting command
descriptions: [Errno 111] Connection refused
[ceph_deploy.mon][WARNIN] mon.dumbo007 monitor is not yet in quorum,
tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[dumbo007][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
/var/run/ceph/ceph-mon.dumbo007.asok mon_status
[dumbo007][ERROR ] admin_socket: exception getting command
descriptions: exception: [Errno 104] Connection reset by peer
[ceph_deploy.mon][WARNIN] mon.dumbo007 monitor is not yet in quorum,
tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying

On Tue, Jun 20, 2017 at 11:33 PM, Alfredo Deza <adeza@xxxxxxxxxx> wrote:
> On Tue, Jun 20, 2017 at 4:43 AM, Prince Hamandawana
> <phamandawana@xxxxxxxxx> wrote:
>> Dear all
>>
>> I am having problems when trying to deploy my initial monitors via
>> ceph-deplyoy on centos 7 . The version of ceph I am running is ceph
>> version 10.2.7 (50e863e0f4bc8f4b9e31156de690d765af245185). When I run
>> ceph-deploy mon create-initial, i get the following errors ;
>>
>> [root@dumbo008 my-cluster]# ceph-deploy mon create-initial
>> [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
>> [ceph_deploy.cli][INFO  ] Invoked (1.5.37): /usr/bin/ceph-deploy mon
>> create-initial
>> [ceph_deploy.cli][INFO  ] ceph-deploy options:
>> [ceph_deploy.cli][INFO  ]  username                      : None
>> [ceph_deploy.cli][INFO  ]  verbose                       : False
>> [ceph_deploy.cli][INFO  ]  overwrite_conf                : False
>> [ceph_deploy.cli][INFO  ]  subcommand                    : create-initial
>> [ceph_deploy.cli][INFO  ]  quiet                         : False
>> [ceph_deploy.cli][INFO  ]  cd_conf                       :
>> <ceph_deploy.conf.cephdeploy.Conf instance at 0x27b5fc8>
>> [ceph_deploy.cli][INFO  ]  cluster                       : ceph
>> [ceph_deploy.cli][INFO  ]  func                          : <function
>> mon at 0x27ad5f0>
>> [ceph_deploy.cli][INFO  ]  ceph_conf                     : None
>> [ceph_deploy.cli][INFO  ]  default_release               : False
>> [ceph_deploy.cli][INFO  ]  keyrings                      : None
>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts dumbo007 dumbo008
>> [ceph_deploy.mon][DEBUG ] detecting platform for host dumbo007 ...
>> [dumbo007][DEBUG ] connected to host: dumbo007
>> [dumbo007][DEBUG ] detect platform information from remote host
>> [dumbo007][DEBUG ] detect machine type
>> [dumbo007][DEBUG ] find the location of an executable
>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.3.1611 Core
>> [dumbo007][DEBUG ] determining if provided host has same hostname in remote
>> [dumbo007][DEBUG ] get remote short hostname
>> [dumbo007][DEBUG ] deploying mon to dumbo007
>> [dumbo007][DEBUG ] get remote short hostname
>> [dumbo007][DEBUG ] remote hostname: dumbo007
>> [dumbo007][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
>> [dumbo007][DEBUG ] create the mon path if it does not exist
>> [dumbo007][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-dumbo007/done
>> [dumbo007][DEBUG ] create a done file to avoid re-doing the mon deployment
>> [dumbo007][DEBUG ] create the init path if it does not exist
>> [dumbo007][INFO  ] Running command: systemctl enable ceph.target
>> [dumbo007][INFO  ] Running command: systemctl enable ceph-mon@dumbo007
>> [dumbo007][INFO  ] Running command: systemctl start ceph-mon@dumbo007
>> [dumbo007][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
>> /var/run/ceph/ceph-mon.dumbo007.asok mon_status
>> [dumbo007][ERROR ] admin_socket: exception getting command
>> descriptions: [Errno 111] Connection refused
>> [dumbo007][WARNIN] monitor: mon.dumbo007, might not be running yet
>> [dumbo007][INFO  ] Running command: ceph --cluster=ceph --admin-daemon
>> /var/run/ceph/ceph-mon.dumbo007.asok mon_status
>> [dumbo007][ERROR ] admin_socket: exception getting command
>> descriptions: [Errno 111] Connection refused
>> [dumbo007][WARNIN] monitor dumbo007 does not exist in monmap
>> [dumbo007][WARNIN] neither `public_addr` nor `public_network` keys are
>> defined for monitors
>> [dumbo007][WARNIN] monitors may not be able to form quorum
>> [ceph_deploy.mon][DEBUG ] detecting platform for host dumbo008 ...
>> [dumbo008][DEBUG ] connected to host: dumbo008
>> [dumbo008][DEBUG ] detect platform information from remote host
>> [dumbo008][DEBUG ] detect machine type
>> [dumbo008][DEBUG ] find the location of an executable
>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.3.1611 Core
>> [dumbo008][DEBUG ] determining if provided host has same hostname in remote
>> [dumbo008][DEBUG ] get remote short hostname
>> [dumbo008][DEBUG ] deploying mon to dumbo008
>> [dumbo008][DEBUG ] get remote short hostname
>> [dumbo008][DEBUG ] remote hostname: dumbo008
>> [dumbo008][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
>> [ceph_deploy.mon][ERROR ] RuntimeError: config file
>> /etc/ceph/ceph.conf exists with different content; use
>> --overwrite-conf to overwrite
>> [ceph_deploy][ERROR ] GenericError: Failed to create 1 monitors
>>
>>
>> this is my ceph.conf file
>> [root@dumbo008 my-cluster]#
>> [root@dumbo008 my-cluster]# vim ceph.conf
>> [global]
>> fsid = f3207ed8-8b96-4650-a76e-f42c91ffb42c
>> mon_initial_members = dumbo007, dumbo008
>> mon_host = 172.20.1.7,172.20.1.8
>> auth_cluster_required = cephx
>> auth_service_required = cephx
>> auth_client_required = cephx
>>
>> Below is the information of my Linux OS
>> [root@dumbo008 my-cluster]# uname -a
>> Linux dumbo008 3.10.0-327.el7.x86_64 #1 SMP Thu Nov 19 22:10:57 UTC
>> 2015 x86_64 x86_64 x86_64 GNU/Linux
>>
>> [root@dumbo008 my-cluster]#
>> [root@dumbo008 my-cluster]# lsb_release -d
>> Description: CentOS Linux release 7.3.1611 (Core)
>> [root@dumbo008 my-cluster]#
>> [root@dumbo008 my-cluster]# lsb_release
>> LSB Version: :core-4.1-amd64:core-4.1-ia32:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-ia32:cxx-4.1-noarch:desktop-4.1-amd64:
>> desktop-4.1-ia32:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch
>>
>> Can someone help.
>
> This here tells me you have tried this more than once:
>
>> [ceph_deploy.mon][ERROR ] RuntimeError: config file
>> /etc/ceph/ceph.conf exists with different content; use
>> --overwrite-conf to overwrite
>
> Or possibly deployed to a host that had left overs from another
> cluster. There are many reasons why a monitor may not come up, you
> could
> try looking at the logs in the `dumbo007` box and look at
> /var/log/ceph/* and `journalctl -xe` to find out what the unit file is
> complaining about.
>
>
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@xxxxxxxxxxxxxxx
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux