Re: ceph-deploy problems on CentOS-6.4

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Oct 29, 2013 at 2:00 PM,  <alistair.whittle@xxxxxxxxxxxx> wrote:
>
>
>
>
> From: Trivedi, Narendra [mailto:Narendra.Trivedi@xxxxxxxxxx]
> Sent: Tuesday, October 29, 2013 5:33 PM
> To: Whittle, Alistair: Investment Bank (LDN); joseph.r.gruher@xxxxxxxxx;
> ceph-users@xxxxxxxxxxxxxx
>
>
> Subject: RE: ceph-deploy problems on CentOS-6.4
>
>
>
> Thanks a lot Joseph and Alistair… I have the following questions based on
> your inputs:
>
>
>
> 1)      Do I need to make changes to all the nodes or just the admin node? I
> guess all the nodes since ceph-deploy issues commands via ssh on all nodes…
>
> AW::  I found I needed to make the changes to ALL nodes.    It helps if they
> are pretty much identical in this regards prior to setting off.   Remember
> too that it’s not just wget that needs the proxy settings.   You may want to
> check your yum proxy settings as well.   I went one step further and set
> both http and https proxy settings in my default user shell script (both
> ceph and root).
>

It would be great if you could share all of the changes you had to do
so we can document them
for others :)


>
>
> 2)      The installation guide recommends using ceph user to communicate
> with other nodes. Do I login to the admin node as root user or ceph user?
>
> AW::  Initially used root from the admin node, but found that to not work.
> I eventually created a ceph user, logged in as that and did all my ceph
> related work as that user on all nodes.  The guide mentions not to run
> ceph-deploy as root or with sudo and I found to my frustration that is
> advice worth heeding.
>
>
>
>
>
> From: alistair.whittle@xxxxxxxxxxxx [mailto:alistair.whittle@xxxxxxxxxxxx]
> Sent: Tuesday, October 29, 2013 12:08 PM
> To: joseph.r.gruher@xxxxxxxxx; Trivedi, Narendra; ceph-users@xxxxxxxxxxxxxx
> Subject: RE: ceph-deploy problems on CentOS-6.4
>
>
>
> You also want to make sure that if you are using a proxy your proxy settings
> are maintained through sudo.
>
>
>
> With my deployment I had to add a line to my sudoers file to specify that
> the https_proxy and http_proxy settings are maintained.  Didn’t work
> otherwise.
>
>
>
> Defaults env_keep += "http_proxy https_proxy"
>
>
>
>
>
> From: ceph-users-bounces@xxxxxxxxxxxxxx
> [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Gruher, Joseph R
> Sent: Tuesday, October 29, 2013 4:55 PM
> To: Trivedi, Narendra; ceph-users@xxxxxxxxxxxxxx
> Subject: Re:  ceph-deploy problems on CentOS-6.4
>
>
>
> If you are behind a proxy try configuring the wget proxy through
> /etc/wgetrc.  I had a similar problem where I could complete wget commands
> manually but they would fail in ceph-deploy until I configured the wget
> proxy in that manner.
>
>
>
> From: ceph-users-bounces@xxxxxxxxxxxxxx
> [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Trivedi, Narendra
> Sent: Tuesday, October 29, 2013 9:51 AM
> To: ceph-users@xxxxxxxxxxxxxx
> Subject:  ceph-deploy problems on CentOS-6.4
>
>
>
> Hi All,
>
>
>
> I am a newbie to ceph. I am installing ceph (dumpling release) using
> ceph-deploy (issued from my admin node) on one monitor and two OSD nodes
> running CentOS 6.4 (64-bit) using followed instructions in the link below:
>
>
>
> http://ceph.com/docs/master/start/quick-ceph-deploy/
>
>
>
> My setup looks exactly like the diagram. I followed pre-flight instructions
> exacty as outlined in the link below:
>
>
>
> http://ceph.com/docs/master/start/quick-start-preflight/
>
>
>
> The ceph-deploy takes forever and then throws up the following error:
>
>
>
> 2013-10-28 17:32:35,903 [ceph_deploy.cli][INFO  ] Invoked (1.2.7):
> /usr/bin/ceph-deploy new ceph-node1-mon-centos-6-4
>
> 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Creating new cluster named
> ceph
>
> 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Resolving host
> ceph-node1-mon-centos-6-4
>
> 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor
> ceph-node1-mon-centos-6-4 at 10.12.0.70
>
> 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor initial members
> are ['ceph-node1-mon-centos-6-4']
>
> 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor addrs are
> ['10.12.0.70']
>
> 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Creating a random mon
> key...
>
> 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing initial config to
> ceph.conf...
>
> 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing monitor keyring to
> ceph.mon.keyring...
>
> 2013-10-28 17:33:10,287 [ceph_deploy.cli][INFO  ] Invoked (1.2.7):
> /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4
> ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4
>
> 2013-10-28 17:33:10,287 [ceph_deploy.install][DEBUG ] Installing stable
> version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4
> ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4
>
> 2013-10-28 17:33:10,288 [ceph_deploy.install][DEBUG ] Detecting platform for
> host ceph-node1-mon-centos-6-4 ...
>
> 2013-10-28 17:33:10,288 [ceph_deploy.sudo_pushy][DEBUG ] will use a remote
> connection without sudo
>
> 2013-10-28 17:33:10,626 [ceph_deploy.install][INFO  ] Distro info: CentOS
> 6.4 Final
>
> 2013-10-28 17:33:10,626 [ceph-node1-mon-centos-6-4][INFO  ] installing ceph
> on ceph-node1-mon-centos-6-4
>
> 2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO  ] adding EPEL
> repository
>
> 2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO  ] Running command:
> wget
> http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
>
> 2013-10-28 19:20:35,893 [ceph-node1-mon-centos-6-4][ERROR ] Traceback (most
> recent call last):
>
> 2013-10-28 19:20:35,894 [ceph-node1-mon-centos-6-4][ERROR ]   File
> "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line
> 77, in install_epel
>
> 2013-10-28 19:20:35,899 [ceph-node1-mon-centos-6-4][ERROR ]   File
> "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10,
> in inner
>
> 2013-10-28 19:20:35,900 [ceph-node1-mon-centos-6-4][ERROR ]   File
> "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in
> remote_call
>
> 2013-10-28 19:20:35,902 [ceph-node1-mon-centos-6-4][ERROR ]   File
> "/usr/lib64/python2.6/subprocess.py", line 502, in check_call
>
> 2013-10-28 19:20:35,903 [ceph-node1-mon-centos-6-4][ERROR ]     raise
> CalledProcessError(retcode, cmd)
>
> 2013-10-28 19:20:35,904 [ceph-node1-mon-centos-6-4][ERROR ]
> CalledProcessError: Command '['wget',
> 'http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm']'
> returned non-zero exit status 4
>
> 2013-10-28 19:20:35,911 [ceph-node1-mon-centos-6-4][ERROR ] --2013-10-28
> 17:33:10--
> http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
>
> 2013-10-28 19:20:35,911 [ceph-node1-mon-centos-6-4][ERROR ] Resolving
> dl.fedoraproject.org... 209.132.181.25, 209.132.181.26, 209.132.181.27, ...
>
> 2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to
> dl.fedoraproject.org|209.132.181.25|:80... failed: Connection timed out.
>
> 2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to
> dl.fedoraproject.org|209.132.181.26|:80... failed: Connection timed out.
>
>
>
> Interestingly, “wget
> http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm”;
> on each nodes (1 mon and 2 OSDs) succeeds without any problem. I have tried
> everything many times with root user, ceph user etc. but it fails every
> time! It is very frustrating!
>
>
>
> Has anyone else experienced the same or similar problem?
>
>
>
> Thanks a lot in advance!
>
> Nar
>
>
>
>
> This message contains information which may be confidential and/or
> privileged. Unless you are the intended recipient (or authorized to receive
> for the intended recipient), you may not read, use, copy or disclose to
> anyone the message or any information contained in the message. If you have
> received the message in error, please advise the sender by reply e-mail and
> delete the message and any attachment(s) thereto without retaining any
> copies.
>
> _______________________________________________
>
> This message is for information purposes only, it is not a recommendation,
> advice, offer or solicitation to buy or sell a product or service nor an
> official confirmation of any transaction. It is directed at persons who are
> professionals and is not intended for retail customer use. Intended for
> recipient only. This message is subject to the terms at:
> www.barclays.com/emaildisclaimer.
>
> For important disclosures, please see:
> www.barclays.com/salesandtradingdisclaimer regarding market commentary from
> Barclays Sales and/or Trading, who are active market participants; and in
> respect of Barclays Research, including disclosures relating to specific
> issuers, please see http://publicresearch.barclays.com.
>
> _______________________________________________
>
>
> This message contains information which may be confidential and/or
> privileged. Unless you are the intended recipient (or authorized to receive
> for the intended recipient), you may not read, use, copy or disclose to
> anyone the message or any information contained in the message. If you have
> received the message in error, please advise the sender by reply e-mail and
> delete the message and any attachment(s) thereto without retaining any
> copies.
>
> _______________________________________________
>
> This message is for information purposes only, it is not a recommendation,
> advice, offer or solicitation to buy or sell a product or service nor an
> official confirmation of any transaction. It is directed at persons who are
> professionals and is not intended for retail customer use. Intended for
> recipient only. This message is subject to the terms at:
> www.barclays.com/emaildisclaimer.
>
> For important disclosures, please see:
> www.barclays.com/salesandtradingdisclaimer regarding market commentary from
> Barclays Sales and/or Trading, who are active market participants; and in
> respect of Barclays Research, including disclosures relating to specific
> issuers, please see http://publicresearch.barclays.com.
>
> _______________________________________________
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux