On Tue, Oct 29, 2013 at 2:00 PM, <alistair.whittle@xxxxxxxxxxxx> wrote: > > > > > From: Trivedi, Narendra [mailto:Narendra.Trivedi@xxxxxxxxxx] > Sent: Tuesday, October 29, 2013 5:33 PM > To: Whittle, Alistair: Investment Bank (LDN); joseph.r.gruher@xxxxxxxxx; > ceph-users@xxxxxxxxxxxxxx > > > Subject: RE: ceph-deploy problems on CentOS-6.4 > > > > Thanks a lot Joseph and Alistair… I have the following questions based on > your inputs: > > > > 1) Do I need to make changes to all the nodes or just the admin node? I > guess all the nodes since ceph-deploy issues commands via ssh on all nodes… > > AW:: I found I needed to make the changes to ALL nodes. It helps if they > are pretty much identical in this regards prior to setting off. Remember > too that it’s not just wget that needs the proxy settings. You may want to > check your yum proxy settings as well. I went one step further and set > both http and https proxy settings in my default user shell script (both > ceph and root). > It would be great if you could share all of the changes you had to do so we can document them for others :) > > > 2) The installation guide recommends using ceph user to communicate > with other nodes. Do I login to the admin node as root user or ceph user? > > AW:: Initially used root from the admin node, but found that to not work. > I eventually created a ceph user, logged in as that and did all my ceph > related work as that user on all nodes. The guide mentions not to run > ceph-deploy as root or with sudo and I found to my frustration that is > advice worth heeding. > > > > > > From: alistair.whittle@xxxxxxxxxxxx [mailto:alistair.whittle@xxxxxxxxxxxx] > Sent: Tuesday, October 29, 2013 12:08 PM > To: joseph.r.gruher@xxxxxxxxx; Trivedi, Narendra; ceph-users@xxxxxxxxxxxxxx > Subject: RE: ceph-deploy problems on CentOS-6.4 > > > > You also want to make sure that if you are using a proxy your proxy settings > are maintained through sudo. > > > > With my deployment I had to add a line to my sudoers file to specify that > the https_proxy and http_proxy settings are maintained. Didn’t work > otherwise. > > > > Defaults env_keep += "http_proxy https_proxy" > > > > > > From: ceph-users-bounces@xxxxxxxxxxxxxx > [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Gruher, Joseph R > Sent: Tuesday, October 29, 2013 4:55 PM > To: Trivedi, Narendra; ceph-users@xxxxxxxxxxxxxx > Subject: Re: ceph-deploy problems on CentOS-6.4 > > > > If you are behind a proxy try configuring the wget proxy through > /etc/wgetrc. I had a similar problem where I could complete wget commands > manually but they would fail in ceph-deploy until I configured the wget > proxy in that manner. > > > > From: ceph-users-bounces@xxxxxxxxxxxxxx > [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Trivedi, Narendra > Sent: Tuesday, October 29, 2013 9:51 AM > To: ceph-users@xxxxxxxxxxxxxx > Subject: ceph-deploy problems on CentOS-6.4 > > > > Hi All, > > > > I am a newbie to ceph. I am installing ceph (dumpling release) using > ceph-deploy (issued from my admin node) on one monitor and two OSD nodes > running CentOS 6.4 (64-bit) using followed instructions in the link below: > > > > http://ceph.com/docs/master/start/quick-ceph-deploy/ > > > > My setup looks exactly like the diagram. I followed pre-flight instructions > exacty as outlined in the link below: > > > > http://ceph.com/docs/master/start/quick-start-preflight/ > > > > The ceph-deploy takes forever and then throws up the following error: > > > > 2013-10-28 17:32:35,903 [ceph_deploy.cli][INFO ] Invoked (1.2.7): > /usr/bin/ceph-deploy new ceph-node1-mon-centos-6-4 > > 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Creating new cluster named > ceph > > 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Resolving host > ceph-node1-mon-centos-6-4 > > 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor > ceph-node1-mon-centos-6-4 at 10.12.0.70 > > 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor initial members > are ['ceph-node1-mon-centos-6-4'] > > 2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor addrs are > ['10.12.0.70'] > > 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Creating a random mon > key... > > 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing initial config to > ceph.conf... > > 2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing monitor keyring to > ceph.mon.keyring... > > 2013-10-28 17:33:10,287 [ceph_deploy.cli][INFO ] Invoked (1.2.7): > /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4 > ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4 > > 2013-10-28 17:33:10,287 [ceph_deploy.install][DEBUG ] Installing stable > version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 > ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4 > > 2013-10-28 17:33:10,288 [ceph_deploy.install][DEBUG ] Detecting platform for > host ceph-node1-mon-centos-6-4 ... > > 2013-10-28 17:33:10,288 [ceph_deploy.sudo_pushy][DEBUG ] will use a remote > connection without sudo > > 2013-10-28 17:33:10,626 [ceph_deploy.install][INFO ] Distro info: CentOS > 6.4 Final > > 2013-10-28 17:33:10,626 [ceph-node1-mon-centos-6-4][INFO ] installing ceph > on ceph-node1-mon-centos-6-4 > > 2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO ] adding EPEL > repository > > 2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO ] Running command: > wget > http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm > > 2013-10-28 19:20:35,893 [ceph-node1-mon-centos-6-4][ERROR ] Traceback (most > recent call last): > > 2013-10-28 19:20:35,894 [ceph-node1-mon-centos-6-4][ERROR ] File > "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line > 77, in install_epel > > 2013-10-28 19:20:35,899 [ceph-node1-mon-centos-6-4][ERROR ] File > "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, > in inner > > 2013-10-28 19:20:35,900 [ceph-node1-mon-centos-6-4][ERROR ] File > "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in > remote_call > > 2013-10-28 19:20:35,902 [ceph-node1-mon-centos-6-4][ERROR ] File > "/usr/lib64/python2.6/subprocess.py", line 502, in check_call > > 2013-10-28 19:20:35,903 [ceph-node1-mon-centos-6-4][ERROR ] raise > CalledProcessError(retcode, cmd) > > 2013-10-28 19:20:35,904 [ceph-node1-mon-centos-6-4][ERROR ] > CalledProcessError: Command '['wget', > 'http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm']' > returned non-zero exit status 4 > > 2013-10-28 19:20:35,911 [ceph-node1-mon-centos-6-4][ERROR ] --2013-10-28 > 17:33:10-- > http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm > > 2013-10-28 19:20:35,911 [ceph-node1-mon-centos-6-4][ERROR ] Resolving > dl.fedoraproject.org... 209.132.181.25, 209.132.181.26, 209.132.181.27, ... > > 2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to > dl.fedoraproject.org|209.132.181.25|:80... failed: Connection timed out. > > 2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to > dl.fedoraproject.org|209.132.181.26|:80... failed: Connection timed out. > > > > Interestingly, “wget > http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm”; > on each nodes (1 mon and 2 OSDs) succeeds without any problem. I have tried > everything many times with root user, ceph user etc. but it fails every > time! It is very frustrating! > > > > Has anyone else experienced the same or similar problem? > > > > Thanks a lot in advance! > > Nar > > > > > This message contains information which may be confidential and/or > privileged. Unless you are the intended recipient (or authorized to receive > for the intended recipient), you may not read, use, copy or disclose to > anyone the message or any information contained in the message. If you have > received the message in error, please advise the sender by reply e-mail and > delete the message and any attachment(s) thereto without retaining any > copies. > > _______________________________________________ > > This message is for information purposes only, it is not a recommendation, > advice, offer or solicitation to buy or sell a product or service nor an > official confirmation of any transaction. It is directed at persons who are > professionals and is not intended for retail customer use. Intended for > recipient only. This message is subject to the terms at: > www.barclays.com/emaildisclaimer. > > For important disclosures, please see: > www.barclays.com/salesandtradingdisclaimer regarding market commentary from > Barclays Sales and/or Trading, who are active market participants; and in > respect of Barclays Research, including disclosures relating to specific > issuers, please see http://publicresearch.barclays.com. > > _______________________________________________ > > > This message contains information which may be confidential and/or > privileged. Unless you are the intended recipient (or authorized to receive > for the intended recipient), you may not read, use, copy or disclose to > anyone the message or any information contained in the message. If you have > received the message in error, please advise the sender by reply e-mail and > delete the message and any attachment(s) thereto without retaining any > copies. > > _______________________________________________ > > This message is for information purposes only, it is not a recommendation, > advice, offer or solicitation to buy or sell a product or service nor an > official confirmation of any transaction. It is directed at persons who are > professionals and is not intended for retail customer use. Intended for > recipient only. This message is subject to the terms at: > www.barclays.com/emaildisclaimer. > > For important disclosures, please see: > www.barclays.com/salesandtradingdisclaimer regarding market commentary from > Barclays Sales and/or Trading, who are active market participants; and in > respect of Barclays Research, including disclosures relating to specific > issuers, please see http://publicresearch.barclays.com. > > _______________________________________________ > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com