Re: ceph-deploy problems on CentOS-6.4

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




Narendra 

You should perform a test first

1) Install ceph one at a time on nodes , start with node ceph-node1-mon-centos-6-4
2) Manually login to node ceph-node1-mon-centos-6-4
3) Manually install release key on this node  
rpm --import 'https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc'
4) Manually install EPEL  
su -c 'rpm -Uvh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm'
5) Manually install perquisite

yum install snappy leveldb gdisk python-argparse gperftools-libs

6) Manually install Add Dumpling release package

su -c 'rpm -Uvh http://ceph.com/rpm-dumpling/el6/noarch/ceph-release-1-0.el6.noarch.rpm'
7) Add Ceph to YUM

8) Then again try to run ceph-deploy from your admin node ( ceph-admin-node-centos-6-4 )


Read this link for more information http://ceph.com/docs/next/install/rpm/

Regards
Karan Singh
System Specialist Storage | CSC IT center for Science 
Espoo | FINLAND
karan.singh@xxxxxx



From: "Joseph R Gruher" <joseph.r.gruher@xxxxxxxxx>
To: "Narendra Trivedi" <Narendra.Trivedi@xxxxxxxxxx>, "alistair whittle" <alistair.whittle@xxxxxxxxxxxx>, ceph-users@xxxxxxxxxxxxxx
Sent: Tuesday, 29 October, 2013 9:53:23 PM
Subject: Re: ceph-deploy problems on CentOS-6.4

Did you configure /root/.curlrc?  Since ceph-deploy runs the commands with sudo I believe it will refer to the proxy files in /root/ instead of ~/.  I configure both just to be safe.  I just did a new ceph-deploy on CentOS 6.4 this morning with these settings:

 

[ceph@joceph01 ceph]$ sudo cat /root/.rpmmacros

%_httpproxy proxy.intel.com

%_httpport 123

 

[ceph@joceph01 ceph]$ sudo cat /root/.curlrc

proxy=http://proxy.intel.com:123

 

[ceph@joceph01 ceph]$ sudo cat /etc/yum.conf | grep proxy

proxy=http://proxy.intel.com:123

 

[ceph@joceph01 ceph]$ sudo cat /etc/wgetrc | grep proxy

https_proxy = http://proxy.intel.com:123/

http_proxy = http://proxy.intel.com:123/

ftp_proxy = http://proxy.intel.com:123/

use_proxy = on

 

[ceph@joceph01 ceph]$ sudo cat ~/.rpmmacros

%_httpproxy proxy.intel.com

%_httpport 123

 

[ceph@joceph01 ceph]$ sudo cat ~/.curlrc

proxy=http://proxy.intel.com:123

 

 

From: Trivedi, Narendra [mailto:Narendra.Trivedi@xxxxxxxxxx]
Sent: Tuesday, October 29, 2013 12:40 PM
To: Gruher, Joseph R; alistair.whittle@xxxxxxxxxxxx; ceph-users@xxxxxxxxxxxxxx
Subject: RE: ceph-deploy problems on CentOS-6.4

 

Guys,

 

I am still struggling with the installation. Seems proxy +  ceph-deploy is a deadly combo. Look below:

 

[ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 ceph-nod

e2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-node1-mon-centos-6-4 ...

[ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection without sudo

[ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final

[ceph-node1-mon-centos-6-4][INFO  ] installing ceph on ceph-node1-mon-centos-6-4

[ceph-node1-mon-centos-6-4][INFO  ] adding EPEL repository

[ceph-node1-mon-centos-6-4][INFO  ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.

noarch.rpm

[ceph-node1-mon-centos-6-4][ERROR ] --2013-10-29 14:26:25--  http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6

-8.noarch.rpm

[ceph-node1-mon-centos-6-4][ERROR ] Connecting to 10.12.132.208:8080... connected.

[ceph-node1-mon-centos-6-4][ERROR ] Proxy request sent, awaiting response... 200 OK

[ceph-node1-mon-centos-6-4][ERROR ] Length: 14540 (14K) [application/x-rpm]

[ceph-node1-mon-centos-6-4][ERROR ] Saving to: `epel-release-6-8.noarch.rpm.6.1'

[ceph-node1-mon-centos-6-4][ERROR ]      0K .......... ....                                       100% 5.90M=0.002s

[ceph-node1-mon-centos-6-4][ERROR ] Last-modified header invalid -- time-stamp ignored.

[ceph-node1-mon-centos-6-4][ERROR ] 2013-10-29 14:27:24 (5.90 MB/s) - `epel-release-6-8.noarch.rpm.6.1' saved [14540/1454

0]

[ceph-node1-mon-centos-6-4][INFO  ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm

[ceph-node1-mon-centos-6-4][INFO  ] Preparing...                ##################################################

[ceph-node1-mon-centos-6-4][INFO  ] epel-release                ##################################################

[ceph-node1-mon-centos-6-4][ERROR ] warning: epel-release-6-8.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID 0608b895

: NOKEY

[ceph-node1-mon-centos-6-4][INFO  ] Running command: su -c 'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f

=keys/release.asc"'

[ceph-node1-mon-centos-6-4][ERROR ] Traceback (most recent call last):

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line 2

3, in install

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, in

inner

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in re

mote_call

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib64/python2.6/subprocess.py", line 502, in check_call

[ceph-node1-mon-centos-6-4][ERROR ]     raise CalledProcessError(retcode, cmd)

[ceph-node1-mon-centos-6-4][ERROR ] CalledProcessError: Command '['su -c \'rpm --import "https://ceph.com/git/?p=ceph.git

;a=blob_plain;f=keys/release.asc"\'']' returned non-zero exit status 1

[ceph-node1-mon-centos-6-4][ERROR ] curl: (7) couldn't connect to host

[ceph-node1-mon-centos-6-4][ERROR ] error: https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc: import read

failed(2).

[ceph_deploy][ERROR ] RuntimeError: Failed to execute command: su -c 'rpm --import "https://ceph.com/git/?p=ceph.git;a=bl

 

My ~/.curlrc, /etc/yum.conf and ~/.rpmmacros contain the following line:

proxy=http://10.12.132.208:8080

I tried https too but get the same error L

And of course /etc/wgetrc contains the 2 lines below for http and https proxy:

http_proxy= http://10.12.132.208:8080

https_proxy= https://10.12.132.208:8080

 

Stupid question for JRG: should ~/.curlrc, /etc/yum.conf and ~/.rpmmacros contain http(s)_proxy= and not proxy=??

 

Thanks again!

Narendra

 

 

Gruher, Joseph R joseph.r.gruher at intel.com 
Tue Oct 29 12:18:14 PDT 2013


I don’t think this is true… I am behind a proxy and use ceph-deploy and I do not have to use --no-adjust-repos if I set up all my proxies correctly.

 

From: ceph-users-bounces at lists.ceph.com [mailto:ceph-users-bounces at lists.ceph.com] On Behalf Of alistair.whittle at barclays.com

Sent: Tuesday, October 29, 2013 12:15 PM

To: ceph-users at lists.ceph.com

Subject: Re: ceph-deploy problems on CentOS-6.4

 

One more thing, because you are using a proxy, you need to include the --no-adjust-repos flag at the end of the install command in Ceph-deploy.

 

I will be honest. I found with my install that doing the yum install outside of Ceph-deploy on the Ceph node itself works much better. It does require all the packages and dependencies to be available on the node, but it saved me a lot of debugging hassle and time. In fact, I am fast developing the opinion that doing most things outside of Ceph-deploy (certainly on my Red Hat build) is the easier option.

 

 

 

__________________________________________________________________________

Alistair Whittle | Storage Engineer | Global Technology Infrastructure and Services

Tel +44 (0) 20 3134 5933 | Mobile +44 (0) 77883 55220 | Email alistair.whittle at barclays.com<mailto:alistair.whittle at barclays.com>

Barclays, 10 South Colonnade, Canary Wharf, London, E14 4PU

barclays.com

 

Advance Out of Office Notification: 14-18th October (Training)

 

 

-----Original Message-----

From: Gruher, Joseph R [joseph.r.gruher at intel.com<mailto:joseph.r.gruher at intel.com>]

Sent: Tuesday, October 29, 2013 06:48 PM GMT Standard Time

To: Trivedi, Narendra; Whittle, Alistair: Investment Bank (LDN); ceph-users at lists.ceph.com<mailto:ceph-users at lists.ceph.com>

Subject: RE: ceph-deploy problems on CentOS-6.4

 

 

Now you need to set the Curl proxy in /root/.curlrc (might also set it in ~/.curlrc for good measure).

 

To ceph-deploy on CentOS 6.4 I had to set all these proxies:

Curl: /root/.curlrc

rpm: /root/.rpmmacros

wget: /etc/wgetrc

yum: /etc/yum.conf

 

 

From: Trivedi, Narendra [mailto:Narendra.Trivedi at savvis.com]

Sent: Tuesday, October 29, 2013 11:45 AM

To: alistair.whittle at barclays.com<mailto:alistair.whittle at barclays.com>; Gruher, Joseph R; ceph-users at lists.ceph.com<mailto:ceph-users at lists.ceph.com>

Subject: RE: ceph-deploy problems on CentOS-6.4

 

I made the changes and it seems now it can successfully wget the rpm but getting a different error now:

 

[root at ceph-admin-node-centos-6-4 my-cluster]# ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.cli][INFO  ] Invoked (1.2.7): /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-node1-mon-centos-6-4 ...

[ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection without sudo

[ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final

[ceph-node1-mon-centos-6-4][INFO  ] installing ceph on ceph-node1-mon-centos-6-4

[ceph-node1-mon-centos-6-4][INFO  ] adding EPEL repository

[ceph-node1-mon-centos-6-4][INFO  ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

[ceph-node1-mon-centos-6-4][ERROR ] --2013-10-29 13:40:43--  http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

[ceph-node1-mon-centos-6-4][ERROR ] Connecting to 10.12.132.208:8080... connected.

[ceph-node1-mon-centos-6-4][ERROR ] Proxy request sent, awaiting response... 200 OK

[ceph-node1-mon-centos-6-4][ERROR ] Length: 14540 (14K) [application/x-rpm]

[ceph-node1-mon-centos-6-4][ERROR ] Saving to: `epel-release-6-8.noarch.rpm'

[ceph-node1-mon-centos-6-4][ERROR ]      0K .......... ....                                       100% 1.52M=0.009s

[ceph-node1-mon-centos-6-4][ERROR ] Last-modified header invalid -- time-stamp ignored.

[ceph-node1-mon-centos-6-4][ERROR ] 2013-10-29 13:41:42 (1.52 MB/s) - `epel-release-6-8.noarch.rpm' saved [14540/14540]

[ceph-node1-mon-centos-6-4][INFO  ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm

[ceph-node1-mon-centos-6-4][INFO  ] Preparing...                ##################################################

[ceph-node1-mon-centos-6-4][INFO  ] epel-release                ##################################################

[ceph-node1-mon-centos-6-4][ERROR ] warning: epel-release-6-8.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY

[ceph-node1-mon-centos-6-4][INFO  ] Running command: su -c 'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc"'

[ceph-node1-mon-centos-6-4][ERROR ] Traceback (most recent call last):

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line 23, in install

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, in inner

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in remote_call

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib64/python2.6/subprocess.py", line 502, in check_call

[ceph-node1-mon-centos-6-4][ERROR ]     raise CalledProcessError(retcode, cmd)

[ceph-node1-mon-centos-6-4][ERROR ] CalledProcessError: Command '['su -c \'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc"\'']' returned non-zero exit status 1

[ceph-node1-mon-centos-6-4][ERROR ] curl: (7) couldn't connect to host

[ceph-node1-mon-centos-6-4][ERROR ] error: https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc: import read failed(2).

[ceph_deploy][ERROR ] RuntimeError: Failed to execute command: su -c 'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc"'

 

Does anyone know why?

 

Thanks a lot in advance!

Nar

From:alistair.whittle at barclays.com<mailto:alistair.whittle at barclays.com> [mailto:alistair.whittle at barclays.com]

Sent: Tuesday, October 29, 2013 12:08 PM

To: joseph.r.gruher at intel.com<mailto:joseph.r.gruher at intel.com>; Trivedi, Narendra; ceph-users at lists.ceph.com<mailto:ceph-users at lists.ceph.com>

Subject: RE: ceph-deploy problems on CentOS-6.4

 

You also want to make sure that if you are using a proxy your proxy settings are maintained through sudo.

 

With my deployment I had to add a line to my sudoers file to specify that the https_proxy and http_proxy settings are maintained.  Didn’t work otherwise.

 

Defaults env_keep += "http_proxy https_proxy"

 

 

From:ceph-users-bounces at lists.ceph.com<mailto:ceph-users-bounces at lists.ceph.com> [mailto:ceph-users-bounces at lists.ceph.com] On Behalf Of Gruher, Joseph R

Sent: Tuesday, October 29, 2013 4:55 PM

To: Trivedi, Narendra; ceph-users at lists.ceph.com<mailto:ceph-users at lists.ceph.com>

Subject: Re: ceph-deploy problems on CentOS-6.4

 

If you are behind a proxy try configuring the wget proxy through /etc/wgetrc.  I had a similar problem where I could complete wget commands manually but they would fail in ceph-deploy until I configured the wget proxy in that manner.

 

From: ceph-users-bounces at lists.ceph.com<mailto:ceph-users-bounces at lists.ceph.com> [mailto:ceph-users-bounces at lists.ceph.com] On Behalf Of Trivedi, Narendra

Sent: Tuesday, October 29, 2013 9:51 AM

To: ceph-users at lists.ceph.com<mailto:ceph-users at lists.ceph.com>

Subject: ceph-deploy problems on CentOS-6.4

 

Hi All,

 

I am a newbie to ceph. I am installing ceph (dumpling release) using ceph-deploy (issued from my admin node) on one monitor and two OSD nodes running CentOS 6.4 (64-bit) using followed instructions in the link below:

 

http://ceph.com/docs/master/start/quick-ceph-deploy/

 

My setup looks exactly like the diagram. I followed pre-flight instructions exacty as outlined in the link below:

 

http://ceph.com/docs/master/start/quick-start-preflight/

 

The ceph-deploy takes forever and then throws up the following error:

 

2013-10-28 17:32:35,903 [ceph_deploy.cli][INFO  ] Invoked (1.2.7): /usr/bin/ceph-deploy new ceph-node1-mon-centos-6-4

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Creating new cluster named ceph

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Resolving host ceph-node1-mon-centos-6-4

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor ceph-node1-mon-centos-6-4 at 10.12.0.70

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor initial members are ['ceph-node1-mon-centos-6-4']

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor addrs are ['10.12.0.70']

2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Creating a random mon key...

2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf...

2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring...

2013-10-28 17:33:10,287 [ceph_deploy.cli][INFO  ] Invoked (1.2.7): /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4

2013-10-28 17:33:10,287 [ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4

2013-10-28 17:33:10,288 [ceph_deploy.install][DEBUG ] Detecting platform for host ceph-node1-mon-centos-6-4 ...

2013-10-28 17:33:10,288 [ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection without sudo

2013-10-28 17:33:10,626 [ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final

2013-10-28 17:33:10,626 [ceph-node1-mon-centos-6-4][INFO  ] installing ceph on ceph-node1-mon-centos-6-4

2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO  ] adding EPEL repository

2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO  ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

2013-10-28 19:20:35,893 [ceph-node1-mon-centos-6-4][ERROR ] Traceback (most recent call last):

2013-10-28 19:20:35,894 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line 77, in install_epel

2013-10-28 19:20:35,899 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, in inner

2013-10-28 19:20:35,900 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in remote_call

2013-10-28 19:20:35,902 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib64/python2.6/subprocess.py", line 502, in check_call

2013-10-28 19:20:35,903 [ceph-node1-mon-centos-6-4][ERROR ]     raise CalledProcessError(retcode, cmd)

2013-10-28 19:20:35,904 [ceph-node1-mon-centos-6-4][ERROR ] CalledProcessError: Command '['wget', 'http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm']' returned non-zero exit status 4

2013-10-28 19:20:35,123 [ceph-node1-mon-centos-6-4][ERROR ] --2013-10-28 17:33:10--  http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

2013-10-28 19:20:35,123 [ceph-node1-mon-centos-6-4][ERROR ] Resolving dl.fedoraproject.org... 209.132.181.25, 209.132.181.26, 209.132.181.27, ...

2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to dl.fedoraproject.org<http://dl.fedoraproject.org/>|209.132.181.25|:80... failed: Connection timed out.

2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to dl.fedoraproject.org<http://dl.fedoraproject.org/>|209.132.181.26|:80... failed: Connection timed out.

 

Interestingly, “wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm” on each nodes (1 mon and 2 OSDs) succeeds without any problem. I have tried everything many times with root user, ceph user etc. but it fails every time! It is very frustrating!

 

Has anyone else experienced the same or similar problem?

 

Thanks a lot in advance!

Nar

 

 

This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies.

 

_______________________________________________

 

This message is for information purposes only, it is not a recommendation, advice, offer or solicitation to buy or sell a product or service nor an official confirmation of any transaction. It is directed at persons who are professionals and is not intended for retail customer use. Intended for recipient only. This message is subject to the terms at: www.barclays.com/emaildisclaimer<http://www.barclays.com/emaildisclaimer>.

 

For important disclosures, please see: www.barclays.com/salesandtradingdisclaimer<http://www.barclays.com/salesandtradingdisclaimer> regarding market commentary from Barclays Sales and/or Trading, who are active market participants; and in respect of Barclays Research, including disclosures relating to specific issuers, please see http://publicresearch.barclays.com.

 

_______________________________________________

 

This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies.

 

_______________________________________________

 

This message is for information purposes only, it is not a recommendation, advice, offer or solicitation to buy or sell a product or service nor an official confirmation of any transaction. It is directed at persons who are professionals and is not intended for retail customer use. Intended for recipient only. This message is subject to the terms at: www.barclays.com/emaildisclaimer<http://www.barclays.com/emaildisclaimer>.

 

For important disclosures, please see: www.barclays.com/salesandtradingdisclaimer<http://www.barclays.com/salesandtradingdisclaimer> regarding market commentary from Barclays Sales and/or Trading, who are active market participants; and in respect of Barclays Research, including disclosures relating to specific issuers, please see http://publicresearch.barclays.com.

 

_______________________________________________

-------------- next part --------------

An HTML attachment was scrubbed...

URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20131029/7ce9da22/attachment-0001.htm>


 

 

From: Gruher, Joseph R [mailto:joseph.r.gruher@xxxxxxxxx]
Sent: Tuesday, October 29, 2013 1:49 PM
To: Trivedi, Narendra; alistair.whittle@xxxxxxxxxxxx; ceph-users@xxxxxxxxxxxxxx
Subject: RE: ceph-deploy problems on CentOS-6.4

 

Now you need to set the Curl proxy in /root/.curlrc (might also set it in ~/.curlrc for good measure).

 

To ceph-deploy on CentOS 6.4 I had to set all these proxies:

Curl: /root/.curlrc

rpm: /root/.rpmmacros

wget: /etc/wgetrc

yum: /etc/yum.conf

 

 

From: Trivedi, Narendra [mailto:Narendra.Trivedi@xxxxxxxxxx]
Sent: Tuesday, October 29, 2013 11:45 AM
To: alistair.whittle@xxxxxxxxxxxx; Gruher, Joseph R; ceph-users@xxxxxxxxxxxxxx
Subject: RE: ceph-deploy problems on CentOS-6.4

 

I made the changes and it seems now it can successfully wget the rpm but getting a different error now:

 

[root@ceph-admin-node-centos-6-4 my-cluster]# ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.cli][INFO  ] Invoked (1.2.7): /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-node3-osd1-centos-6-4

[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-node1-mon-centos-6-4 ...

[ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection without sudo

[ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final

[ceph-node1-mon-centos-6-4][INFO  ] installing ceph on ceph-node1-mon-centos-6-4

[ceph-node1-mon-centos-6-4][INFO  ] adding EPEL repository

[ceph-node1-mon-centos-6-4][INFO  ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

[ceph-node1-mon-centos-6-4][ERROR ] --2013-10-29 13:40:43--  http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

[ceph-node1-mon-centos-6-4][ERROR ] Connecting to 10.12.132.208:8080... connected.

[ceph-node1-mon-centos-6-4][ERROR ] Proxy request sent, awaiting response... 200 OK

[ceph-node1-mon-centos-6-4][ERROR ] Length: 14540 (14K) [application/x-rpm]

[ceph-node1-mon-centos-6-4][ERROR ] Saving to: `epel-release-6-8.noarch.rpm'

[ceph-node1-mon-centos-6-4][ERROR ]      0K .......... ....                                       100% 1.52M=0.009s

[ceph-node1-mon-centos-6-4][ERROR ] Last-modified header invalid -- time-stamp ignored.

[ceph-node1-mon-centos-6-4][ERROR ] 2013-10-29 13:41:42 (1.52 MB/s) - `epel-release-6-8.noarch.rpm' saved [14540/14540]

[ceph-node1-mon-centos-6-4][INFO  ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm

[ceph-node1-mon-centos-6-4][INFO  ] Preparing...                ##################################################

[ceph-node1-mon-centos-6-4][INFO  ] epel-release                ##################################################

[ceph-node1-mon-centos-6-4][ERROR ] warning: epel-release-6-8.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY

[ceph-node1-mon-centos-6-4][INFO  ] Running command: su -c 'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc"'

[ceph-node1-mon-centos-6-4][ERROR ] Traceback (most recent call last):

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line 23, in install

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, in inner

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in remote_call

[ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib64/python2.6/subprocess.py", line 502, in check_call

[ceph-node1-mon-centos-6-4][ERROR ]     raise CalledProcessError(retcode, cmd)

[ceph-node1-mon-centos-6-4][ERROR ] CalledProcessError: Command '['su -c \'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc"\'']' returned non-zero exit status 1

[ceph-node1-mon-centos-6-4][ERROR ] curl: (7) couldn't connect to host

[ceph-node1-mon-centos-6-4][ERROR ] error: https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc: import read failed(2).

[ceph_deploy][ERROR ] RuntimeError: Failed to execute command: su -c 'rpm --import "https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc"'

                                                                                                                                                                         

Does anyone know why?

 

Thanks a lot in advance!

Nar

From: alistair.whittle@xxxxxxxxxxxx [mailto:alistair.whittle@xxxxxxxxxxxx]
Sent: Tuesday, October 29, 2013 12:08 PM
To:
joseph.r.gruher@xxxxxxxxx; Trivedi, Narendra; ceph-users@xxxxxxxxxxxxxx
Subject: RE: ceph-deploy problems on CentOS-6.4

 

You also want to make sure that if you are using a proxy your proxy settings are maintained through sudo.  

 

With my deployment I had to add a line to my sudoers file to specify that the https_proxy and http_proxy settings are maintained.  Didn’t work otherwise.

 

Defaults env_keep += "http_proxy https_proxy"

 

 

From: ceph-users-bounces@xxxxxxxxxxxxxx [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Gruher, Joseph R
Sent: Tuesday, October 29, 2013 4:55 PM
To: Trivedi, Narendra;
ceph-users@xxxxxxxxxxxxxx
Subject: Re: ceph-deploy problems on CentOS-6.4

 

If you are behind a proxy try configuring the wget proxy through /etc/wgetrc.  I had a similar problem where I could complete wget commands manually but they would fail in ceph-deploy until I configured the wget proxy in that manner.

 

From: ceph-users-bounces@xxxxxxxxxxxxxx [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Trivedi, Narendra
Sent: Tuesday, October 29, 2013 9:51 AM
To: ceph-users@xxxxxxxxxxxxxx
Subject: ceph-deploy problems on CentOS-6.4

 

Hi All,

 

I am a newbie to ceph. I am installing ceph (dumpling release) using ceph-deploy (issued from my admin node) on one monitor and two OSD nodes running CentOS 6.4 (64-bit) using followed instructions in the link below:

 

http://ceph.com/docs/master/start/quick-ceph-deploy/

 

My setup looks exactly like the diagram. I followed pre-flight instructions exacty as outlined in the link below:

 

http://ceph.com/docs/master/start/quick-start-preflight/

 

The ceph-deploy takes forever and then throws up the following error:  

 

2013-10-28 17:32:35,903 [ceph_deploy.cli][INFO  ] Invoked (1.2.7): /usr/bin/ceph-deploy new ceph-node1-mon-centos-6-4

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Creating new cluster named ceph

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Resolving host ceph-node1-mon-centos-6-4

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor ceph-node1-mon-centos-6-4 at 10.12.0.70

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor initial members are ['ceph-node1-mon-centos-6-4']

2013-10-28 17:32:35,904 [ceph_deploy.new][DEBUG ] Monitor addrs are ['10.12.0.70']

2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Creating a random mon key...

2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf...

2013-10-28 17:32:35,905 [ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring...

2013-10-28 17:33:10,287 [ceph_deploy.cli][INFO  ] Invoked (1.2.7): /usr/bin/ceph-deploy install ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4

2013-10-28 17:33:10,287 [ceph_deploy.install][DEBUG ] Installing stable version dumpling on cluster ceph hosts ceph-node1-mon-centos-6-4 ceph-node2-osd0-centos-6-4 ceph-admin-node-centos-6-4

2013-10-28 17:33:10,288 [ceph_deploy.install][DEBUG ] Detecting platform for host ceph-node1-mon-centos-6-4 ...

2013-10-28 17:33:10,288 [ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection without sudo

2013-10-28 17:33:10,626 [ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final

2013-10-28 17:33:10,626 [ceph-node1-mon-centos-6-4][INFO  ] installing ceph on ceph-node1-mon-centos-6-4

2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO  ] adding EPEL repository

2013-10-28 17:33:10,633 [ceph-node1-mon-centos-6-4][INFO  ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

2013-10-28 19:20:35,893 [ceph-node1-mon-centos-6-4][ERROR ] Traceback (most recent call last):

2013-10-28 19:20:35,894 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py", line 77, in install_epel

2013-10-28 19:20:35,899 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py", line 10, in inner

2013-10-28 19:20:35,900 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib/python2.6/site-packages/ceph_deploy/util/wrappers.py", line 6, in remote_call

2013-10-28 19:20:35,902 [ceph-node1-mon-centos-6-4][ERROR ]   File "/usr/lib64/python2.6/subprocess.py", line 502, in check_call

2013-10-28 19:20:35,903 [ceph-node1-mon-centos-6-4][ERROR ]     raise CalledProcessError(retcode, cmd)

2013-10-28 19:20:35,904 [ceph-node1-mon-centos-6-4][ERROR ] CalledProcessError: Command '['wget', 'http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm']' returned non-zero exit status 4

2013-10-28 19:20:35,123 [ceph-node1-mon-centos-6-4][ERROR ] --2013-10-28 17:33:10--  http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

2013-10-28 19:20:35,123 [ceph-node1-mon-centos-6-4][ERROR ] Resolving dl.fedoraproject.org... 209.132.181.25, 209.132.181.26, 209.132.181.27, ...

2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to dl.fedoraproject.org|209.132.181.25|:80... failed: Connection timed out.

2013-10-28 19:20:35,912 [ceph-node1-mon-centos-6-4][ERROR ] Connecting to dl.fedoraproject.org|209.132.181.26|:80... failed: Connection timed out.

 

Interestingly, “wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm on each nodes (1 mon and 2 OSDs) succeeds without any problem. I have tried everything many times with root user, ceph user etc. but it fails every time! It is very frustrating!

 

Has anyone else experienced the same or similar problem?

 

Thanks a lot in advance!

Nar

 


This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies.

_______________________________________________

This message is for information purposes only, it is not a recommendation, advice, offer or solicitation to buy or sell a product or service nor an official confirmation of any transaction. It is directed at persons who are professionals and is not intended for retail customer use. Intended for recipient only. This message is subject to the terms at: www.barclays.com/emaildisclaimer.

For important disclosures, please see: www.barclays.com/salesandtradingdisclaimer regarding market commentary from Barclays Sales and/or Trading, who are active market participants; and in respect of Barclays Research, including disclosures relating to specific issuers, please see http://publicresearch.barclays.com.

_______________________________________________


This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies.


This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies.


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux