Re: newbie / Error connecting to cluster: PermissionError

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



hello Alfredo

here's some additional information and log output attached

had some trouble with yum ("Resolving dl.fedoraproject.org... failed: Name or service not known"), but only with "node3" and "ceph-admin".  looked ok after retrying

-------------------------
[ceph@ceph-admin scripts]$ uname -a
Linux ceph-admin 2.6.32-431.5.1.el6.x86_64 #1 SMP Wed Feb 12 00:41:43 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux

---------------------------------------
[ceph@ceph-admin scripts]$ cat /etc/redhat-release
CentOS release 6.5 (Final)

-------------------
[ceph@node1 ~]$ sudo yum update
........
No Packages marked for Update


----------------------------- iptables

[ceph@node1 ~]$ chkconfig --list|grep tables
ip6tables 0:off 1:off 2:off 3:off 4:off 5:off 6:off
iptables 0:off 1:off 2:off 3:off 4:off 5:off 6:off

[ceph@node1 ~]$ sudo iptables -L
Chain INPUT (policy ACCEPT)
target prot opt source destination

Chain FORWARD (policy ACCEPT)
target prot opt source destination

Chain OUTPUT (policy ACCEPT)
target prot opt source destination


--------------------------- some suspect errors on "activate" (see file 05-activate-typescript)

filestore(/var/local/osd0) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory

---------------- some more diagnostics:

[ceph@node1 ~]$ ceph health
2014-02-19 10:06:56.952386 7ffa7648b700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2014-02-19 10:06:56.952438 7ffa7648b700 0 librados: client.admin initialization error (2) No such file or directory
Error connecting to cluster: ObjectNotFound

----------------------------- setup

vms addresses------------

[ceph@ceph-admin scripts]$ cat /etc/hosts
...........
192.168.50.144 ceph-admin
192.168.50.145 node1
192.168.50.146 node2
192.168.50.147 node3
192.168.50.148 client

ceph version----------

[ceph@node1 ~]$ rpm -q -a |grep -i ceph
ceph-deploy-1.3.5-0.noarch
ceph-release-1-0.el6.noarch
python-ceph-0.72.2-0.el6.x86_64
libcephfs1-0.72.2-0.el6.x86_64
ceph-0.72.2-0.el6.x86_64

hope it's useful

didn't try ubuntu yet

best regards,
joão

Melhores cumprimentos,
João Pagaime,
Área de Infra-estruturas Aplicacionais - FCCN – FCT I.P.

Em 18-02-2014 20:54, Alfredo Deza escreveu:
On Tue, Feb 18, 2014 at 3:44 PM, João Pagaime <jpsp@xxxxxxx> wrote:
Hello João

thanks for the reply

tried again with debian VMs and didn't have any problems (it worked!)

the ceph-deploy script doesn't seem to work perfectly on CentOS 6.5, so I
guess that was the reason for the troubles (it did throw a few errors, but,
since it was on debug mode, I didn't pay much attention)
That sounds odd, we do test ceph-deploy heavily against that distro
and version. It would be useful to
see the log output of your issues and determine if ceph-deploy is
missing something or it needs fixing.

One of the reasons why sometimes getting a cluster up and running
works with some distros right of the bat is
that certain things come enabled/disabled that affect cluster
operation like iptables for example.


thanks, best regards,

Melhores cumprimentos,
João Pagaime,
Área de Infra-estruturas Aplicacionais - FCCN - FCT I.P.

Em 18-02-2014 16:04, Joao Eduardo Luis escreveu:

On 02/18/2014 08:42 AM, João Pagaime wrote:
Hello all

We're looking at Ceph for a possible future pilot, and so
I've just installed ceph-emperor [1] by the "Installation (Quick)"
guide, but got stuck on the following error:

"authentication error (1) Operation not permitted" [2]

could someone give clues as to diagnose (or better yet fix) this problem?

the setup:
- as prescribed by the current "Installation (Quick)" guide
- all vms are "CentOS release 6.5 (Final)" running on vmware-player:
- one VM "admin node ceph-deploy"
- one VM node1 (monitor)
- one VM node2
- one VM node3

any help would be welcome!

best regards
joao

[1]--------------------------- version

$ rpm -q -a |grep -i ceph
libcephfs1-0.72.2-0.el6.x86_64
python-ceph-0.72.2-0.el6.x86_64
ceph-0.72.2-0.el6.x86_64
ceph-release-1-0.el6.noarch

[2]--------------------------------- specific error

[ceph@ceph-node2 ~]$ sudo ceph-disk-activate --mark-init sysvinit
--mount /var/local/osd0
=== osd.0 ===
2014-02-18 08:35:44.769825 7f1659c3c700 0 librados: osd.0
authentication error (1) Operation not permitted
Error connecting to cluster: PermissionError
failed: 'timeout 10 /usr/bin/ceph --name=osd.0
--keyring=/var/lib/ceph/osd/ceph-0/keyring osd crush create-or-move
-- 0 0.05 root=default
host=ceph-node2

Do you have a keyring in /var/lib/ceph/osd/ceph-0/keyring? Does it contain
an entry for 'osd.0'?

What about 'ceph auth export', does it contain an entry for 'osd.0' with a
matching key?

-Joao

'

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Attachment: command-logs.tgz
Description: Binary data

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux