Re: mon problems after upgrading to cuttlefish

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,


please do not forget to respond to the list ceph-users@xxxxxxxxxxxxxx

find answer below.

Am 23.05.2013 17:16, schrieb Bryan Stillwell:
> This is what I currently have configured:
> 
> 
> # Ceph config file
> 
> [global]
>         auth cluster required = none
>         auth service required = none
> #       auth client required = cephx
> 
> [osd]
>         osd journal size = 1000
>         filestore xattr use omap = true
>         osd mkfs type = xfs
>         osd mkfs options xfs = noatime
> 
> [mon.a]
>         host = a1
>         mon addr = 172.24.88.50:6789
> 
> [osd.0]
>         host = b1
>         devs = /dev/sdb
> 
> [osd.1]
>         host = b1
>         devs = /dev/sdc
> 
> [osd.2]
>         host = b1
>         devs = /dev/sdd
> 
> [osd.3]
>         host = b1
>         devs = /dev/sde
> 
> [osd.4]
>         host = b1
>         devs = /dev/sdf
> 
> [osd.5]
>         host = b2
>         devs = /dev/sdb
> 
> [osd.6]
>         host = b2
>         devs = /dev/sdc
> 
> [osd.7]
>         host = b2
>         devs = /dev/sdd1
> 
> [osd.8]
>         host = b2
>         devs = /dev/sde
> 
> [osd.9]
>         host = b2
>         devs = /dev/sdf
> 
> [osd.10]
>         host = b3
>         devs = /dev/sdb1
> 
> [osd.11]
>         host = b3
>         devs = /dev/sdc1
> 
> [osd.12]
>         host = b3
>         devs = /dev/sdd1
> 
> [osd.13]
>         host = b3
>         devs = /dev/sde1
> 
> [osd.14]
>         host = b3
>         devs = /dev/sdf1
> 
> [osd.15]
>         host = b4
>         devs = /dev/sdb1
> 
> [osd.16]
>         host = b4
>         devs = /dev/sdc1
> 
> [osd.17]
>         host = b4
>         devs = /dev/sdd1
> 
> [osd.18]
>         host = b4
>         devs = /dev/sde1
> 
> [osd.19]
>         host = b4
>         devs = /dev/sdf1
> 
> [osd.20]
>         host = b1
>         devs = /dev/sda4
> 
> [osd.21]
>         host = b2
>         devs = /dev/sda4
> 
> [osd.22]
>         host = b3
>         devs = /dev/sda4
> 
> [osd.23]
>         host = b4
>         devs = /dev/sda4
> 
> [mds.a]
>         host = a1
> 
> #[client]
> #       debug ms = 1
> #       debug client = 20
> 
> On Thu, May 23, 2013 at 4:00 AM, Smart Weblications GmbH - Florian
> Wiessner <f.wiessner@xxxxxxxxxxxxxxxxxxxxx> wrote:
>> Am 23.05.2013 07:45, schrieb Bryan Stillwell:
>>> I attempted to upgrade my bobtail cluster to cuttlefish tonight and I
>>> believe I'm running into some mon related issues.  I did the original
>>> install manually instead of with mkcephfs or ceph-deploy, so I think
>>> that might have to do with this error:
>>>
>>> root@a1:~# ceph-mon -d -c /etc/ceph/ceph.conf
>>> 2013-05-22 23:37:29.283975 7f8fb97b3780  0 ceph version 0.61.2
>>> (fea782543a844bb277ae94d3391788b76c5bee60), process ceph-mon, pid 5531
>>> IO error: /var/lib/ceph/mon/ceph-admin/store.db/LOCK: No such file or directory
>>> 2013-05-22 23:37:29.286534 7f8fb97b3780  1 unable to open monitor
>>> store at /var/lib/ceph/mon/ceph-admin
>>> 2013-05-22 23:37:29.286544 7f8fb97b3780  1 check for old monitor store format
>>> 2013-05-22 23:37:29.286550 7f8fb97b3780  1
>>> store(/var/lib/ceph/mon/ceph-admin) mount
>>> 2013-05-22 23:37:29.286559 7f8fb97b3780  1
>>> store(/var/lib/ceph/mon/ceph-admin) basedir
>>> /var/lib/ceph/mon/ceph-admin dne
>>> 2013-05-22 23:37:29.286564 7f8fb97b3780 -1 unable to mount monitor
>>> store: (2) No such file or directory
>>> 2013-05-22 23:37:29.286577 7f8fb97b3780 -1 found errors while
>>> attempting to convert the monitor store: (2) No such file or directory
>>> root@a1:~# ls -l /var/lib/ceph/mon/
>>> total 4
>>> drwxr-xr-x 15 root root 4096 May 22 23:30 ceph-a
>>>
>>>
>>> I only have one mon daemon in this cluster as well.  I was planning on
>>> upgrading it to 3 tonight but when I try to run most commands they
>>> just hang now.
>>>
>>> I do see the store.db directory in the ceph-a directory if that helps:
>>>
>>> root@a1:~# ls -l  /var/lib/ceph/mon/ceph-a/
>>> total 868
>>> drwxr-xr-x 2 root root   4096 May 22 23:30 auth
>>> drwxr-xr-x 2 root root   4096 May 22 23:30 auth_gv
>>> -rw------- 1 root root     37 Feb  4 14:22 cluster_uuid
>>> -rw------- 1 root root      2 May 22 23:30 election_epoch
>>> -rw------- 1 root root    120 Feb  4 14:22 feature_set
>>> -rw------- 1 root root      2 Dec 28 11:35 joined
>>> -rw------- 1 root root     77 May 22 22:30 keyring
>>> -rw------- 1 root root      0 Dec 28 11:35 lock
>>> drwxr-xr-x 2 root root  20480 May 22 23:30 logm
>>> drwxr-xr-x 2 root root  20480 May 22 23:30 logm_gv
>>> -rw------- 1 root root     21 Dec 28 11:35 magic
>>> drwxr-xr-x 2 root root  12288 May 22 23:30 mdsmap
>>> drwxr-xr-x 2 root root  12288 May 22 23:30 mdsmap_gv
>>> drwxr-xr-x 2 root root   4096 Dec 28 11:35 monmap
>>> drwxr-xr-x 2 root root 233472 May 22 23:30 osdmap
>>> drwxr-xr-x 2 root root 237568 May 22 23:30 osdmap_full
>>> drwxr-xr-x 2 root root 253952 May 22 23:30 osdmap_gv
>>> drwxr-xr-x 2 root root  20480 May 22 23:30 pgmap
>>> drwxr-xr-x 2 root root  20480 May 22 23:30 pgmap_gv
>>> drwxr-xr-x 2 root root   4096 May 22 23:36 store.db
>>>
>>>
>>
>> what does your ceph.conf look like?
>>
>>
>>> store(/var/lib/ceph/mon/ceph-admin) mount
>>> 2013-05-22 23:37:29.286559 7f8fb97b3780  1
>>> store(/var/lib/ceph/mon/ceph-admin) basedir
>>> /var/lib/ceph/mon/ceph-admin dne
>>> 2013-05-22 23:37:29.286564 7f8fb97b3780 -1 unable to mount monitor
>>> store: (2) No such file or directory
>>
>> indicates that the path to monitor data dir is not configured properly..
>>

you may need to update your [mon.a] section in your ceph.conf like this:


[mon.a]
       mon data = /var/lib/ceph/mon/ceph-a/




-- 

Mit freundlichen Grüßen,

Florian Wiessner

Smart Weblications GmbH
Martinsberger Str. 1
D-95119 Naila

fon.: +49 9282 9638 200
fax.: +49 9282 9638 205
24/7: +49 900 144 000 00 - 0,99 EUR/Min*
http://www.smart-weblications.de

--
Sitz der Gesellschaft: Naila
Geschäftsführer: Florian Wiessner
HRB-Nr.: HRB 3840 Amtsgericht Hof
*aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux