Oh, hey look at that. I must have screwed something up before. I
thought it was strange that it didn't work.
Works now, thanks!
-Steve
On 10/27/2014 03:20 PM, Scott Laird
wrote:
Double-check that you did it right. Does 'ls -lL
/var/lib/ceph/osd/ceph-33/journal' resolve to a block-special
device?
On Mon Oct 27 2014 at 12:12:20 PM Steve
Anthony < sma310@xxxxxxxxxx>
wrote:
Nice. Thanks all, I'll
adjust my scripts to call ceph-deploy using /dev/disk/by-id
for future ODSs.
I tried stopping an existing OSD on another node (which is
working - osd.33 in this case), changing
/var/lib/ceph/osd/ceph-33/journal to point to the same
partition using /dev/disk/by-id, and starting the OSD again,
but it fails to start with:
2014-10-27 11:03:31.607060 7fa65018e780 -1
filestore(/var/lib/ceph/osd/ceph-33) mount failed to open
journal /var/lib/ceph/osd/ceph-33/journal: (2) No such file
or directory
2014-10-27 11:03:31.617262 7fa65018e780 -1 ** ERROR: error
converting store /var/lib/ceph/osd/ceph-33: (2) No such file
or directory
The journal symlink exists and points to the same partition
as before when it was /dev/sde1. Can I not change these
existing symlinks manually to point to the same partition
using /dev/disk/by-id?
-Steve
On 10/27/2014 12:44 PM, Mariusz Gronczewski wrote:
> * /dev/disk/by-id
>
> by-path will change if you connect it to different
controller, or
> replace your controller with other model, or put it
in different pci
> slot
>
> On Sat, 25 Oct 2014 17:20:58 +0000, Scott Laird <scott@xxxxxxxxxxx>
> wrote:
>
>> You'd be best off using /dev/disk/by-path/ or
similar links; that way they
>> follow the disks if they're renamed again.
>>
>> On Fri, Oct 24, 2014, 9:40 PM Steve Anthony <sma310@xxxxxxxxxx> wrote:
>>
>>> Hello,
>>>
>>> I was having problems with a node in my
cluster (Ceph v0.80.7/Debian
>>> Wheezy/Kernel 3.12), so I rebooted it and the
disks were relabled when
>>> it came back up. Now all the symlinks to the
journals are broken. The
>>> SSDs are now sda, sdb, and sdc but the
journals were sdc, sdd, and sde:
>>>
>>> root@ceph17:~# ls -l
/var/lib/ceph/osd/ceph-*/journal
>>> lrwxrwxrwx 1 root root 9 Oct 20 16:47
/var/lib/ceph/osd/ceph-150/journal
>>> -> /dev/sde1
>>> lrwxrwxrwx 1 root root 9 Oct 20 16:53
/var/lib/ceph/osd/ceph-157/journal
>>> -> /dev/sdd1
>>> lrwxrwxrwx 1 root root 9 Oct 21 08:31
/var/lib/ceph/osd/ceph-164/journal
>>> -> /dev/sdc1
>>> lrwxrwxrwx 1 root root 9 Oct 21 16:33
/var/lib/ceph/osd/ceph-171/journal
>>> -> /dev/sde2
>>> lrwxrwxrwx 1 root root 9 Oct 22 10:50
/var/lib/ceph/osd/ceph-178/journal
>>> -> /dev/sdc2
>>> lrwxrwxrwx 1 root root 9 Oct 22 15:48
/var/lib/ceph/osd/ceph-184/journal
>>> -> /dev/sdd2
>>> lrwxrwxrwx 1 root root 9 Oct 23 10:46
/var/lib/ceph/osd/ceph-191/journal
>>> -> /dev/sde3
>>> lrwxrwxrwx 1 root root 9 Oct 23 15:22
/var/lib/ceph/osd/ceph-195/journal
>>> -> /dev/sdc3
>>> lrwxrwxrwx 1 root root 9 Oct 23 16:59
/var/lib/ceph/osd/ceph-201/journal
>>> -> /dev/sdd3
>>> lrwxrwxrwx 1 root root 9 Oct 24 21:32
/var/lib/ceph/osd/ceph-214/journal
>>> -> /dev/sde4
>>> lrwxrwxrwx 1 root root 9 Oct 24 21:33
/var/lib/ceph/osd/ceph-215/journal
>>> -> /dev/sdd4
>>>
>>> Any way to fix this without just removing all
the OSDs and re-adding
>>> them? I thought about recreating the symlinks
to point at the new SSD
>>> labels, but I figured I'd check here first.
Thanks!
>>>
>>> -Steve
>>>
>>> --
>>> Steve Anthony
>>> LTS HPC Support Specialist
>>> Lehigh University
>>> sma310@xxxxxxxxxx
>>>
>>>
_______________________________________________
>>> ceph-users mailing list
>>> ceph-users@xxxxxxxxxxxxxx
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>
>
>
--
Steve Anthony
LTS HPC Support Specialist
Lehigh University
sma310@xxxxxxxxxx
--
Steve Anthony
LTS HPC Support Specialist
Lehigh University
sma310@xxxxxxxxxx
|
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
