On Mon Oct 27 2014 at 12:12:20 PM Steve Anthony <sma310@xxxxxxxxxx> wrote:
Nice. Thanks all, I'll adjust my scripts to call ceph-deploy using /dev/disk/by-id for future ODSs.
I tried stopping an existing OSD on another node (which is working - osd.33 in this case), changing /var/lib/ceph/osd/ceph-33/journal to point to the same partition using /dev/disk/by-id, and starting the OSD again, but it fails to start with:
2014-10-27 11:03:31.607060 7fa65018e780 -1 filestore(/var/lib/ceph/osd/ceph-33) mount failed to open journal /var/lib/ceph/osd/ceph-33/journal: (2) No such file or directory
2014-10-27 11:03:31.617262 7fa65018e780 -1 ** ERROR: error converting store /var/lib/ceph/osd/ceph-33: (2) No such file or directory
The journal symlink exists and points to the same partition as before when it was /dev/sde1. Can I not change these existing symlinks manually to point to the same partition using /dev/disk/by-id?
-Steve
On 10/27/2014 12:44 PM, Mariusz Gronczewski wrote:
> * /dev/disk/by-id
>
> by-path will change if you connect it to different controller, or
> replace your controller with other model, or put it in different pci
> slot
>
> On Sat, 25 Oct 2014 17:20:58 +0000, Scott Laird <scott@xxxxxxxxxxx>
> wrote:
>
>> You'd be best off using /dev/disk/by-path/ or similar links; that way they
>> follow the disks if they're renamed again.
>>
>> On Fri, Oct 24, 2014, 9:40 PM Steve Anthony <sma310@xxxxxxxxxx> wrote:
>>
>>> Hello,
>>>
>>> I was having problems with a node in my cluster (Ceph v0.80.7/Debian
>>> Wheezy/Kernel 3.12), so I rebooted it and the disks were relabled when
>>> it came back up. Now all the symlinks to the journals are broken. The
>>> SSDs are now sda, sdb, and sdc but the journals were sdc, sdd, and sde:
>>>
>>> root@ceph17:~# ls -l /var/lib/ceph/osd/ceph-*/journal
>>> lrwxrwxrwx 1 root root 9 Oct 20 16:47 /var/lib/ceph/osd/ceph-150/journal
>>> -> /dev/sde1
>>> lrwxrwxrwx 1 root root 9 Oct 20 16:53 /var/lib/ceph/osd/ceph-157/journal
>>> -> /dev/sdd1
>>> lrwxrwxrwx 1 root root 9 Oct 21 08:31 /var/lib/ceph/osd/ceph-164/journal
>>> -> /dev/sdc1
>>> lrwxrwxrwx 1 root root 9 Oct 21 16:33 /var/lib/ceph/osd/ceph-171/journal
>>> -> /dev/sde2
>>> lrwxrwxrwx 1 root root 9 Oct 22 10:50 /var/lib/ceph/osd/ceph-178/journal
>>> -> /dev/sdc2
>>> lrwxrwxrwx 1 root root 9 Oct 22 15:48 /var/lib/ceph/osd/ceph-184/journal
>>> -> /dev/sdd2
>>> lrwxrwxrwx 1 root root 9 Oct 23 10:46 /var/lib/ceph/osd/ceph-191/journal
>>> -> /dev/sde3
>>> lrwxrwxrwx 1 root root 9 Oct 23 15:22 /var/lib/ceph/osd/ceph-195/journal
>>> -> /dev/sdc3
>>> lrwxrwxrwx 1 root root 9 Oct 23 16:59 /var/lib/ceph/osd/ceph-201/journal
>>> -> /dev/sdd3
>>> lrwxrwxrwx 1 root root 9 Oct 24 21:32 /var/lib/ceph/osd/ceph-214/journal
>>> -> /dev/sde4
>>> lrwxrwxrwx 1 root root 9 Oct 24 21:33 /var/lib/ceph/osd/ceph-215/journal
>>> -> /dev/sdd4
>>>
>>> Any way to fix this without just removing all the OSDs and re-adding
>>> them? I thought about recreating the symlinks to point at the new SSD
>>> labels, but I figured I'd check here first. Thanks!
>>>
>>> -Steve
>>>
>>> --
>>> Steve Anthony
>>> LTS HPC Support Specialist
>>> Lehigh University
>>> sma310@xxxxxxxxxx
>>>
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users@xxxxxxxxxxxxxx
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>
>
>
--
Steve Anthony
LTS HPC Support Specialist
Lehigh University
sma310@xxxxxxxxxx
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
