|
Nice. Thanks all, I'll adjust my scripts to call ceph-deploy using
/dev/disk/by-id for future ODSs. I tried stopping an existing OSD on another node (which is working - osd.33 in this case), changing /var/lib/ceph/osd/ceph-33/journal to point to the same partition using /dev/disk/by-id, and starting the OSD again, but it fails to start with: 2014-10-27 11:03:31.607060 7fa65018e780 -1 filestore(/var/lib/ceph/osd/ceph-33) mount failed to open journal /var/lib/ceph/osd/ceph-33/journal: (2) No such file or directory 2014-10-27 11:03:31.617262 7fa65018e780 -1 ** ERROR: error converting store /var/lib/ceph/osd/ceph-33: (2) No such file or directory The journal symlink exists and points to the same partition as before when it was /dev/sde1. Can I not change these existing symlinks manually to point to the same partition using /dev/disk/by-id? -Steve On 10/27/2014 12:44 PM, Mariusz Gronczewski wrote: > * /dev/disk/by-id > > by-path will change if you connect it to different controller, or > replace your controller with other model, or put it in different pci > slot > > On Sat, 25 Oct 2014 17:20:58 +0000, Scott Laird <scott@xxxxxxxxxxx> > wrote: > >> You'd be best off using /dev/disk/by-path/ or similar links; that way they >> follow the disks if they're renamed again. >> >> On Fri, Oct 24, 2014, 9:40 PM Steve Anthony <sma310@xxxxxxxxxx> wrote: >> >>> Hello, >>> >>> I was having problems with a node in my cluster (Ceph v0.80.7/Debian >>> Wheezy/Kernel 3.12), so I rebooted it and the disks were relabled when >>> it came back up. Now all the symlinks to the journals are broken. The >>> SSDs are now sda, sdb, and sdc but the journals were sdc, sdd, and sde: >>> >>> root@ceph17:~# ls -l /var/lib/ceph/osd/ceph-*/journal >>> lrwxrwxrwx 1 root root 9 Oct 20 16:47 /var/lib/ceph/osd/ceph-150/journal >>> -> /dev/sde1 >>> lrwxrwxrwx 1 root root 9 Oct 20 16:53 /var/lib/ceph/osd/ceph-157/journal >>> -> /dev/sdd1 >>> lrwxrwxrwx 1 root root 9 Oct 21 08:31 /var/lib/ceph/osd/ceph-164/journal >>> -> /dev/sdc1 >>> lrwxrwxrwx 1 root root 9 Oct 21 16:33 /var/lib/ceph/osd/ceph-171/journal >>> -> /dev/sde2 >>> lrwxrwxrwx 1 root root 9 Oct 22 10:50 /var/lib/ceph/osd/ceph-178/journal >>> -> /dev/sdc2 >>> lrwxrwxrwx 1 root root 9 Oct 22 15:48 /var/lib/ceph/osd/ceph-184/journal >>> -> /dev/sdd2 >>> lrwxrwxrwx 1 root root 9 Oct 23 10:46 /var/lib/ceph/osd/ceph-191/journal >>> -> /dev/sde3 >>> lrwxrwxrwx 1 root root 9 Oct 23 15:22 /var/lib/ceph/osd/ceph-195/journal >>> -> /dev/sdc3 >>> lrwxrwxrwx 1 root root 9 Oct 23 16:59 /var/lib/ceph/osd/ceph-201/journal >>> -> /dev/sdd3 >>> lrwxrwxrwx 1 root root 9 Oct 24 21:32 /var/lib/ceph/osd/ceph-214/journal >>> -> /dev/sde4 >>> lrwxrwxrwx 1 root root 9 Oct 24 21:33 /var/lib/ceph/osd/ceph-215/journal >>> -> /dev/sdd4 >>> >>> Any way to fix this without just removing all the OSDs and re-adding >>> them? I thought about recreating the symlinks to point at the new SSD >>> labels, but I figured I'd check here first. Thanks! >>> >>> -Steve >>> >>> -- >>> Steve Anthony >>> LTS HPC Support Specialist >>> Lehigh University >>> sma310@xxxxxxxxxx >>> >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@xxxxxxxxxxxxxx >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> > > > -- Steve Anthony LTS HPC Support Specialist Lehigh University sma310@xxxxxxxxxx |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
