Where does it read it from? does it keep it in the block.db lv, or the block dev lv, or both? I removed the vg from the block dev and did wipefs, if I recall. ----- Original Message ----- From: "Eugen Block" <eblock@xxxxxx> To: "Philip Brown" <pbrown@xxxxxxxxxx> Cc: "ceph-users" <ceph-users@xxxxxxx> Sent: Tuesday, April 6, 2021 9:06:50 AM Subject: [BULK] Re: Re: which is definitive: /var/lib/ceph symlinks or ceph-volume? Did you recreate the OSD with the same UUID? I'm guessing ceph-volume just reads LV tags and thinks there's a block.db for that OSD. Before creating the OSD you should also wipe the LV containing the block.db for the failed OSD. Zitat von Philip Brown <pbrown@xxxxxxxxxx>: > It was up and running. > > I should mention that the situation came about when I was testing > OSD rebuild. > > So I had a previously autogenerated hybrid OSD, with SSD db, and HDD > block dev. > > I then stopped the OSD, wiped HDD, .... did "ceph osd rm" and ceph auth rm. > and then rebuilt with ceph-volume.. with the wrong flags. > I belive I used: > > ceph-volume lvm create --block /dev/xxx --journal /dev/blahblah > > After that, ceph-volume lvm list > claimed it was using the ssd again as db device. but ls -l on > /var/lib/ceph/osd/XXXX only showed symlink for block dev. > > This was on nautilus. > > > > ----- Original Message ----- > From: "Eugen Block" <eblock@xxxxxx> > To: "ceph-users" <ceph-users@xxxxxxx> > Sent: Tuesday, April 6, 2021 5:20:40 AM > Subject: Re: which is definitive: /var/lib/ceph > symlinks or ceph-volume? > > Is the OSD up and running? > Do you see IO on the dedicated block.db LV when running a 'ceph tell > osd.7 bench'? It sounds very strange, I haven't seen that. > > > Zitat von Philip Brown <pbrown@xxxxxxxxxx>: > >> I am in a situation where I see conflicting information. >> On the one hand, >> ls -l /var/lib/ceph/osd/ceph-7 >> shows a symlink for block device, but no block.db >> >> On the other hand, >> >> ceph-volume lvm list >> claims that there is a separate db device registered for osd 7 >> >> how can I know which one is correct? >> >> (This is currently ceph nautilus) >> >> >> >> >> >> -- >> Philip Brown| Sr. Linux System Administrator | Medata, Inc. >> 5 Peters Canyon Rd Suite 250 >> Irvine CA 92606 >> Office 714.918.1310| Fax 714.918.1325 >> pbrown@xxxxxxxxxx| www.medata.com >> _______________________________________________ >> ceph-users mailing list -- ceph-users@xxxxxxx >> To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |