Thank you for taking the time to reply. I removed the file /lib/udev/rules.d/95-ceph-osd.rules from all my nodes and tried to recreate the osd's. The bellow pastebin is an example of the commands: ceph-deploy disk zap ceph02:/dev/sdc ceph-deploy osd prepare --zap-disk ceph02:sda:/dev/sdc ceph-deploy osd activate ceph02:/dev/sda1 http://paste.debian.net/211771/ It ends with the errors: [ceph02][WARNIN] 2015-06-08 12:05:34.094844 7f19bdef77c0 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected 25189ded-d858-4720-8c6e-c7af66d1ff83, invalid (someone else's?) journal [ceph02][WARNIN] 2015-06-08 12:05:35.191998 7f19bdef77c0 -1 filestore(/var/lib/ceph/tmp/mnt.V3wZOX) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory root@ceph-deploy:~/ceph-cluster# ceph -v ceph version 0.80.9 (b5a67f0e1d15385bc0d60a6da6e7fc810bde6047) (from https://packages.debian.org/jessie/ceph) I will try to purge everything and retry to make sure there is no "old" date intervening. Does anyone knows what is going on? Kind regards, Jelle de Jong On 08/06/15 09:58, Christian Balzer wrote: > > Hello, > > All I can tell you is that I'm seeing the same thing frequently on > Debian Jessie and that it indeed seems to be a race condition between udev > and ceph-deploy (ceph-disk). > > I "solved" this by killing of the process stuck on the target node (the > one with the tmp/mnt directory) and then doing an "ceph-deploy activate" > until it works. > > While the udev stuff is "cool" and certainly helpful in certain ways, the > lack of control over it, the whole "magic" of ceph-disk and friends can be > very frustrating and unpredictable. > > Christian > > On Mon, 08 Jun 2015 09:51:14 +0200 Jelle de Jong wrote: > >> On 05/06/15 21:50, Jelle de Jong wrote: >>> I am new to ceph and I am trying to build a cluster for testing. >>> >>> after running: >>> ceph-deploy osd prepare --zap-disk ceph02:/dev/sda >>> >>> It seems udev rules find the disk and try to activate them, but then >>> gets stuck: >>> >>> http://paste.debian.net/plain/204723 >>> >>> Does someone know what is going wrong and how to fix it? >> >> Could someone point me in the right direction? >> >> 2015-06-05 21:47:05.175080 7f8d484ab7c0 -1 >> filestore(/var/lib/ceph/tmp/mnt.75Wqut) could not find >> 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory >> >> ^ is this maybe a known bug? >> >> Kind regards, >> >> Jelle de Jong >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |