Tim, in a similar case I put 'strace -f' in front of ceph-osd in /sbin/mkcephfs original $BINDIR/ceph-osd -c $conf --monmap $dir/monmap -i $id --mkfs --mkkey change to strace -f $BINDIR/ceph-osd -c $conf --monmap $dir/monmap -i $id --mkfs --mkkey 2> err > out run the test and look in 'err' for 'ENOENT' Cheers, -Dieter On Tue, Aug 28, 2012 at 07:38:09PM +0200, Tim Flavin wrote: > Sage: Yes I tried that. > > user1@ceph4:~/ceph-0.48.1argonaut$ cd /data > user1@ceph4:/data$ cd sd1 > user1@ceph4:/data/sd1$ ls > current d1 fsid lost+found store_version > > user1@ceph4:/data/sd1$ sudo rm -rf current d1 fsid store_version > user1@ceph4:/data/sd1$ ls > lost+found > > user1@ceph4:/data/sd1$ cd > user1@ceph4:~$ sudo mkcephfs -a -c ceph.conf -k ceph.keyring > > > ... > > === osd.0 === > 2012-08-28 12:29:38.299530 b6fd0000 -1 OSD::mkfs: FileStore::mkfs > failed with error -2 > 2012-08-28 12:29:38.299634 b6fd0000 -1 ** ERROR: error creating empty > object store in /data/sd1: (2) No such file or directory > failed: '/usr/local/sbin/mkcephfs -d /tmp/mkcephfs.syrvDQZU6f > --init-daemon osd.0' > > > user1@ceph4:~$ cd /data/sd1 > user1@ceph4:/data/sd1$ lsn > total 28K > drwxr-xr-x 3 root root 4.0K Aug 28 12:29 current > -rw-r--r-- 1 root root 4 Aug 28 12:29 store_version > -rw-r--r-- 1 root root 37 Aug 28 12:29 fsid > drwx------ 2 root root 16K Aug 28 10:40 lost+found > > > Note that mkcephfs was able to create current, store_version and fsid. > > > > > > On Tue, Aug 28, 2012 at 1:14 PM, Sage Weil <sage@xxxxxxxxxxx> wrote: > > On Tue, 28 Aug 2012, Tim Flavin wrote: > >> Hi: > >> > >> I am having a problem with mkcephfs. I built ceph from the 48.1 tarball. > >> > >> When I type: sudo mkcephfs -a -c ceph.conf -k ceph.keyring > >> > >> I get: > >> > >> (monmap tool related stuff is ok) > >> > >> > >> === osd.0 === > >> 2012-08-28 11:51:49.549651 b6f85000 -1 OSD::mkfs: FileStore::mkfs > >> failed with error -2 > >> 2012-08-28 11:51:49.549767 b6f85000 -1 ** ERROR: error creating empty > >> object store in /data/sd1: (2) No such file or directory > >> failed: '/usr/local/sbin/mkcephfs -d /tmp/mkcephfs.mKzTuonWuF > >> --init-daemon osd.0' > > > > That is not the most helpful error message, but: > > > >> > >> > >> user1@ceph4:~$ cat ceph.conf > >> [osd] > >> osd journal size = 1000 > >> filestore xattr use omap = true > >> > >> [mon.a] > >> host = ceph4 > >> mon addr = 64.20.246.210 > >> > >> [osd.0] > >> host = ceph4 > >> osd data = /data/sd1 > >> ; osd data = /dev/user1/data > >> ; osd journal = /dev/sdc1 > >> osd journal = /user1/log > >> > >> > >> user1@ceph4:~$ ls /data/sd1 > >> current d1 fsid lost+found store_version > > > > ...it looks like there is already data in that directory. Have you tried > > removing all of the files in /data/sd1 and retrying? > > > > sage > > > > > >> > >> /data/sd1 is an ext4 file system with -o noatime,user_xattr > >> > >> Any ideas? > >> > >> > >> Tim Flavin > >> -- > >> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > >> the body of a message to majordomo@xxxxxxxxxxxxxxx > >> More majordomo info at http://vger.kernel.org/majordomo-info.html > >> > >> > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html