It will return that error if the osd directory is not empty at create time. Can you confirm that the osd directory is empty and try again? -Sam On Tue, Nov 27, 2012 at 9:07 AM, Rick Richardson <rick.richardson@xxxxxxxxx> wrote: > I have 4 ubuntu 12.04 with 3.6.7 kernel that I'm trying to configure. > Each will have 1 btrfs drive for an OSD, and 1 drive for its journal. > both drives on each host are formatted with mkfs.btrfs. > > I am using github/ceph master. I have osd.0-3 assigned to the 4 > hosts, then in [osd] I have > osd journal = /dev/sdc1 > > I'm hoping that it will universally apply to all 4 nodes. > > ------ > > root@blargle1:/etc/ceph# mount > ... > /dev/sdb1 on /var/lib/ceph/osd/ceph-0 type btrfs (rw) > > root@blargle1:/etc/ceph# sudo mkcephfs -a -c /etc/ceph/ceph.conf -k ceph.keyring > temp dir is /tmp/mkcephfs.54pDJ56uZN > preparing monmap in /tmp/mkcephfs.54pDJ56uZN/monmap > /usr/local/bin/monmaptool --create --clobber --add a 172.17.9.234:6789 > --add b 172.17.9.235:6789 --add c 172.17.9.236:6789 --add d > 172.17.9.237:6789 --print /tmp/mkcephfs.54pDJ56uZN/monmap > /usr/local/bin/monmaptool: monmap file /tmp/mkcephfs.54pDJ56uZN/monmap > /usr/local/bin/monmaptool: generated fsid 8681d07b-d8f1-4f2a-8008-cd72997eb912 > epoch 0 > fsid 8681d07b-d8f1-4f2a-8008-cd72997eb912 > last_changed 2012-11-27 11:47:27.852699 > created 2012-11-27 11:47:27.852699 > 0: 172.17.9.234:6789/0 mon.a > 1: 172.17.9.235:6789/0 mon.b > 2: 172.17.9.236:6789/0 mon.c > 3: 172.17.9.237:6789/0 mon.d > /usr/local/bin/monmaptool: writing epoch 0 to > /tmp/mkcephfs.54pDJ56uZN/monmap (4 monitors) > === osd.0 === > SG_IO: bad/missing sense data, sb[]: 70 00 05 00 00 00 00 0a 00 00 00 > 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > SG_IO: bad/missing sense data, sb[]: 70 00 05 00 00 00 00 0a 00 00 00 > 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > SG_IO: bad/missing sense data, sb[]: 70 00 05 00 00 00 00 0a 00 00 00 > 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > 2012-11-27 11:47:30.461827 7faac2144780 -1 provided osd id 0 != superblock's -1 > 2012-11-27 11:47:30.463239 7faac2144780 -1 ** ERROR: error creating > empty object store in /var/lib/ceph/osd/ceph-0: (22) Invalid argument > failed: '/usr/local/sbin/mkcephfs -d /tmp/mkcephfs.54pDJ56uZN > --init-daemon osd.0' > > ---- > > Thoughts? > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html