I've found the cause of the problem - ceph was attempting to create the journal with direct io which zfs doesn't support. I worked round it by disabling journal dio in ceph.config [osd] journal dio = false Dunno if this is a good idea or not or whether there is a better way of doing it :_ On 26 November 2014 at 09:43, Craig Lewis <clewis@xxxxxxxxxxxxxxxxxx> wrote: > There was a good thread on the mailing list a little while ago. There were > several recommendations in that thread, maybe some of them will help. > > Found it: > https://www.mail-archive.com/ceph-users@xxxxxxxxxxxxxx/msg14154.html > > > On Tue, Nov 25, 2014 at 4:16 AM, Lindsay Mathieson > <lindsay.mathieson@xxxxxxxxx> wrote: >> >> Testing ceph on top of ZFS (zfsonlinux), kernel driver. >> >> >> >> - Have created ZFS mount: >> >> "/var/lib/ceph/osd/ceph-0" >> >> >> >> - followed the instructions at: >> >> http://ceph.com/docs/firefly/rados/operations/add-or-rm-osds/ >> >> >> >> failing on the step 4. Initialize the OSD data directory. >> >> >> >> >> >> ceph-osd -i 0 --mkfs --mkkey >> >> 2014-11-25 22:12:26.563666 7ff12b466780 -1 >> filestore(/var/lib/ceph/osd/ceph-0) mkjournal error creating journal on >> /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument >> >> 2014-11-25 22:12:26.563691 7ff12b466780 -1 OSD::mkfs: ObjectStore::mkfs >> failed with error -22 >> >> 2014-11-25 22:12:26.563765 7ff12b466780 -1 ** ERROR: error creating empty >> object store in /var/lib/ceph/osd/ceph-0: (22) Invalid argument >> >> >> >> >> >> Is this supported? >> >> >> >> thanks, >> >> >> >> -- >> >> Lindsay >> >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > -- Lindsay _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |