Thanks Craig, I had a good read of it - from what I read, the std ceph packages should work with zfs, just not make use of its extra features (writeparallel support), whose performance was not all that good anyway. I did note the "set xattr to sa" comment which gave me a different error:) ceph-osd -i 0 --mkfs --mkkey 2014-11-26 10:51:33.559288 7fd10544c780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2014-11-26 10:51:33.559355 7fd10544c780 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected c064615f-d692-4eb0-9211-a26dcb186478, invalid (someone else's?) journal 2014-11-26 10:51:33.559405 7fd10544c780 -1 filestore(/var/lib/ceph/osd/ceph-0) mkjournal error creating journal on /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument 2014-11-26 10:51:33.559430 7fd10544c780 -1 OSD::mkfs: ObjectStore::mkfs failed with error -22 2014-11-26 10:51:33.559505 7fd10544c780 -1 ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-0: (22) Invalid argument nb. The command actually succeeds if I unmount zfs and use the underlying ext4 system. This is on a proxmox (debian wheezy) box: ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a3) zfs: 0.6.3-1~wheezy kernel: 3.10 thanks, On 26 November 2014 at 09:43, Craig Lewis <clewis@xxxxxxxxxxxxxxxxxx> wrote: > There was a good thread on the mailing list a little while ago. There were > several recommendations in that thread, maybe some of them will help. > > Found it: > https://www.mail-archive.com/ceph-users@xxxxxxxxxxxxxx/msg14154.html > > > On Tue, Nov 25, 2014 at 4:16 AM, Lindsay Mathieson > <lindsay.mathieson@xxxxxxxxx> wrote: >> >> Testing ceph on top of ZFS (zfsonlinux), kernel driver. >> >> >> >> - Have created ZFS mount: >> >> "/var/lib/ceph/osd/ceph-0" >> >> >> >> - followed the instructions at: >> >> http://ceph.com/docs/firefly/rados/operations/add-or-rm-osds/ >> >> >> >> failing on the step 4. Initialize the OSD data directory. >> >> >> >> >> >> ceph-osd -i 0 --mkfs --mkkey >> >> 2014-11-25 22:12:26.563666 7ff12b466780 -1 >> filestore(/var/lib/ceph/osd/ceph-0) mkjournal error creating journal on >> /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument >> >> 2014-11-25 22:12:26.563691 7ff12b466780 -1 OSD::mkfs: ObjectStore::mkfs >> failed with error -22 >> >> 2014-11-25 22:12:26.563765 7ff12b466780 -1 ** ERROR: error creating empty >> object store in /var/lib/ceph/osd/ceph-0: (22) Invalid argument >> >> >> >> >> >> Is this supported? >> >> >> >> thanks, >> >> >> >> -- >> >> Lindsay >> >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > -- Lindsay _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |