Ok, now it is clear to me. I disable filestore_xattr_use_omap for now, and i will try to move puppet class to xfs for a new cluster init :) Thanks On Tue, May 22, 2012 at 7:47 PM, Greg Farnum <greg@xxxxxxxxxxx> wrote: > On Tuesday, May 22, 2012 at 1:21 AM, Sławomir Skowron wrote: >> One more thing: >> >> === osd.0 === >> 2012-05-22 10:14:09.801059 7ffc4414a780 -1 filestore(/vol0/data/osd.0) >> leveldb db created >> 2012-05-22 10:14:09.804227 7ffc4414a780 -1 filestore(/vol0/data/osd.0) >> limited size xattrs -- enable filestore_xattr_use_omap >> 2012-05-22 10:14:09.804250 7ffc4414a780 -1 OSD::mkfs: couldn't mount >> FileStore: error -95 >> 2012-05-22 10:14:09.804364 7ffc4414a780 -1 ** ERROR: error creating >> empty object store in /vol0/data/osd.0: (95) Operation not supported >> failed: '/sbin/mkcephfs -d /tmp/mkcephfs.T8O2L4YPFH --init-daemon osd.0' > > That's because you're using something that only does small xattrs (ext4, probably?) and the system wants you to turn on "filestore_xattr_use_omap" in the config file (for OSDs). :) > I'm not sure why it's off by default -- Sam? > -Greg > >> >> /dev/sdb on /vol0/data/osd.0 type ext4 >> (rw,noexec,nodev,noatime,nodiratime,user_xattr,data=writeback,barrier=0) >> >> ls -la osd.0 >> total 524332 >> drwxr-xr-x 4 root root 4096 May 22 10:16 . >> drwxr-xr-x 29 root root 4096 May 22 10:15 .. >> drwxr-xr-x 3 root root 4096 May 22 10:16 current >> -rw-r--r-- 1 root root 37 May 22 10:16 fsid >> -rw-r--r-- 1 root root 536870912 May 22 10:16 journal >> drwx------ 2 root root 16384 May 22 10:15 lost+found >> -rw-r--r-- 1 root root 4 May 22 10:16 store_version >> -rwx------ 1 root root 0 May 22 10:16 xattr_test >> >> >> On Mon, May 21, 2012 at 11:25 PM, Sławomir Skowron <szibis@xxxxxxxxx (mailto:szibis@xxxxxxxxx)> wrote: >> > Great Thanks. >> > >> > On Mon, May 21, 2012 at 11:24 PM, Sage Weil <sage@xxxxxxxxxxx (mailto:sage@xxxxxxxxxxx)> wrote: >> > > On Mon, 21 May 2012, Stefan Priebe wrote: >> > > > Am 21.05.2012 22:58, schrieb Sawomir Skowron: >> > > > > Yes on root. 30 minutes ago on 0.46 same operation works. >> > > > >> > > > >> > > > ... >> > > > > Repo: >> > > > > >> > > > > deb http://ceph.com/debian/ precise main >> > > > >> > > > Same to me except i'm using debian squeeze. >> > > >> > > I just pushed a fix for this to the stable branch. Will build a v0.47.1 >> > > shortly. >> > > >> > > sage >> > >> > >> > >> > -- >> > ----- >> > Pozdrawiam >> > >> > Sławek "sZiBis" Skowron >> >> -- >> ----- >> Pozdrawiam >> >> Sławek Skowron > > -- ----- Pozdrawiam Sławek "sZiBis" Skowron -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html