Hi, due to performance issues I try to move the osd-nodes from debian to ubuntu. Two nodes works without trouble but on the next node the OSDs don't start with following error message: more ceph-mon.a.log 2014-02-13 19:19:25.436277 7f08c9bfd780 0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process ceph-mon, pid 2116 2014-02-13 19:19:25.617382 7f08c9bfd780 -1 failed to create new leveldb store more ceph-osd.0.log 2014-02-13 19:19:28.422693 7f8994c2e780 0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process ceph-osd, pid 4431 2014-02-13 19:19:28.424402 7f8994c2e780 1 filestore(/var/lib/ceph/osd/ceph-0) mount detected xfs 2014-02-13 19:19:28.424408 7f8994c2e780 1 filestore(/var/lib/ceph/osd/ceph-0) disabling 'filestore replica fadvise' due to known issues with fadvise(DONTNEED) on xfs 2014-02-13 19:19:28.448225 7f8994c2e780 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work 2014-02-13 19:19:28.448236 7f8994c2e780 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option 2014-02-13 19:19:28.448570 7f8994c2e780 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) 2014-02-13 19:19:28.495633 7f8994c2e780 -1 filestore(/var/lib/ceph/osd/ceph-0) Error initializing leveldb: Corruption: 30 missing files; e.g.: /var/lib/ceph/osd/ceph-0/current/omap/001678.sst 2014-02-13 19:19:28.495723 7f8994c2e780 -1 ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (1) Operation not permitted In the directory are .ldb-files: ls -lsa /var/lib/ceph/osd/ceph-1/current/omap/ insgesamt 62952 8 drwxr-xr-x 2 root root 4096 Feb 14 10:22 . 28 drwxr-xr-x 354 root root 28672 Feb 13 20:02 .. 2088 -rw-r--r-- 1 root root 2135421 Feb 5 22:26 001834.ldb 2088 -rw-r--r-- 1 root root 2136838 Feb 5 22:26 001835.ldb 2088 -rw-r--r-- 1 root root 2136483 Feb 5 22:26 001836.ldb 2088 -rw-r--r-- 1 root root 2136909 Feb 5 22:26 001837.ldb 2088 -rw-r--r-- 1 root root 2137557 Feb 6 04:31 002008.ldb 2092 -rw-r--r-- 1 root root 2138466 Feb 6 04:31 002009.ldb ... but all other nodes have sst-files: ls -l /var/lib/ceph/osd/ceph-11/current/omap/ insgesamt 395300 -rw-r--r-- 1 root root 2137811 Mai 31 2013 001707.sst -rw-r--r-- 1 root root 2126471 Jun 5 2013 002001.sst -rw-r--r-- 1 root root 2137469 Jun 5 2013 002002.sst -rw-r--r-- 1 root root 2136640 Jun 5 2013 002003.sst -rw-r--r-- 1 root root 2136908 Jun 5 2013 002004.sst ... The ceph-version is on all os-nodes equal: ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60) How to convert the .ldb-files to .sst?? Any hints? Best regards Udo Lembke _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com