On Sun, 17 Jun 2012, Sage Weil wrote: > Hi Simon, > > We've opened http://tracker.newdream.net/issues/2598 to track this. Actually, having looked at the code, I'm pretty sure I see the problem. I pushed a fix to the 'next' branch. Can you try the latest and see if it resolves the problem? (Also, out of curiosity, what file system are you running underneath the ceph-osd?) Thanks! sage > > Thanks! > sage > > On Sat, 16 Jun 2012, Simon Frerichs | Fremaks GmbH wrote: > > > Hi, > > > > i tried updating one of our osds from stable 0.47-2 to latest next branch and > > it started updating the filestore and failed. > > After that neither next branch osd nor stable osd would start with this > > filestore anymore. > > Is their something wrong with the filestore update? > > > > Jun 16 14:10:03 fcstore01 ceph-osd: 2012-06-16 14:10:03.134135 7ffed3e35780 0 > > filestore(/data/osd11) mount FIEMAP ioctl is supported and appears to work Jun > > 16 14:10:03 fcstore01 ceph-osd: 2012-06-16 14:10:03.134163 7ffed3e35780 0 > > filestore(/data/osd11) mount FIEMAP ioctl is disabled via 'filestore fiemap' > > config option Jun 16 14:10:03 fcstore01 ceph-osd: 2012-06-16 14:10:03.134476 > > 7ffed3e35780 0 filestore(/data/osd11) mount did NOT detect btrfs Jun 16 > > 14:10:03 fcstore01 ceph-osd: 2012-06-16 14:10:03.134485 7ffed3e35780 0 > > filestore(/data/osd11) mount syncfs(2) syscall not support by glibc Jun 16 > > 14:10:03 fcstore01 ceph-osd: 2012-06-16 14:10:03.134513 7ffed3e35780 0 > > filestore(/data/osd11) mount no syncfs(2), must use sync(2). Jun 16 14:10:03 > > fcstore01 ceph-osd: 2012-06-16 14:10:03.134514 7ffed3e35780 0 > > filestore(/data/osd11) mount WARNING: multiple ceph-osd daemons on the same > > host will be slow Jun 16 14:10:03 fcstore01 ceph-osd: 2012-06-16 > > 14:10:03.134551 7ffed3e35780 -1 filestore(/data/osd11) FileStore::mount : > > stale version stamp detected: 2. Proceeding, do_update is set, DO NOT USE THIS > > OPTION IF YOU DO NOT KNOW WHAT IT DOES. More details can be found on the wiki. > > Jun 16 14:10:03 fcstore01 ceph-osd: 2012-06-16 14:10:03.134585 7ffed3e35780 0 > > filestore(/data/osd11) mount found snaps <> Jun 16 14:10:12 fcstore01 > > ceph-osd: 2012-06-16 14:10:12.531974 7ffed3e35780 0 filestore(/data/osd11) > > mount: enabling WRITEAHEAD journal mode: btrfs not detected Jun 16 14:10:12 > > fcstore01 ceph-osd: 2012-06-16 14:10:12.543721 7ffed3e35780 1 journal _open > > /dev/sdb1 fd 18: 53687091200 bytes, block size 4096 bytes, directio = 1, aio = > > 0 Jun 16 14:10:12 fcstore01 ceph-osd: 2012-06-16 14:10:12.588059 7ffed3e35780 > > 1 journal _open /dev/sdb1 fd 18: 53687091200 bytes, block size 4096 bytes, > > directio = 1, aio = 0 Jun 16 14:10:12 fcstore01 ceph-osd: 2012-06-16 > > 14:10:12.588905 7ffed3e35780 -1 FileStore is old at version 2. Updating... Jun > > 16 14:10:12 fcstore01 ceph-osd: 2012-06-16 14:10:12.588914 7ffed3e35780 -1 > > Removing tmp pgs Jun 16 14:10:12 fcstore01 ceph-osd: 2012-06-16 > > 14:10:12.594362 7ffed3e35780 -1 Getting collections Jun 16 14:10:12 fcstore01 > > ceph-osd: 2012-06-16 14:10:12.594369 7ffed3e35780 -1 597 to process. Jun 16 > > 14:10:12 fcstore01 ceph-osd: 2012-06-16 14:10:12.595195 7ffed3e35780 -1 0/597 > > processed Jun 16 14:10:12 fcstore01 ceph-osd: 2012-06-16 14:10:12.595213 > > 7ffed3e35780 -1 Updating collection omap current version is 0 Jun 16 14:10:12 > > fcstore01 ceph-osd: 2012-06-16 14:10:12.662274 7ffed3e35780 -1 > > os/FlatIndex.cc: In function 'virtual int > > FlatIndex::collection_list_partial(const hobject_t&, int, int, snapid_t, > > std::vector<hobject_t>*, hobject_t*)' thread 7ffed3e35780 time 2012-06-16 > > 14:10:12.637479#012os/FlatIndex.cc: 386: FAILED assert(0)#012#012 ceph version > > 0.47.2-500-g1e899d0 (commit:1e899d08e61bbba0af6f3600b6bc9a5fc9e5c2e9)#012 1: > > /usr/local/bin/ceph-osd() [0x6b337d]#012 2: > > (FileStore::collection_list_partial(coll_t, hobject_t, int, int, snapid_t, > > std::vector<hobject_t, std::allocator<hobject_t> >*, hobject_t*)+0x9c) > > [0x67b24c]#012 3: (OSD::convert_collection(ObjectStore*, coll_t)+0x529) > > [0x5b90e9]#012 4: (OSD::do_convertfs(ObjectStore*)+0x46f) [0x5b9b9f]#012 5: > > (OSD::convertfs(std::string const&, std::string const&)+0x47) [0x5ba127]#012 > > 6: (main()+0x967) [0x531d07]#012 7: (__libc_start_main()+0xfd) > > [0x7ffed1d8aead]#012 8: /usr/local/bin/ceph-osd() [0x5357b9]#012 NOTE: a copy > > of the executable, or `objdump -rdS <executable>` is needed to interpret this. > > > > Simon > > > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > > > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
