Sorry for the early send, my keyboard is a bit of a whack right now. I just pushed a fix to wip-6161, can you verify that it fixes the issue for you? Thanks, Yehuda On Thu, Aug 29, 2013 at 1:06 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote: > Just pushed a f > > On Thu, Aug 29, 2013 at 7:24 AM, Sylvain Munaut > <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >> It's a local commit. We have a few patches that implement features we >> need but that weren't accepted upstream. (and yes, I checked they had >> no influence on the issue at hand). >> >> The latest commit from the ceph repo is 39adc0195e6016ce36828885515be1bffbc10ae1 >> >> Cheers, >> >> Sylvain >> >> >> On Thu, Aug 29, 2013 at 4:15 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote: >>> What's commit c81bc5b59dda37f54c02039ca3d5aada64076624? I don't see it >>> on the ceph github repository. >>> >>> >>> >>> On Thu, Aug 29, 2013 at 5:59 AM, Sylvain Munaut >>> <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >>>> I tried going back to a src/rgw/ directory as it is in the 0.67.2 >>>> release, but didn't start either. >>>> >>>> (failed to init storage). >>>> >>>> Finally I disabled the cache for now and it seem to have started properly. >>>> >>>> On Thu, Aug 29, 2013 at 1:50 PM, Sylvain Munaut >>>> <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >>>>> I reverted commit a4cca31c82bf0e84272e01eb1b3188dfdb5b5615 and then I got : >>>>> >>>>> 2013-08-29 13:32:44.430574 7f55402a7780 0 ceph version >>>>> 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624), process >>>>> lt-radosgw, pid 30786 >>>>> 2013-08-29 13:32:44.430608 7f55402a7780 -1 WARNING: libcurl doesn't >>>>> support curl_multi_wait() >>>>> 2013-08-29 13:32:44.430619 7f55402a7780 -1 WARNING: cross zone / >>>>> region transfer performance may be affected >>>>> 2013-08-29 13:32:44.451041 7f552f6fd700 2 >>>>> RGWDataChangesLog::ChangesRenewThread: start >>>>> 2013-08-29 13:32:44.453327 7f55402a7780 10 cache get: >>>>> name=.rgw+.pools.avail : miss >>>>> 2013-08-29 13:32:44.457216 7f55402a7780 10 cache put: name=.rgw+.pools.avail >>>>> 2013-08-29 13:32:44.457256 7f55402a7780 10 adding .rgw+.pools.avail to >>>>> cache LRU end >>>>> 2013-08-29 13:32:44.458385 7f55402a7780 -1 error storing zone params: >>>>> (1) Operation not permitted >>>>> 2013-08-29 13:32:44.460492 7f55402a7780 -1 Couldn't init storage >>>>> provider (RADOS) >>>>> >>>>> >>>>> So I tried creating .rgw.root pool manually (even though the docs in >>>>> http://ceph.com/docs/next/radosgw/config/ don't list it) and that went >>>>> to : >>>>> >>>>> >>>>> 2013-08-29 13:45:37.454387 7f46da40b780 0 ceph version >>>>> 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624), process >>>>> lt-radosgw, pid 31234 >>>>> 2013-08-29 13:45:37.454433 7f46da40b780 -1 WARNING: libcurl doesn't >>>>> support curl_multi_wait() >>>>> 2013-08-29 13:45:37.454446 7f46da40b780 -1 WARNING: cross zone / >>>>> region transfer performance may be affected >>>>> 2013-08-29 13:45:37.473025 7f46c97fa700 2 >>>>> RGWDataChangesLog::ChangesRenewThread: start >>>>> 2013-08-29 13:45:37.473499 7f46da40b780 20 get_obj_state: >>>>> rctx=0xdb2cd0 obj=.rgw.root:default.region state=0xdaffc8 >>>>> s->prefetch_data=0 >>>>> 2013-08-29 13:45:37.473531 7f46da40b780 10 cache get: >>>>> name=.rgw.root+default.region : miss >>>>> 2013-08-29 13:45:37.487496 7f46da40b780 10 cache put: >>>>> name=.rgw.root+default.region >>>>> 2013-08-29 13:45:37.487548 7f46da40b780 10 adding >>>>> .rgw.root+default.region to cache LRU end >>>>> 2013-08-29 13:45:37.487626 7f46da40b780 10 cache get: >>>>> name=.rgw+.pools.avail : miss >>>>> 2013-08-29 13:45:37.491370 7f46da40b780 10 cache put: name=.rgw+.pools.avail >>>>> 2013-08-29 13:45:37.491393 7f46da40b780 10 adding .rgw+.pools.avail to >>>>> cache LRU end >>>>> 2013-08-29 13:45:37.491448 7f46da40b780 0 PN: .rgw.root OID: zone_info.default >>>>> 2013-08-29 13:45:37.531675 7f46da40b780 10 cache put: >>>>> name=.rgw.root+zone_info.default >>>>> 2013-08-29 13:45:37.531697 7f46da40b780 10 adding >>>>> .rgw.root+zone_info.default to cache LRU end >>>>> *** Caught signal (Floating point exception) ** >>>>> in thread 7f46da40b780 >>>>> ceph version 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624) >>>>> 1: /home/whatever/ceph/src/.libs/lt-radosgw() [0x573bfa] >>>>> 2: (()+0xfcb0) [0x7f46d8d3acb0] >>>>> 3: (RGWRados::pick_control_oid(std::string const&, >>>>> std::string&)+0x35) [0x4dd855] >>>>> 4: (RGWRados::distribute(std::string const&, >>>>> ceph::buffer::list&)+0x3f) [0x4dd91f] >>>>> 5: (RGWCache<RGWRados>::distribute_cache(std::string const&, >>>>> rgw_obj&, ObjectCacheInfo&, int)+0x3d7) [0x510b37] >>>>> 6: (RGWCache<RGWRados>::put_obj_meta_impl(void*, rgw_obj&, unsigned >>>>> long, long*, std::map<std::string, ceph::buffer::list, >>>>> std::less<std::string>, std::allocator<std::pair<std::string const, >>>>> ceph::buffer::list> > >&, RGWObjCategory, int, std::map<std::string, >>>>> ceph::buffer::list, std::less<std::string>, >>>>> std::allocator<std::pair<std::string const, ceph::buffer::list> > >*, >>>>> ceph::buffer::list const*, RGWObjManifest*, std::string const*, >>>>> std::list<std::string, std::allocator<std::string> >*, bool, >>>>> RGWObjVersionTracker*, long)+0x2ab) [0x511dab] >>>>> 7: (RGWRados::put_obj_meta(void*, rgw_obj&, unsigned long, >>>>> std::map<std::string, ceph::buffer::list, std::less<std::string>, >>>>> std::allocator<std::pair<std::string const, ceph::buffer::list> > >&, >>>>> RGWObjCategory, int, RGWRados::PutObjMetaExtraParams&)+0x6f) >>>>> [0x500e0f] >>>>> 8: (rgw_put_system_obj(RGWRados*, rgw_bucket&, std::string&, char >>>>> const*, unsigned long, bool, RGWObjVersionTracker*, long, >>>>> std::map<std::string, ceph::buffer::list, std::less<std::string>, >>>>> std::allocator<std::pair<std::string const, ceph::buffer::list> > >>>>>>*)+0x2c4) [0x4daba4] >>>>> 9: (RGWZoneParams::store_info(CephContext*, RGWRados*, >>>>> RGWRegion&)+0x17c) [0x4e40dc] >>>>> 10: (RGWRegion::create_default()+0x487) [0x4ed5f7] >>>>> 11: (RGWRegion::init(CephContext*, RGWRados*, bool)+0x108) [0x4edb38] >>>>> 12: (RGWRados::init_complete()+0x32) [0x4efd82] >>>>> 13: (RGWStoreManager::init_storage_provider(CephContext*, >>>>> bool)+0x621) [0x4e98c1] >>>>> 14: (main()+0x441) [0x4579c1] >>>>> 15: (__libc_start_main()+0xed) [0x7f46d7a4d76d] >>>>> 16: /home/whatever/ceph/src/.libs/lt-radosgw() [0x459789] >>>>> 2013-08-29 13:45:37.555982 7f46da40b780 -1 *** Caught signal (Floating >>>>> point exception) ** >>>>> in thread 7f46da40b780 >>>>> >>>>> >>>>> Cheers, >>>>> >>>>> Sylvain >>>>> >>>>> >>>>> On Thu, Aug 29, 2013 at 11:53 AM, Sylvain Munaut >>>>> <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >>>>>> Hi, >>>>>> >>>>>> I just updated our test cluster to 0.67.2+ (latest dumpling branch) ( >>>>>> from 0.61.x ) and radosgw refuses to start. >>>>>> >>>>>> >>>>>> 2013-08-29 11:46:34.915552 7ffccbc3d780 0 ceph version >>>>>> 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624), process >>>>>> lt-radosgw, pid 30404 >>>>>> 2013-08-29 11:46:34.915598 7ffccbc3d780 -1 WARNING: libcurl doesn't >>>>>> support curl_multi_wait() >>>>>> 2013-08-29 11:46:34.915612 7ffccbc3d780 -1 WARNING: cross zone / >>>>>> region transfer performance may be affected >>>>>> 2013-08-29 11:46:34.935674 7ffcb2ffd700 2 >>>>>> RGWDataChangesLog::ChangesRenewThread: start >>>>>> 2013-08-29 11:46:34.937337 7ffccbc3d780 -1 ERROR: failed to initialize watch >>>>>> 2013-08-29 11:46:34.939135 7ffccbc3d780 -1 Couldn't init storage >>>>>> provider (RADOS) >>>>>> >>>>>> in RGWRados::init_watch(), it seems that : >>>>>> >>>>>> const char *control_pool = zone.control_pool.name.c_str() >>>>>> >>>>>> returns an empty string which is really suspect ... >>>>>> >>>>>> >>>>>> Cheers, >>>>>> >>>>>> Sylvain >>>>> >>>>> >>>>> >>>>> -- >>>>> Sylvain Munaut >>>>> Whatever s.a. >>>>> Rue Fond Cattelain 5 >>>>> 1435 Mont-Saint-Guibert >>>>> Fixed line: +32 10 23.59.30 >>>> >>>> >>>> >>>> -- >>>> Sylvain Munaut >>>> Whatever s.a. >>>> Rue Fond Cattelain 5 >>>> 1435 Mont-Saint-Guibert >>>> Fixed line: +32 10 23.59.30 >>>> -- >>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >>>> the body of a message to majordomo@xxxxxxxxxxxxxxx >>>> More majordomo info at http://vger.kernel.org/majordomo-info.html >> >> >> >> -- >> Sylvain Munaut >> Whatever s.a. >> Rue Fond Cattelain 5 >> 1435 Mont-Saint-Guibert >> Fixed line: +32 10 23.59.30 > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
