Just pushed a f On Thu, Aug 29, 2013 at 7:24 AM, Sylvain Munaut <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: > It's a local commit. We have a few patches that implement features we > need but that weren't accepted upstream. (and yes, I checked they had > no influence on the issue at hand). > > The latest commit from the ceph repo is 39adc0195e6016ce36828885515be1bffbc10ae1 > > Cheers, > > Sylvain > > > On Thu, Aug 29, 2013 at 4:15 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote: >> What's commit c81bc5b59dda37f54c02039ca3d5aada64076624? I don't see it >> on the ceph github repository. >> >> >> >> On Thu, Aug 29, 2013 at 5:59 AM, Sylvain Munaut >> <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >>> I tried going back to a src/rgw/ directory as it is in the 0.67.2 >>> release, but didn't start either. >>> >>> (failed to init storage). >>> >>> Finally I disabled the cache for now and it seem to have started properly. >>> >>> On Thu, Aug 29, 2013 at 1:50 PM, Sylvain Munaut >>> <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >>>> I reverted commit a4cca31c82bf0e84272e01eb1b3188dfdb5b5615 and then I got : >>>> >>>> 2013-08-29 13:32:44.430574 7f55402a7780 0 ceph version >>>> 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624), process >>>> lt-radosgw, pid 30786 >>>> 2013-08-29 13:32:44.430608 7f55402a7780 -1 WARNING: libcurl doesn't >>>> support curl_multi_wait() >>>> 2013-08-29 13:32:44.430619 7f55402a7780 -1 WARNING: cross zone / >>>> region transfer performance may be affected >>>> 2013-08-29 13:32:44.451041 7f552f6fd700 2 >>>> RGWDataChangesLog::ChangesRenewThread: start >>>> 2013-08-29 13:32:44.453327 7f55402a7780 10 cache get: >>>> name=.rgw+.pools.avail : miss >>>> 2013-08-29 13:32:44.457216 7f55402a7780 10 cache put: name=.rgw+.pools.avail >>>> 2013-08-29 13:32:44.457256 7f55402a7780 10 adding .rgw+.pools.avail to >>>> cache LRU end >>>> 2013-08-29 13:32:44.458385 7f55402a7780 -1 error storing zone params: >>>> (1) Operation not permitted >>>> 2013-08-29 13:32:44.460492 7f55402a7780 -1 Couldn't init storage >>>> provider (RADOS) >>>> >>>> >>>> So I tried creating .rgw.root pool manually (even though the docs in >>>> http://ceph.com/docs/next/radosgw/config/ don't list it) and that went >>>> to : >>>> >>>> >>>> 2013-08-29 13:45:37.454387 7f46da40b780 0 ceph version >>>> 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624), process >>>> lt-radosgw, pid 31234 >>>> 2013-08-29 13:45:37.454433 7f46da40b780 -1 WARNING: libcurl doesn't >>>> support curl_multi_wait() >>>> 2013-08-29 13:45:37.454446 7f46da40b780 -1 WARNING: cross zone / >>>> region transfer performance may be affected >>>> 2013-08-29 13:45:37.473025 7f46c97fa700 2 >>>> RGWDataChangesLog::ChangesRenewThread: start >>>> 2013-08-29 13:45:37.473499 7f46da40b780 20 get_obj_state: >>>> rctx=0xdb2cd0 obj=.rgw.root:default.region state=0xdaffc8 >>>> s->prefetch_data=0 >>>> 2013-08-29 13:45:37.473531 7f46da40b780 10 cache get: >>>> name=.rgw.root+default.region : miss >>>> 2013-08-29 13:45:37.487496 7f46da40b780 10 cache put: >>>> name=.rgw.root+default.region >>>> 2013-08-29 13:45:37.487548 7f46da40b780 10 adding >>>> .rgw.root+default.region to cache LRU end >>>> 2013-08-29 13:45:37.487626 7f46da40b780 10 cache get: >>>> name=.rgw+.pools.avail : miss >>>> 2013-08-29 13:45:37.491370 7f46da40b780 10 cache put: name=.rgw+.pools.avail >>>> 2013-08-29 13:45:37.491393 7f46da40b780 10 adding .rgw+.pools.avail to >>>> cache LRU end >>>> 2013-08-29 13:45:37.491448 7f46da40b780 0 PN: .rgw.root OID: zone_info.default >>>> 2013-08-29 13:45:37.531675 7f46da40b780 10 cache put: >>>> name=.rgw.root+zone_info.default >>>> 2013-08-29 13:45:37.531697 7f46da40b780 10 adding >>>> .rgw.root+zone_info.default to cache LRU end >>>> *** Caught signal (Floating point exception) ** >>>> in thread 7f46da40b780 >>>> ceph version 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624) >>>> 1: /home/whatever/ceph/src/.libs/lt-radosgw() [0x573bfa] >>>> 2: (()+0xfcb0) [0x7f46d8d3acb0] >>>> 3: (RGWRados::pick_control_oid(std::string const&, >>>> std::string&)+0x35) [0x4dd855] >>>> 4: (RGWRados::distribute(std::string const&, >>>> ceph::buffer::list&)+0x3f) [0x4dd91f] >>>> 5: (RGWCache<RGWRados>::distribute_cache(std::string const&, >>>> rgw_obj&, ObjectCacheInfo&, int)+0x3d7) [0x510b37] >>>> 6: (RGWCache<RGWRados>::put_obj_meta_impl(void*, rgw_obj&, unsigned >>>> long, long*, std::map<std::string, ceph::buffer::list, >>>> std::less<std::string>, std::allocator<std::pair<std::string const, >>>> ceph::buffer::list> > >&, RGWObjCategory, int, std::map<std::string, >>>> ceph::buffer::list, std::less<std::string>, >>>> std::allocator<std::pair<std::string const, ceph::buffer::list> > >*, >>>> ceph::buffer::list const*, RGWObjManifest*, std::string const*, >>>> std::list<std::string, std::allocator<std::string> >*, bool, >>>> RGWObjVersionTracker*, long)+0x2ab) [0x511dab] >>>> 7: (RGWRados::put_obj_meta(void*, rgw_obj&, unsigned long, >>>> std::map<std::string, ceph::buffer::list, std::less<std::string>, >>>> std::allocator<std::pair<std::string const, ceph::buffer::list> > >&, >>>> RGWObjCategory, int, RGWRados::PutObjMetaExtraParams&)+0x6f) >>>> [0x500e0f] >>>> 8: (rgw_put_system_obj(RGWRados*, rgw_bucket&, std::string&, char >>>> const*, unsigned long, bool, RGWObjVersionTracker*, long, >>>> std::map<std::string, ceph::buffer::list, std::less<std::string>, >>>> std::allocator<std::pair<std::string const, ceph::buffer::list> > >>>>>*)+0x2c4) [0x4daba4] >>>> 9: (RGWZoneParams::store_info(CephContext*, RGWRados*, >>>> RGWRegion&)+0x17c) [0x4e40dc] >>>> 10: (RGWRegion::create_default()+0x487) [0x4ed5f7] >>>> 11: (RGWRegion::init(CephContext*, RGWRados*, bool)+0x108) [0x4edb38] >>>> 12: (RGWRados::init_complete()+0x32) [0x4efd82] >>>> 13: (RGWStoreManager::init_storage_provider(CephContext*, >>>> bool)+0x621) [0x4e98c1] >>>> 14: (main()+0x441) [0x4579c1] >>>> 15: (__libc_start_main()+0xed) [0x7f46d7a4d76d] >>>> 16: /home/whatever/ceph/src/.libs/lt-radosgw() [0x459789] >>>> 2013-08-29 13:45:37.555982 7f46da40b780 -1 *** Caught signal (Floating >>>> point exception) ** >>>> in thread 7f46da40b780 >>>> >>>> >>>> Cheers, >>>> >>>> Sylvain >>>> >>>> >>>> On Thu, Aug 29, 2013 at 11:53 AM, Sylvain Munaut >>>> <s.munaut@xxxxxxxxxxxxxxxxxxxx> wrote: >>>>> Hi, >>>>> >>>>> I just updated our test cluster to 0.67.2+ (latest dumpling branch) ( >>>>> from 0.61.x ) and radosgw refuses to start. >>>>> >>>>> >>>>> 2013-08-29 11:46:34.915552 7ffccbc3d780 0 ceph version >>>>> 0.67.2-19-gc81bc5b (c81bc5b59dda37f54c02039ca3d5aada64076624), process >>>>> lt-radosgw, pid 30404 >>>>> 2013-08-29 11:46:34.915598 7ffccbc3d780 -1 WARNING: libcurl doesn't >>>>> support curl_multi_wait() >>>>> 2013-08-29 11:46:34.915612 7ffccbc3d780 -1 WARNING: cross zone / >>>>> region transfer performance may be affected >>>>> 2013-08-29 11:46:34.935674 7ffcb2ffd700 2 >>>>> RGWDataChangesLog::ChangesRenewThread: start >>>>> 2013-08-29 11:46:34.937337 7ffccbc3d780 -1 ERROR: failed to initialize watch >>>>> 2013-08-29 11:46:34.939135 7ffccbc3d780 -1 Couldn't init storage >>>>> provider (RADOS) >>>>> >>>>> in RGWRados::init_watch(), it seems that : >>>>> >>>>> const char *control_pool = zone.control_pool.name.c_str() >>>>> >>>>> returns an empty string which is really suspect ... >>>>> >>>>> >>>>> Cheers, >>>>> >>>>> Sylvain >>>> >>>> >>>> >>>> -- >>>> Sylvain Munaut >>>> Whatever s.a. >>>> Rue Fond Cattelain 5 >>>> 1435 Mont-Saint-Guibert >>>> Fixed line: +32 10 23.59.30 >>> >>> >>> >>> -- >>> Sylvain Munaut >>> Whatever s.a. >>> Rue Fond Cattelain 5 >>> 1435 Mont-Saint-Guibert >>> Fixed line: +32 10 23.59.30 >>> -- >>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >>> the body of a message to majordomo@xxxxxxxxxxxxxxx >>> More majordomo info at http://vger.kernel.org/majordomo-info.html > > > > -- > Sylvain Munaut > Whatever s.a. > Rue Fond Cattelain 5 > 1435 Mont-Saint-Guibert > Fixed line: +32 10 23.59.30 -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html