radosgw multipart-uploaded downloads fail

[yehuda at inktank.com (Yehuda Sadeh)]

On Wed, Apr 2, 2014 at 2:08 AM, Benedikt Fraunhofer
<given.to.lists.ceph-users.ceph.com.toasta.001 at traced.net> wrote:
> Hi Yehuda,
>
> i tried your patch and it feels fine,
> except you might need some special handling for those already corrupt uploads,
> as trying to delete them gets radosgw in an endless loop and high cpu usage:

The problem was with the download, not with the upload. The objects
should be fine. Also, by the look at this log it seems that the
specific object is not a multipart one, but one that was uploaded
regularly. Can you run:

$ radosgw-admin object stat --bucket=<bucket> --object=<object>

Are you running the version off the master branch, or did you just
cherry-pick the patch? I can't seem to reproduce the problem.

Thanks,
Yehuda

>
> 2014-04-02 11:03:15.045627 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045628 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045629 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045631 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045632 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045634 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045634 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045636 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045637 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045639 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045639 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045641 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045642 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045644 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045644 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045646 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045647 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045649 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045649 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045651 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045652 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045654 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045654 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045656 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045657 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045659 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045660 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045661 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045662 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045664 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045665 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045667 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045667 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045669 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
> 2014-04-02 11:03:15.045670 7fbf157d2700  0
> RGWObjManifest::operator++(): result: ofs=33554432 stripe_ofs=33554432
> part_ofs=33554432 rule->part_size=0
> 2014-04-02 11:03:15.045672 7fbf157d2700 20
> RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1
>
>
> Thx
>
>  Benedikt