Re: rgw: Moving index objects to the right index_pool

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Wed, Feb 14, 2018 at 10:53 PM, Ingo Reimann <ireimann@xxxxxxxxx> wrote:
> Hi Yehuda,
>
> Thanks for you help.
>
> No, listing does not work, if I remove the old index objects.
>
> I guessed, I could use the resharding for my purpose. I just tried
> * copy the index object
> * rewrite bucket metadata
> * reshard
> => I get new index objects at the old place. Metadata gets turned back
> again.
>
> Maybe this is more complicated as expected?
>

You probably need this change for you to be able to modify the pool placement:

https://github.com/yehudasa/ceph/commit/0baebec32e388f4cb7bdf1fee9afe2144eeeb354

> Best regards,
>
> Ingo
>
>
> -----Ursprüngliche Nachricht-----
> Von: Yehuda Sadeh-Weinraub [mailto:yehuda@xxxxxxxxxx]
> Gesendet: Donnerstag, 15. Februar 2018 00:21
> An: Ingo Reimann
> Cc: ceph-users
> Betreff: Re:  rgw: Moving index objects to the right index_pool
>
> On Tue, Feb 13, 2018 at 11:27 PM, Ingo Reimann <ireimann@xxxxxxxxx> wrote:
>> Hi List,
>>
>> we want to brush up our cluster and correct things, that have been
>> changed over time. When we started with bobtail, we put all index
>> objects together with data into the pool rgw.buckets:
>>
>> root@cephadmin:~# radosgw-admin metadata get bucket:some-bucket {
>>     "key": "bucket:some-bucket",
>>     "ver": {
>>         "tag": "_zgv1FXm604BQtdiZnLkaiXN",
>>         "ver": 1
>>     },
>>     "mtime": "2016-01-08 04:53:38.000000Z",
>>     "data": {
>>         "bucket": {
>>             "name": "some-bucket",
>>             "pool": "rgw.buckets",
>>             "data_extra_pool": "",
>>             "index_pool": "rgw.buckets",
>>             "marker": "default.101387371.6",
>>             "bucket_id": "default.101387371.6",
>>             "tenant": ""
>>   [...]
>>
>> With Jewel, we introduced a default-placement and put the index of new
>> buckets into the pool rgw.buckets.index. Now, we`d like to correct the
>> old buckets and shift all the indices where they belong to.
>> I can
>> * copy the .dir.MARKER.SHARD# objects to the index pool
>> * modify the buckets metadata
>> But:
>> * when I try to modify the metadata of the bucket instance, the
>> index_pool does not get changed
>> * radosgw-admin bucket stats still shows the old index pool
>>
>> Did I miss something?
>
> You didn't miss much. There is a guard in the code that prevents you from
> modifying the placement pools. I have this commit that changes that (but
> that probably doesn't help you much):
>
> https://github.com/yehudasa/ceph/commit/0baebec32e388f4cb7bdf1fee9afe2144eeeb354
>
> The way to go forward for you I think would be by reshrding the buckets,
> which will put the bucket indexes in the correct place. Can you actually
> list the bucket indexes right now?
>
> Yehuda
>
>>
>> NB: Just now, I perform all the operations with a jewel 10.2.2 rgw.
>> Luminous is available but not active yet.
>>
>> Best regards,
>>
>> Ingo Reimann
>> Dunkel GmbH
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux