Re: how to use cache tiering with proxy in ceph-10.2.2

[<m13913886148@xxxxxxxxx>]

I have configured ceph.conf with "osd_tier_promote_max_bytes_sec" in [osd] Attributes. But it still invalid.

I do command --show-config discovery that it has not been modified.

[root@node01 ~]# cat /etc/ceph/ceph.conf | grep tier
osd_tier_promote_max_objects_sec=200000
osd_tier_promote_max_bytes_sec=16106127360

 [root@node01 ~]# ceph --show-config | grep tier
mon_debug_unsafe_allow_tier_with_nonempty_snaps = false
osd_tier_promote_max_objects_sec = 5242880
osd_tier_promote_max_bytes_sec = 25
osd_tier_default_cache_mode = writeback
osd_tier_default_cache_hit_set_count = 4
osd_tier_default_cache_hit_set_period = 1200
osd_tier_default_cache_hit_set_type = bloom
osd_tier_default_cache_min_read_recency_for_promote = 1
osd_tier_default_cache_min_write_recency_for_promote = 1
osd_tier_default_cache_hit_set_grade_decay_rate = 20
osd_tier_default_cache_hit_set_search_last_n = 1

and cache tiering does not work , low iops.

On Monday, July 18, 2016 5:33 PM, "m13913886148@xxxxxxxxx" <m13913886148@xxxxxxxxx> wrote:

thank you very much! 

On Monday, July 18, 2016 5:31 PM, Oliver Dzombic <info@xxxxxxxxxxxxxxxxx> wrote:

Hi,

everything is here:

http://docs.ceph.com/docs/jewel/

except

osd_tier_promote_max_bytes_sec

and other stuff, but its enough there that you can make it work.

--
Mit freundlichen Gruessen / Best regards

Oliver Dzombic
IP-Interactive

mailto:info@xxxxxxxxxxxxxxxxx

Anschrift:

IP Interactive UG ( haftungsbeschraenkt )
Zum Sonnenberg 1-3
63571 Gelnhausen

HRB 93402 beim Amtsgericht Hanau
Geschäftsführung: Oliver Dzombic

Steuer Nr.: 35 236 3622 1
UST ID: DE274086107


Am 18.07.2016 um 11:24 schrieb m13913886148@xxxxxxxxx:
> Where to find base docu?
> Official website does not update the document
>
>
> On Monday, July 18, 2016 5:16 PM, Oliver Dzombic
> <info@xxxxxxxxxxxxxxxxx> wrote:
>
>
> Hi
>
> i suggest you to read some base docu about that.
>
> osd_tier_promote_max_bytes_sec = how much bytes per second are going on tier
>
> ceph osd pool set ssd-pool target_max_bytes = maximum size in bytes on
> this specific pool ( its like a quota )
>
> --
> Mit freundlichen Gruessen / Best regards
>
> Oliver Dzombic
> IP-Interactive
>
> mailto:info@xxxxxxxxxxxxxxxxx <mailto:info@xxxxxxxxxxxxxxxxx>
>
> Anschrift:
>
> IP Interactive UG ( haftungsbeschraenkt )
> Zum Sonnenberg 1-3
> 63571 Gelnhausen
>
> HRB 93402 beim Amtsgericht Hanau
> Geschäftsführung: Oliver Dzombic
>
> Steuer Nr.: 35 236 3622 1
> UST ID: DE274086107
>
>
> Am 18.07.2016 um 11:14 schrieb m13913886148@xxxxxxxxx
> <mailto:m13913886148@xxxxxxxxx>:
>> what is "osd_tier_promote_max_bytes_sec" in ceph.conf file  and command
>> "ceph osd pool set ssd-pool target_max_bytes" are not the same ?
>>
>>
>> On Monday, July 18, 2016 4:40 PM, Oliver Dzombic
>> <info@xxxxxxxxxxxxxxxxx <mailto:info@xxxxxxxxxxxxxxxxx>> wrote:
>>
>>
>> Hi,
>>
>> osd_tier_promote_max_bytes_sec
>>
>> is your friend.
>>
>> --
>> Mit freundlichen Gruessen / Best regards
>>
>> Oliver Dzombic
>> IP-Interactive
>>
>> mailto:info@xxxxxxxxxxxxxxxxx <mailto:info@xxxxxxxxxxxxxxxxx>
> <mailto:info@xxxxxxxxxxxxxxxxx <mailto:info@xxxxxxxxxxxxxxxxx>>
>>
>> Anschrift:
>>
>> IP Interactive UG ( haftungsbeschraenkt )
>> Zum Sonnenberg 1-3
>> 63571 Gelnhausen
>>
>> HRB 93402 beim Amtsgericht Hanau
>> Geschäftsführung: Oliver Dzombic
>>
>> Steuer Nr.: 35 236 3622 1
>> UST ID: DE274086107
>>
>>
>> Am 18.07.2016 um 10:19 schrieb m13913886148@xxxxxxxxx
> <mailto:m13913886148@xxxxxxxxx>
>> <mailto:m13913886148@xxxxxxxxx <mailto:m13913886148@xxxxxxxxx>>:
>>> hello cepher!
>>>    I have a problem like this :
>>>    I want to config a cache tiering to my ceph with writeback mode.In
>>> ceph-0.94,it runs ok. IO is First through hot-pool. then it flush to
>>> cold-pool.
>>>    But in ceph-10.2.2,it doesn't like tihs. IO wrties to  hot-pool and
>>> cold-pool at the same time. I think it is be associated with "proxy".
>>>    So how to config a cache tiering in ceph-10.2.2 to Improve IO
>>> performance as much as possible ?
>>>    how to use the proxy in cache tiering ?
>>
>>>
>>>
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>
> <mailto:ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>>
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>

> <mailto:ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>>
>
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com