Re: Monitoring bluestore compression ratio

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi David,

First of all 'bluestore_extent_compress' is unrelated to data compression - that's amount of merged onode's extent map entries.

When BlueStore detects neighboring extents in an onode - it might merge them into a single map entry, e.g.

write 0x4000~1000

...

<other sparse writes>

...

write 0x5000~2000


can be merged in a single extent entry in the corresponding extent map:
...
0x4000~3000
...

Hence please ignore this parameter for your task.

Other parameters show that most probably no compression were applied.
But could you please share all the counters from "bluestore" section?

Also for easier analysis it would be nice to have some OSD log extract (with 'debug bluestore = 20') containing writes supposed to be compressed.

Thanks,
Igor


On 6/26/2018 4:53 PM, David Turner wrote:
ceph daemon osd.1 perf dump | grep bluestore | grep compress
        "bluestore_compressed": 0,
        "bluestore_compressed_allocated": 0,
        "bluestore_compressed_original": 0,
        "bluestore_extent_compress": 35372,

I filled up an RBD in a compressed pool (aggressive) in my test cluster with 1TB of zeros.  The bluestore OSDs in the cluster all show similar to this. Am I missing something here?  Is there any other method to determining compression ratios?

On Tue, Dec 5, 2017 at 1:25 AM Rafał Wądołowski <rwadolowski@xxxxxxxxxxxxxx> wrote:

Finally, I've founded the command:


ceph daemon osd.1 perf dump | grep bluestore


And there you have compressed data

Regards,

Rafał Wądołowski


http://cloudferro.com/

On 04.12.2017 14:17, Rafał Wądołowski wrote:
Hi,

Is there any command or tool to show effectiveness of bluestore compression?

I see the difference (in ceph osd df tree), while uploading a object to ceph, but maybe there are more friendly method to do it.



_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux