I should mention we are using the S3 interface, so it is S3 traffic.
________________________________________
Von: Martin Traxl <martin.traxl@xxxxxxxx>
Gesendet: Dienstag, 10. August 2021 14:35
An: ceph-users@xxxxxxx
Betreff: RGW memory consumption
Hi everyone,
we are running a ceph nautilus 14.2.22 cluster with 6 osd-nodes (each 12x8TB hdd, 2x ssd for rgw index pool), 3 mon-nodes and 3 dedicated rgw-nodes. The rgw-nodes have 64GB ram each. We have a job running every day at 4 am. It is running for about 1 hour, it is read only, read load is peaking up to about 970MB/s (megabyte per second). This is causing an additional ~5% of ram usage every day on the rgw-nodes. This ram usage is never freed up. So we have to restart the rgws regularly. Maybe there is some kind of memory leak ongoing.
For example right now on one of my rgw-nodes:
$ free -m
total used free shared buff/cache available
Mem: 63686 44084 6363 4 13238 18887
top tells me, radosgw is using 67.8% of the machines memory.
A mempool dump on the radosgw shows me
"total": {
"items": 71162589,
"bytes": 1712643376
which is only 1,7 Gbyte. Almost all of it used as "buffer_anon".
Are there any setting that might help tuning the memory consumption? Do you need further information about my setup?
Thank you,
Martin
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
