RGW memory consumption

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi everyone,

we are running a ceph nautilus 14.2.22 cluster with 6 osd-nodes (each 12x8TB hdd, 2x ssd for rgw index pool), 3 mon-nodes and 3 dedicated rgw-nodes. The rgw-nodes have 64GB ram each. We have a job running every day at 4 am. It is running for about 1 hour, it is read only, read load is peaking up to about 970MB/s (megabyte per second). This is causing an additional ~5% of ram usage every day on the rgw-nodes. This ram usage is never freed up. So we have to restart the rgws regularly. Maybe there is some kind of memory leak ongoing.

For example right now on one of my rgw-nodes:


$ free -m
              total        used        free      shared  buff/cache   available
Mem:          63686       44084        6363           4       13238       18887

top tells me, radosgw is using 67.8% of the machines memory.

A mempool dump on the radosgw shows me

        "total": {
            "items": 71162589,
            "bytes": 1712643376

which is only 1,7 Gbyte. Almost all of it used as "buffer_anon".


Are there any setting that might help tuning the memory consumption? Do you need further information about my setup?



Thank you,
Martin

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux