On my ceph osd servers I have lot of "out of memory messages".
My servers are configured with :
- 32 G of memory
- 11 HDD (3,5 T each) (+ 2 HDD for the system)
And the error messages are :
[101292.017968] Out of memory: Kill process 2597 (ceph-osd)
score 102 or sacrifice child
[101292.018836] Killed process 2597 (ceph-osd)
total-vm:5048008kB, anon-rss:3002648kB, file-rss:0kB,
shmem-rss:0kB
Top result :
PID USER PR NI VIRT RES SHR S %CPU %MEM
TIME+ COMMAND
75469 ceph 20 0 4982324 3,988g 0 S 0,7 12,7
3:45.05 ceph-osd
75499 ceph 20 0 5095896 3,710g 0 S 0,3 11,8
4:08.93 ceph-osd
65848 ceph 20 0 5713748 3,329g 0 S 0,0 10,6
68:49.12 ceph-osd
67237 ceph 20 0 5580720 3,155g 0 S 0,0 10,1
57:15.99 ceph-osd
71113 ceph 20 0 5557608 3,101g 0 S 0,3 9,9
36:47.69 ceph-osd
74745 ceph 20 0 5117212 3,062g 0 S 3,7 9,8
8:13.56 ceph-osd
72494 ceph 20 0 5621156 2,828g 0 S 0,3 9,0
27:19.97 ceph-osd
70954 ceph 20 0 5765016 2,571g 0 S 0,3 8,2
40:02.00 ceph-osd
74817 ceph 20 0 5139328 2,510g 0 S 0,3 8,0
7:24.33 ceph-osd
76523 ceph 20 0 3324820 2,422g 0 S 0,3 7,7
0:55.54 ceph-osd
Is there a way to limit or reduce the memory usage of each osd
deamon ?
