There no doubt are those with differing views, but here’s my take. Back in the second half of the 1980s, it was not unusual for a *ix workstation to have all of 4MB of RAM. Yes, that is the right unit. Modules were limited in capacity compared to today, and were relatively much more expensive. Diskless workstations were not uncommon, swapping over 10Mb/s ethernet via NFS or ND onto an SMD drive with a transfer rate of 9.6 Mb/s and loooooong seeks. That was an era where swap was often a necessity. But that was a long time ago, and our hardware landscrape is dramatically different today. My view is that if in general a server-role system needs swap, what it really needs is more RAM. There may be exceptions where, say, it might make sense to swap onto an NVMe or PMEM device. With Ceph, I definitely am not a believer in swap. Conventional swap, say to SATA/SAS HDD/SSD, will be much slower than RAM, and OSD performance will tank, resulting in dreaded slow requests, etc. One of my mantras (*) is that Ceph is usually happier with a component down hard than with it up and crippled or flapping. So my sense is that in almost all cases, one is better off having an OSD crash and restart if it fails to alloc memory than for it to slow to a crawl when swapping. With the osd_memory_target in recent releases, OSD processes in my experience are much less prone to ballooning as well. * Along with “There is no such thing as too much garlic" > > Dear ceph community, > > over the last years I read pros and cons regarding swap for different workloads or setups. > > Recently I came again across that question on ceph OSD nodes. The folks a croit disable it at all on their distribution an suggest it to ;) …. and from the v14.2.22 Nautilus released notes I got: > > … the most consistent performing combination is to enable bluefs_buffered_io and disable system level swap … > > Out of curiosity: How do you configure your systems? Do you enable swap or do you disable it at all? > > Assume that regarding the OSD configuration and expected workload there should be enough RAM. > > Thanks for your thoughts and regards . Götz > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |