Hi Thomas, Yes we set it to a million. >From our puppet manifest: # need to increase aio-max-nr to allow many bluestore devs sysctl { 'fs.aio-max-nr': val => '1048576' } Cheers, Dan On Aug 30, 2017 9:53 AM, "Thomas Bennett" <thomas@xxxxxxxxx> wrote: > > Hi, > > I've been testing out Luminous and I've noticed that at some point the number of osds per nodes was limited by aio-max-nr. By default its set to 65536 in Ubuntu 16.04 > > Has anyone else experienced this issue? > > fs.aio-nr currently sitting at 196608 with 48 osds. > > I have 48 osd's per node so I've added fs.aio-max-nr = 262144 in my /etc/systctl.d/ceph-tuning.conf file. > > Cheers, > Tom > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com