On Tue, 17 Nov 2015, ghislain.chevalier@xxxxxxxxxx wrote: > Hi, > > Context: > Firefly 0.80.9 > Ubuntu 14.04.1 > Almost a production platform in an openstack environment > 176 OSD (SAS and SSD), 2 crushmap-oriented storage classes , 8 servers in 2 rooms, 3 monitors on openstack controllers > Usage: Rados Gateway for object service and RBD as back-end for Cinder and Glance > > Issue: > We are currently running performances tests on this cluster before turning it to production. > We created cinder volumes (attached to Ceph Back End) on virtual machines and we use FIO to stress the cluster. > A very large number of threads are created per OSD daemon (about 1000). This is normal. The init scripts set the max open files ulimit to a high value (usually 4194304 to avoid any possibility of hitting it) but you may need to set /proc/sys/kernel/pid_max to something big if your cluster is large. sage -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html