Hi Sage and all, Currently the option bluestore_shard_finishers is set as false. As a result there is one finisher to handle bluestore IO completion. In NVMe scenario, it becomes the bottleneck. In my cluster with one OSD on NVMe disk, With finisher number is 1: write: IOPS=20.6k, BW=80.5MiB/s (84.4MB/s)(70.8GiB/899908msec) And when set finisher numbers to 8: write: IOPS=41.1k, BW=161MiB/s (168MB/s)(141GiB/899916msec) In scenario with finisher number as 1, it takes long time in finisher queue. I am wondering whether we can set bluestore_shard_finishers to true by default? And by default m_finisher_num = cct->_conf->osd_op_num_shards_hdd/2 or m_finisher_num = cct->_conf->osd_op_num_shards_ssd/2 How do you think? -- Best wishes Lisa -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
