I am seeing a strange behavior with Luminous 12.2.4 and Bluestore, Ubuntu kernel 4.14 and 108 x 10K RPM Seagate drives, no SSD WAL/DB and 8GB Areca controllers, 10 GbE networking on OSD nodes and 56GbE on clients. Single stream IOs to RD volumes return with 50-1000 ms latency, while atop shows any of the physical drives respond with single ms of latency. No obvious errors - I am wondering if we are not working the OSD daemons hard enough. In the past, there was the osd_op_threads, which seemed to help when > 20 - this parameter seems to be gone now. I looked at the osd_op_queue, but not sure if it would do similar things. Any ideas? https://vendor2.nginfotpdx.net/gitlab/upstream/ceph/commit/8aa159befa58cd9059ad99c752146f3a5dbfcb8b -- Alex Gorbachev Storcium _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |