Gal, My SA just gave me the server with the 5.14 RC4 kernel built. I have a two pass preconditioning run going right now to get us maximum results. I expect to be able to run the tests hopefully by COB Wednesday. Preconditioning will take 8 hours unfortunately (15.36TB drives), I have to make BIOS changes for apples to apples "hero runs" and then get the mdraid's created. In your opinion, if I bypass the initial formatting with mdadm --assume-clean, will that make a difference in the results? I usually let the format run, but I want to get you results as soon as possible. Thanks, Jim -----Original Message----- From: Gal Ofri <gal.ofri@xxxxxxxxxxx> Sent: Sunday, August 1, 2021 7:21 AM To: Finlayson, James M CIV (USA) <james.m.finlayson4.civ@xxxxxxxx> Cc: 'linux-raid@xxxxxxxxxxxxxxx' <linux-raid@xxxxxxxxxxxxxxx> Subject: [Non-DoD Source] Re: Can't get RAID5/RAID6 NVMe randomread IOPS - AMD ROME what am I missing????? All active links contained in this email were disabled. Please verify the identity of the sender, and confirm the authenticity of all links contained within the message prior to copying and pasting the address to a Web browser. ---- Hey Jim, Read iops (rand/seq) were addressed in a recent commit: 97ae27252f49 md/raid5: avoid device_lock in read_one_chunk() Caution-https://github.com/torvalds/linux/commit/97ae27252f4962d0fcc38ee1d9f913d817a2024e It was merged into 5.14, so you can either cherry-pick it or just use a latest-master kernel. Sounds like your environment is stronger than the one I used for the testing, so please do share your benchmark if you manage to surpass the results described in the commit message. Cheers, Gal Ofri, Volumez (formerly storing.io)
