On 2/22/2013 2:10 AM, Stan Hoeppner wrote: Revisiting this briefly... > 2. Run fio using this job file and post the results: > > [global] > filename=/dev/vg0/testlv (assuming this is still correct) > zero_buffers > numjobs=16 > thread > group_reporting > blocksize=256k > ioengine=libaio > iodepth=16 > direct=1 > size=8g > > [read] > rw=randread > stonewall > > [write] > rw=randwrite > stonewall When you run the fio test above, use this for grabbing top output. But first, if you haven't already, run top interactively and enable per CPU display, save by hitting 'w'. Then use: ~$ top -b -n 60 -d 0.25|grep Cpu|sort -n > /some.dir/some.file This will grab metrics 4 times per second instead of 2 as we did previously. This will give better resolution. It will also sort the output by CPU making it much easier to see the ramp and load trend on each. It should have a run time of ~16 seconds, which should be plenty of time to launch fio and get the entire run in our top data. I'm not sure if we were running it long enough previously to capture (all of) the write job. It would probably be wise to upload the top output file to a pastebin and link it, as it will be 240 lines long. I'm quite anxious to see the random write results from the test above and the accompanying CPU burn. The bandwidth numbers should be a bit surprising to you and others following this thread. Ok, I'm probably sandbagging a bit. They should shock you. Then, after everyone has retrieved their jaws from the floor I'll explain why the numbers are so much higher, and why proper test methodology is critical to benchmarking. -- Stan -- To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html