On 04 Jul 2007 13:41:26 +0200, Andi Kleen <andi@xxxxxxxxxxxxxx> wrote:
Dan Williams <dan.j.williams@xxxxxxxxx> writes: > The write performance numbers are better than I expected and would seem > to address the concerns raised in the thread "Odd (slow) RAID > performance"[2]. The read performance drop was not expected. However, > the numbers suggest some additional changes to be made to the queuing > model. Have you considered supporting copy-xor in MD for non accelerated RAID? I've been looking at fixing the old dubious slow crufty x86 SSE XOR functions.
Copy-xor is something that Neil suggested at the beginning of the acceleration work. It was put on the back-burner, but now that the implementation has settled it can be revisited.
One thing I discovered is that it seems fairly pointless to make them slower with cache avoidance when most of the data is copied before anyways. I think much more advantage could be gotten by supporting copy-xor because XORing during a copy should be nearly free.
Yes, it does not make sense to have cache-avoidance mismatched copy and xor operations in MD. However, I think the memcpy should be changed to a cache-avoiding memcpy rather than caching the xor data. Then a copy-xor implementation will have a greater effect, or do you see it differently?
On the other hand ext3 write() also uses a cache avoiding copy now and for the XOR it would need to load the data from memory again. Perhaps this could be also optimized somehow (e.g. setting a flag somewhere and using a normal copy for the RAID-5 case)
The incoming async_memcpy call has a flags parameter where this could go... One possible way to implement support for copy-xor (and xor-copy-xor for that matter) would be to write a soft-dmaengine driver. When a memcpy is submitted it can hold off processing it to see if an xor operation is attached to the chain. Once the xor descriptor is attached the implementation will know the location of all the incoming data, all the existing stripe data and the destination for the xor.
-Andi
Dan - To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
