On Thu, Jan 11, 2018 at 10:44 PM, Darrell Budic <budic@xxxxxxxxxxxxxxxx> wrote:
Sounds like a good option to look into, but I wouldn’t want it to take time & resources away from other, non-GPU based, methods of improving this. Mainly because I don’t have discrete GPUs in most of my systems. While I could add them to my main server cluster pretty easily, many of my clients are 1U or blade systems and have no real possibility of having a GPU added.
In 3.9.0 Xavi added support to use hardware extensions on CPU if available. It uses special instructions if any of "x64", "sse", "avx" etc is available. There is also a plan to do systematic encoding in future which will be different from the current way of encoding. We need to check how performance will change with that as well.
It would also add physical resource requirements to future client deploys, requiring more than 1U for the server (most likely), and I’m not likely to want to do this if I’m trying to optimize for client density, especially with the cost of GPUs today.
From: Ashish Pandey <aspandey@xxxxxxxxxx>
Subject: Integration of GPU with glusterfs
Date: January 11, 2018 at 12:12:43 AM CST
To: Gluster Users
Cc: Gluster Devel
______________________________Hi,We have been thinking of exploiting GPU capabilities to enhance performance of glusterfs. We would like to know others thoughts on this.In EC, we have been doing CPU intensive computations to encode and decode data before writing and reading. This requires a lot of CPU cycles and we havebeen observing 100% CPU usage on client side. Data healing will also have the same impact as it also needs to do read-decode-encode-write cycle.As most of the modern servers comes with GPU feature, having glusterfs GPU ready might give us performance improvements.This is not only specific to EC volume, there are other features which will require a lot of computations and could use this capability; For Example:1 - Encryption/Decryption2 - Compression and de-duplication3 - Hashing4 - Any other? [Please add if you have something in mind]Before proceeding further we would like to have your inputs on this.Do you have any other use case (existing or future) which could perform better on GPU?Do you think that it is worth to integrate GPU with glusterfs? The effort to have this performance gain could be achieved by some other better ways.Any input on the way we should implement it.There is a gihub issue opened for this. Please provide your comment or reply to this mail.---Ashish_________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users
--
Pranith
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://lists.gluster.org/mailman/listinfo/gluster-users
