Re: Integration of GPU with glusterfs

Darrell Budic <budic@xxxxxxxxxxxxxxxx> · Thu, 11 Jan 2018 11:14:29 -0600

Sounds like a good option to look into, but I wouldn’t want it to take time & resources away from other, non-GPU based, methods of improving this. Mainly because I don’t have discrete GPUs in most of my systems. While I could add them to my main server cluster pretty easily, many of my clients are 1U or blade systems and have no real possibility of having a GPU added.
It would also add physical resource requirements to future client deploys, requiring more than 1U for the server (most likely), and I’m not likely to want to do this if I’m trying to optimize for client density, especially with the cost of GPUs today.

From: Ashish Pandey <aspandey@xxxxxxxxxx>

Subject:  Integration of GPU with glusterfs

Date: January 11, 2018 at 12:12:43 AM CST

To: Gluster Users

Cc: Gluster Devel

Hi,

We have been thinking of exploiting GPU capabilities to enhance performance of glusterfs. We would like to know others thoughts on this.
In EC, we have been doing CPU intensive computations to encode and decode data before writing and reading. This requires a lot of CPU cycles and we have
been observing 100% CPU usage on client side. Data healing will also have the same impact as it also needs to do read-decode-encode-write cycle. 
As most of the  modern servers comes with GPU feature, having glusterfs GPU ready might give us performance improvements.
This is not only specific to EC volume, there are other features which will require a lot of computations and could use this capability; For Example:
1 - Encryption/Decryption
2 - Compression and de-duplication
3 - Hashing
4 - Any other? [Please add if you have something in mind]

Before proceeding further we would like to have your inputs on this.
Do you have any other use case (existing or future) which could perform better on GPU?
Do you think that it is worth to integrate GPU with glusterfs? The effort to have this performance gain could be achieved by some other better ways.
Any input on the way we should implement it.

There is a gihub issue opened for this. Please provide your comment or reply to this mail.

A - https://github.com/gluster/glusterfs/issues/388 

---
Ashish
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users