Re: Can I create a distributed dispersed volume with RAM drives?

[Ewen Chan <alpha754293@xxxxxxxxxxx>]

Vijay:

I just tried that and the results using this command:

# for i in `seq -w 1 4`; do dd if=/dev/zero of=10Gfile$1 bs=1024k count=10240; done

is about 1/4th the write performance of a distributed volume.

(I'm currently testing with a 64 GB RAM drive on each of my four compute nodes that are then tied together using GlusterFS).

With a distributed volume, and with direct-io-mode=enable, at best, I can execute that same task at around 2 GB/s. (The host system could execute that task at around 2.8 GB/s to /dev/shm.)

With a dispersed volume with 1 brick for redundancy, it drops to around 500 MB/s at best.

Is there no other way to be get the kind of performance that stripping should theorectically provide?

Thank you.

Sincerely,

Ewen

---

From: Vijay Bellur <vbellur@xxxxxxxxxx>
Sent: August 20, 2019 7:50 PM
To: Ewen Chan <alpha754293@xxxxxxxxxxx>
Cc: gluster-users@xxxxxxxxxxx <gluster-users@xxxxxxxxxxx>
Subject: Re: Can I create a distributed dispersed volume with RAM drives?

 

On Tue, Aug 20, 2019 at 4:47 PM Ewen Chan <alpha754293@xxxxxxxxxxx> wrote:

Vijay:

Here is what it says:

[root@node1 brick1]# gluster volume create gv0 stripe 4 node1:/bricks/brick1/gv0 node2:/bricks/brick1/gv0 node3:/bricks/brick1/gv0 node4:/bricks/brick1/gv0

stripe option not supported

Usage:

volume create <NEW-VOLNAME> [stripe <COUNT>] [replica <COUNT> [arbiter <COUNT>]] [disperse [<COUNT>]] [disperse-data <COUNT>] [red

undancy <COUNT>] [transport <tcp|rdma|tcp,rdma>] <NEW-BRICK>... [force]

It says that the stripe option is not supported, but then in the usage right below it, it gives the correct syntax for how to use the gluster volume create command.

Creating stripe volumes has been deprecated in recent releases. You can create a dispersed volume using the following syntax:

# gluster volume create [disperse [<count>]] [redundancy <count>] <brick-list>

HTH,

Vijay

 

Your help in this matter is greatly appreciated.

Thank you.

Sincerely,

Ewen

---

From: Vijay Bellur <vbellur@xxxxxxxxxx>
Sent: August 20, 2019 6:21 PM
To: Ewen Chan <alpha754293@xxxxxxxxxxx>
Cc: gluster-users@xxxxxxxxxxx <gluster-users@xxxxxxxxxxx>
Subject: Re: Can I create a distributed dispersed volume with RAM drives?

 

On Tue, Aug 20, 2019 at 8:13 AM Ewen Chan <alpha754293@xxxxxxxxxxx> wrote:

To Whom It May Concern:

I am currently using CentOS 7.6.1810 on four compute nodes, where each node has 128 GB of RAM.

I have created a tmpfs mount point using half of the RAM.

I read the CentOS SIG Gluster Quickstart wiki/document (https://wiki.centos.org/SpecialInterestGroup/Storage/gluster-Quickstart). In there, it was creating a replicated volume.

Can I create a distributed dispersed volume with RAM drives?

I was able to create a distributed volume, but I am having difficulties trying to create a distributed dispersed volume.

Can you provide more details about the problems encountered while creating a distributed dispersed volume?

Thanks,

Vijay 

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users