Re: Finding my bottle neck

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thank you for those answers.
I will take time to ponder if glusterfs is the solution I was looking for in this case.


Thank you.

On Tue, Dec 18, 2018 at 10:36 PM csirotic <csirotic@xxxxxxxxx> wrote:
Hi,
I am new to using gluster and I am running some tests right now. I am fairly inexperienced as well, so it's a good learning experience for me.

My problem right now is the small file create iops, using smallfile. I cannot get more than 800 files/second 4k.

My setup is fairly simple.
I have 4 servers.
3 first server have each one brick that is three way replicated.
Server 4 simply mount the volume using the fuse native client.

The first three servers, all have the same hardware. Its common supermicro servers with a raid 6 array of 8 x 6tb hgst 7200 drives.
If I test smallfile directly on the brick location, I get very high results.

For the networking part of it, the 4 servers are using 10GBytes. Iperf3 give me steady 10GBytes when I test between all the servers.

When I transfer files from the client-server with the fuse mount, large .qcow files, I get around 150 MB/s. Why is not low, but is not great either.

What would you look at first?
The options that I am pondering are buying ssd drives to put cache on each servers.
Also, it seems to me that having only a 3 way replication, instead of 2+2 setup, is really hurting.
Any other tests that could help my process?

Any input is much appreciated.
Thank you.




Sent from my Bell Samsung device over Canada's largest network.
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux