Gluster Performance Issues

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




Dear Gluster-Experts,


we created a three-node setup with two bricks each and a dispersed
volume that can be

accessed via the native client (glusterfs --version = 6.0).


The nodes are connected via 10Gbps (cat6,bonding mode 6).


If we running a performance test using the smallfile benchmark tool,

./smallfile_cli.py --top ~/test6/ --file-size 16384 --threads 8 --files
1000 --response-times y --operation create

we observing the

behavior as  shown in the attached figure. For a short time, we can
almost saturated the 10Gbps but

then immediately network traffic is dropping almost to zero for about 5
to 25 seconds.

Actually, we don't have any glue what does causes this strange behavior.
We had a lot of

reconfigured volume options and now we are starting from scratch, i.e.


gluster volume reset dispersed_fuse all


and the current options looks like:

Volume Name: dispersed_fuse
Type: Disperse
Volume ID: 45d3c7c9-526f-45ea-9930-ee7a2274a220
Status: Started
Snapshot Count: 1
Number of Bricks: 1 x (4 + 2) = 6
Transport-type: tcp
Bricks:
Brick1: mimas:/gluster/vg00/dispersed_fuse/brick
Brick2: enceladus:/gluster/vg00/dispersed_fuse/brick
Brick3: tethys:/gluster/vg00/dispersed_fuse/brick
Brick4: mimas:/gluster/vg01/dispersed_fuse/brick
Brick5: enceladus:/gluster/vg01/dispersed_fuse/brick
Brick6: tethys:/gluster/vg01/dispersed_fuse/brick
Options Reconfigured:
client.event-threads: 16
server.event-threads: 16
performance.io-thread-count: 16
geo-replication.ignore-pid-check: on
geo-replication.indexing: on
features.quota: off
features.inode-quota: off
nfs.disable: on
storage.fips-mode-rchecksum: on
server.outstanding-rpc-limit: 512
server.root-squash: off
cluster.server-quorum-ratio: 51%
cluster.enable-shared-storage: enable


Any hints for root cause analysis are appreciated.

Please let me know if you need more information.


Kind Regards,

Felix

Attachment: gluster_smallfile_Performance_test_nativeClient_dispersed_fuse.png
Description: PNG image

________

Community Meeting Calendar:

APAC Schedule -
Every 2nd and 4th Tuesday at 11:30 AM IST
Bridge: https://bluejeans.com/441850968

NA/EMEA Schedule -
Every 1st and 3rd Tuesday at 01:00 PM EDT
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux