GlusterFS fuse client read performance problem

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I'm having a problem with the read performance with the native fuse client. I can write at  250 to 300mb/s but can only read the same written file at a maximum of 60mb/s. Is this behavior normal?
When I tried the NFS mount the speed for read and write operations are about the same peaking both at about 300mb/s.

The tests I did were while copying to and from the mount with a 2gb, and 10gb file.

The build is 2 servers with replicated volumes, both with SSD drives under software Raid 1, 10Gbit local ethernet with MTU 9000, 64Gb ram and 16 core processor.

I've tried a couple different configurations on the server and currently have the following:

Running glusterfs 3.8.5 built on Oct 20 2016 01:15:39

Volume Name: webstorage
Type: Replicate
Volume ID: 1a5924de-737c-4a3d-a195-a95ea1fc6ad6
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: srv1:/data/glusterfs/bricks/1/webstorage
Brick2: srv2:/data/glusterfs/bricks/1/webstorage
Options Reconfigured:
nfs.outstanding-rpc-limit: 128
nfs.acl: off
performance.client-io-threads: on
cluster.lookup-optimize: on
server.outstanding-rpc-limit: 128
server.event-threads: 3
client.event-threads: 3
performance.read-ahead: on
performance.io-cache: on
performance.write-behind-window-size: 1MB
performance.cache-size: 15728640
performance.io-thread-count: 32
nfs.trusted-write: on
nfs.trusted-sync: on
performance.nfs.io-cache: on
performance.nfs.stat-prefetch: on
performance.nfs.io-threads: on
performance.nfs.read-ahead: off
nfs.mem-factor: 20
transport.address-family: inet
performance.readdir-ahead: on
nfs.disable: off
auth.allow: 172.16.*.*
performance.quick-read: on
cluster.read-hash-mode: 0

The client is running the same version of GlusterFs and have the same hardware specs as the servers.

Is there something that I'm missing for the native fuse mount to perform a read speed comparable to the NFS mount? Or at least the same as the write speed of the fuse mount?

Thank you,
Regards.
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux