Re: cluster.readdir-optimize and disappearing files/dirs bug

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I was able to make it out of that issue with listings by recreating everything on 3.12.X
Or maybe it was some setting conflict as I ran tests of each setting for performance and left only those that gave better results. End up with settings below for the distributed mail-server using maildir
cluster.readdir-optimize didn't do much anyway

fuse mounting with negative-timeout=10,attribute-timeout=30,fopen-keep-cache,direct-io-mode=enable,fetch-attempts=5

server.allow-insecure: on
cluster.shd-max-threads: 12
performance.rda-cache-limit: 128MB
cluster.readdir-optimize: on
cluster.read-hash-mode: 0
performance.strict-o-direct: on
cluster.lookup-unhashed: auto
performance.nl-cache: on
performance.nl-cache-timeout: 600
cluster.lookup-optimize: on
client.event-threads: 4
performance.client-io-threads: on
performance.md-cache-timeout: 600
server.event-threads: 4
features.cache-invalidation: on
features.cache-invalidation-timeout: 600
performance.stat-prefetch: on
performance.cache-invalidation: on
network.inode-lru-limit: 90000
performance.cache-refresh-timeout: 10
performance.enable-least-priority: off
performance.cache-size: 2GB
cluster.nufa: on
cluster.choose-local: on
server.outstanding-rpc-limit: 128
disperse.eager-lock: off
performance.io-thread-count: 8


On Tue, Apr 3, 2018 at 1:43 PM, Artem Russakovskii <archon810@xxxxxxxxx> wrote:
Hi,

As many of you know, gluster suffers from pretty bad performance issues when there are lots of files. One way to at least attempt to improve performance is setting cluster.readdir-optimize to on.

However, based on my recent tests (using Gluster 3.13.2), as well as tests of many others (like http://lists.gluster.org/pipermail/gluster-devel/2016-November/051417.html), there's a bug that frequently makes the listings of entire dirs disappear. Though the data is still there, it's a very scary bug for production systems which may think all data is gone.

I know Gluster 4 was recently released, but it makes no mention of cluster.readdir-optimize in the notes.

What's the status of diagnosing this bug and fixing it? We're experiencing major performance issues with gluster in production, and I'd love to do everything possible to get them resolved.

Thank you.

Sincerely,
Artem

--
Founder, Android PoliceAPK Mirror, Illogical Robot LLC

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux