Hi.
Gluster 5.13 is running directly on VM. Got mount failed, endpoint is not connected in K8s. Sometimes connection refused of 1 of 3 Gluster nodes also. Reboot helps sometimes.
My idea is to optimize performance.
I have no idea.
These are the settings I found (from older versions?).
client.event-threads 8
cluster.lookup-optimize on
cluster.lookup-unhashed auto
cluster.quorum-type auto
cluster.read-hash-mode 0
cluster.readdir-optimize on
cluster.self-heal-daemon enable
cluster.server-quorum-type server
cluster.shd-max-threads 12
cluster.use-compound-fops on
dht.force-readdirp off
features.cache-invalidation on
features.cache-invalidation-timeout 600
network.inode-lru-limit 1000000
nfs.disable on
performance.cache-samba-metadata on
performance.cache-invalidation on
performance.cache-max-file-size 1GB
performance.cache-refresh-timeout 60
performance.cache-samba-metadata on
performance.cache-size 1GB
performance.client-io-threads on
performance.enable-least-priority off
performance.force-readdirp off
performance.io-cache off
performance.io-thread-count 16
performance.md-cache-timeout 600
performance.nl-cache on
performance.nl-cache-timeout 600
performance.open-behind off
performance.parallel-readdir on
performance.quick-read off
performance.rda-cache-limit 25MB
performance.read-ahead off
performance.readdir-ahead off
performance.stat-prefetch off
performance.strict-o-direct on
performance.write-behind off
performance.write-behind-window-size 16MB
server.allow-insecure on
server.event-threads 8
server.outstanding-rpc-limit 128
storage.fips-mode-rchecksum on
transport.address-family inet
cluster.lookup-optimize on
cluster.lookup-unhashed auto
cluster.quorum-type auto
cluster.read-hash-mode 0
cluster.readdir-optimize on
cluster.self-heal-daemon enable
cluster.server-quorum-type server
cluster.shd-max-threads 12
cluster.use-compound-fops on
dht.force-readdirp off
features.cache-invalidation on
features.cache-invalidation-timeout 600
network.inode-lru-limit 1000000
nfs.disable on
performance.cache-samba-metadata on
performance.cache-invalidation on
performance.cache-max-file-size 1GB
performance.cache-refresh-timeout 60
performance.cache-samba-metadata on
performance.cache-size 1GB
performance.client-io-threads on
performance.enable-least-priority off
performance.force-readdirp off
performance.io-cache off
performance.io-thread-count 16
performance.md-cache-timeout 600
performance.nl-cache on
performance.nl-cache-timeout 600
performance.open-behind off
performance.parallel-readdir on
performance.quick-read off
performance.rda-cache-limit 25MB
performance.read-ahead off
performance.readdir-ahead off
performance.stat-prefetch off
performance.strict-o-direct on
performance.write-behind off
performance.write-behind-window-size 16MB
server.allow-insecure on
server.event-threads 8
server.outstanding-rpc-limit 128
storage.fips-mode-rchecksum on
transport.address-family inet
I can add them like this to my storage class:
kind: StorageClass
apiVersion: storage.k8s.io/v1beta1
metadata:
name: gluster-heketi-external
provisioner: kubernetes.io/glusterfs
parameters:
resturl: "http://<HOSTNAME>:8080"
restuser: "admin"
secretName: "heketi-secret"
secretNamespace: "kube-system"
# volumeoptions: "ctime off"
# volumetype: replicate:2
kind: StorageClass
apiVersion: storage.k8s.io/v1beta1
metadata:
name: gluster-heketi-external
provisioner: kubernetes.io/glusterfs
parameters:
resturl: "http://<HOSTNAME>:8080"
restuser: "admin"
secretName: "heketi-secret"
secretNamespace: "kube-system"
# volumeoptions: "ctime off"
# volumetype: replicate:2
volumeoptions: "key value key value key value"
See last line.
Please help.
Best regards
________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-users
