Could you share glusterd statedump file? Run kill -SIGUSR1 $(pidof glusterd) and post that there would be a statedump file created in /var/run/gluster.
-Atin
Sent from one plus one
On 03-Mar-2016 12:07 am, "Steve Dainard" <sdainard@xxxxxxxx> wrote:
From the the client side logs I can see version info on mount:Final graph:+------------------------------------------------------------------------------+1: volume storage-client-02: type protocol/client3: option clnt-lk-version 14: option volfile-checksum 05: option volfile-key /storage6: option client-version 3.7.67: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-0-0-08: option fops-version 12984379: option ping-timeout 4210: option remote-host 10.0.231.5011: option remote-subvolume /mnt/raid6-storage/storage12: option transport-type socket13: option send-gids true14: end-volume15:16: volume storage-client-117: type protocol/client18: option clnt-lk-version 119: option volfile-checksum 020: option volfile-key /storage21: option client-version 3.7.622: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-1-0-023: option fops-version 129843724: option ping-timeout 4225: option remote-host 10.0.231.5126: option remote-subvolume /mnt/raid6-storage/storage27: option transport-type socket28: option send-gids true29: end-volume30:31: volume storage-client-232: type protocol/client33: option clnt-lk-version 134: option volfile-checksum 035: option volfile-key /storage36: option client-version 3.7.637: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-2-0-038: option fops-version 129843739: option ping-timeout 4240: option remote-host 10.0.231.5241: option remote-subvolume /mnt/raid6-storage/storage42: option transport-type socket43: option send-gids true44: end-volume45:46: volume storage-client-347: type protocol/client48: option clnt-lk-version 149: option volfile-checksum 050: option volfile-key /storage51: option client-version 3.7.652: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-3-0-053: option fops-version 129843754: option ping-timeout 4255: option remote-host 10.0.231.5356: option remote-subvolume /mnt/raid6-storage/storage57: option transport-type socket58: option send-gids true59: end-volume60:61: volume storage-client-462: type protocol/client63: option ping-timeout 4264: option remote-host 10.0.231.5465: option remote-subvolume /mnt/raid6-storage/storage66: option transport-type socket67: option send-gids true68: end-volume69:70: volume storage-client-571: type protocol/client72: option ping-timeout 4273: option remote-host 10.0.231.5574: option remote-subvolume /mnt/raid6-storage/storage75: option transport-type socket76: option send-gids true77: end-volume78:79: volume storage-dht80: type cluster/distribute81: subvolumes storage-client-0 storage-client-1 storage-client-2 storage-client-3 storage-client-4 storage-client-582: end-volumeBut not the client op-version, how can I retrieve this info?ThanksOn Tue, Mar 1, 2016 at 10:19 PM, Gaurav Garg <ggarg@xxxxxxxxxx> wrote:Hi Steve,
Which version you have upgraded client, could you tell us client op-version after upgrade ?
have you upgraded all of your clients ?
Thanks,
Gaurav
_______________________________________________
----- Original Message -----
From: "Steve Dainard" <sdainard@xxxxxxxx>
To: "gluster-users@xxxxxxxxxxx List" <gluster-users@xxxxxxxxxxx>
Sent: Wednesday, March 2, 2016 1:10:27 AM
Subject: gluster 3.7.6 volume set: failed: One or more connected clients cannot support the feature being set
Gluster 3.7.6
'storage' is a distributed volume
# gluster volume set storage rebal-throttle lazy
volume set: failed: One or more connected clients cannot support the feature being set. These clients need to be upgraded or disconnected before running this command again
I found a client connected using version 3.6.7 so I upgraded & umount/mount the gluster volume on the client but I'm still getting this error.
I've run grep "accepted client from" /var/log/glusterfs/bricks/* | grep -v 3.7.6 and I get a few returns from the client above, all dated last week.
I've run 'gluster volume status storage clients' and checked the connected clients manually, they're all running 3.7.6.
/var/log/gluster/etc-glusterfs-glusterd.vol.log:
[2016-03-01 19:23:20.180821] E [MSGID: 106022] [glusterd-utils.c:10154:glusterd_check_client_op_version_support] 0-management: One or more c
lients don't support the required op-version
[2016-03-01 19:23:20.180853] E [MSGID: 106301] [glusterd-syncop.c:1274:gd_stage_op_phase] 0-management: Staging of operation 'Volume Set' fa
iled on localhost : One or more connected clients cannot support the feature being set. These clients need to be upgraded or disconnected be
fore running this command again
Also tried setting the diagnostics.brick-log-level logging level and got the same error.
/var/lib/glusterd/vols/storage/info:
type=0
count=6
status=1
sub_count=0
stripe_count=1
replica_count=1
disperse_count=0
redundancy_count=0
version=26
transport-type=0
volume-id=26d355cb-c486-481f-ac16-e25390e73775
username=eb9e2063-6ba8-4d16-a54f-2c7cf7740c4c
password=
op-version=3
client-op-version=3
quota-version=1
parent_volname=N/A
restored_from_snap=00000000-0000-0000-0000-000000000000
snap-max-hard-limit=256
features.quota-deem-statfs=on
features.inode-quota=on
diagnostics.brick-log-level=WARNING
features.quota=on
performance.readdir-ahead=on
performance.cache-size=1GB
performance.stat-prefetch=on
brick-0=10.0.231.50:-mnt-raid6-storage-storage
brick-1=10.0.231.51:-mnt-raid6-storage-storage
brick-2=10.0.231.52:-mnt-raid6-storage-storage
brick-3=10.0.231.53:-mnt-raid6-storage-storage
brick-4=10.0.231.54:-mnt-raid6-storage-storage
brick-5=10.0.231.55:-mnt-raid6-storage-storage
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users
