Hi, Sure, it's attached /var/log/gluster/nfs.log.1 (was logrotated this morning). So the time looks off, but if gluster is logging with UTC times it does match our monitoring logs, so I guess that's it. We had alerts from 4:55 to 5:10 am, and the logs seems to flood errors at 3 am so I'm guessing UTC. As mentionned one of the bricks seems to have an hardware problem, the ips6adm.hobb. So I guess those errors are that it can't write on that brick ? Those logs are from ips4adm.hobb. Is it a different problem, not a freez because of the heal but because a brick was dying trying to write on disk ? Thanks On Thu, Jul 07, 2016 at 01:52:19PM +0530, Krutika Dhananjay wrote: > Could you share the client (nfs?) logs? > > -Krutika > On Thu, Jul 7, 2016 at 1:14 PM, Kevin Lemonnier <lemonnierk@xxxxxxxxx> > wrote: > > Hi, > > I recently installed a 3.7.12 gluster to replace our 3.7.6 in > production. > I started moving a few VMs on it, it's accessed using NFS (not ganesha, > as it's debian). > > Last night one of the nodes rebooted, I wasn't the one on call but I can > see in our > monitoring logs that the website hosted on the production VM I moved on > the cluster stopped > responding for 9 minutes. It really really looks like the problem we > have with 3.7.6 where > the VMs are freezing during the heals. > Can someone confirm that 3.7.12 shouldn't be freezing the shards waiting > for a heal, only the shards > being actively healed ? > > In the VM's console I can see the warning about hung task for more than > 120 > seconds, which does seem to indicate that the VM was frozen for a while. > It's a simple debian 8 on proxmox with a virtIO disk on an NFS gluster > volume. > Here is the volume config, if that matters : > > Options Reconfigured: > cluster.data-self-heal-algorithm: full > features.shard-block-size: 64MB > features.shard: on > performance.stat-prefetch: off > performance.io-cache: off > performance.read-ahead: off > performance.quick-read: off > cluster.eager-lock: enable > network.remote-dio: enable > cluster.server-quorum-type: server > cluster.quorum-type: auto > performance.readdir-ahead: on > > Thanks > -- > Kevin Lemonnier > PGP Fingerprint : 89A5 2283 04A0 E6E9 0111 > _______________________________________________ > Gluster-users mailing list > Gluster-users@xxxxxxxxxxx > http://www.gluster.org/mailman/listinfo/gluster-users -- Kevin Lemonnier PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
[2016-07-04 13:57:32.785528] I [MSGID: 100030] [glusterfsd.c:2338:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.12 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/559cc0c18054901c23a85cb8653b6ce2.socket) [2016-07-04 13:57:32.788538] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-07-04 13:57:32.823941] I [rpcsvc.c:2196:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-07-04 13:57:32.830467] W [MSGID: 112153] [mount3.c:3936:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-07-04 13:57:32.839648] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-04 13:57:32.839666] I [MSGID: 112110] [nfs.c:1505:init] 0-nfs: NFS service started [2016-07-04 13:57:32.842433] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-07-04 13:57:32.842794] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth.auth-glusterfs' is not recognized [2016-07-04 13:57:32.842837] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth-allow-insecure' is not recognized [2016-07-04 13:57:32.842870] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'transport-type' is not recognized [2016-07-04 13:57:32.845591] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-0: parent translators are ready, attempting connect on transport [2016-07-04 13:57:32.845995] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-1: parent translators are ready, attempting connect on transport [2016-07-04 13:57:32.846141] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-0: changing port to 49152 (from 0) Final graph: +------------------------------------------------------------------------------+ 1: volume VMs-client-0 2: type protocol/client 3: option ping-timeout 42 4: option remote-host ips4adm.hobb 5: option remote-subvolume /mnt/storage/VMs 6: option transport-type socket 7: option username 22c5474e-578b-4805-b867-49692b1218d0 8: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 9: option send-gids true 10: end-volume 11: 12: volume VMs-client-1 13: type protocol/client 14: option ping-timeout 42 15: option remote-host ips5adm.hobb 16: option remote-subvolume /mnt/storage/VMs 17: option transport-type socket 18: option username 22c5474e-578b-4805-b867-49692b1218d0 19: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 20: option send-gids true 21: end-volume 22: 23: volume VMs-replicate-0 24: type cluster/replicate 25: subvolumes VMs-client-0 VMs-client-1 26: end-volume 27: 28: volume VMs-dht 29: type cluster/distribute 30: subvolumes VMs-replicate-0 31: end-volume 32: 33: volume VMs-write-behind 34: type performance/write-behind 35: subvolumes VMs-dht 36: end-volume 37: 38: volume VMs 39: type debug/io-stats 40: option log-level INFO 41: option latency-measurement off 42: option count-fop-hits off 43: subvolumes VMs-write-behind 44: end-volume 45: 46: volume nfs-server 47: type nfs/server 48: option rpc-auth.auth-glusterfs on 49: option rpc-auth.auth-unix on 50: option rpc-auth.auth-null on 51: option rpc-auth.ports.insecure on 52: option rpc-auth-allow-insecure on 53: option transport-type socket 54: option transport.socket.listen-port 2049 55: option nfs.dynamic-volumes on 56: option nfs.nlm on 57: option nfs.drc off 58: option rpc-auth.addr.VMs.allow * 59: option nfs3.VMs.volume-id c5272382-d0c8-4aa4-aced-dd25a064e45c 60: subvolumes VMs 61: end-volume 62: +------------------------------------------------------------------------------+ [2016-07-04 13:57:32.846535] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-04 13:57:32.846612] E [MSGID: 114058] [client-handshake.c:1524:client_query_portmap_cbk] 0-VMs-client-1: failed to get the port number for remote subvolume. Please run 'gluster volume status' on server to see if brick process is running. [2016-07-04 13:57:32.846645] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-VMs-client-1: disconnected from VMs-client-1. Client process will keep trying to connect to glusterd until brick's port is available [2016-07-04 13:57:32.846816] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-0: Connected to VMs-client-0, attached to remote volume '/mnt/storage/VMs'. [2016-07-04 13:57:32.846830] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-0: Server and Client lk-version numbers are not same, reopening the fds [2016-07-04 13:57:32.846869] I [MSGID: 108005] [afr-common.c:4142:afr_notify] 0-VMs-replicate-0: Subvolume 'VMs-client-0' came back up; going online. [2016-07-04 13:57:32.847033] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-0: Server lk version = 1 [2016-07-04 13:57:32.847326] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-04 13:57:32.847390] I [MSGID: 109063] [dht-layout.c:718:dht_layout_normalize] 0-VMs-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-000000000001). Holes=1 overlaps=0 [2016-07-04 13:57:32.848742] I [MSGID: 109036] [dht-common.c:8888:dht_log_new_layout_for_dir_selfheal] 0-VMs-dht: Setting layout of / with [Subvol_name: VMs-replicate-0, Err: -1 , Start: 0 , Stop: 4294967295 , Hash: 1 ], [2016-07-04 13:57:36.787071] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-1: changing port to 49152 (from 0) [2016-07-04 13:57:36.787508] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-04 13:57:36.787819] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-1: Connected to VMs-client-1, attached to remote volume '/mnt/storage/VMs'. [2016-07-04 13:57:36.787829] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-1: Server and Client lk-version numbers are not same, reopening the fds [2016-07-04 13:57:36.787959] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-1: Server lk version = 1 [2016-07-04 13:59:58.601173] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-04 14:18:47.583265] I [MSGID: 109036] [dht-common.c:8888:dht_log_new_layout_for_dir_selfheal] 0-VMs-dht: Setting layout of /images/112 with [Subvol_name: VMs-replicate-0, Err: -1 , Start: 0 , Stop: 4294967295 , Hash: 1 ], [2016-07-05 12:41:03.120360] I [MSGID: 100030] [glusterfsd.c:2338:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.12 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/559cc0c18054901c23a85cb8653b6ce2.socket) [2016-07-05 12:41:03.123303] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-07-05 12:41:04.121478] I [rpcsvc.c:2196:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-07-05 12:41:04.128913] W [MSGID: 112153] [mount3.c:3936:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-07-05 12:41:04.138778] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:41:04.138796] I [MSGID: 112110] [nfs.c:1505:init] 0-nfs: NFS service started [2016-07-05 12:41:04.140627] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-07-05 12:41:04.141223] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth.auth-glusterfs' is not recognized [2016-07-05 12:41:04.141274] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth-allow-insecure' is not recognized [2016-07-05 12:41:04.141309] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'transport-type' is not recognized [2016-07-05 12:41:04.141365] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-0: parent translators are ready, attempting connect on transport [2016-07-05 12:41:04.141655] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-1: parent translators are ready, attempting connect on transport [2016-07-05 12:41:04.141782] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-0: changing port to 49152 (from 0) [2016-07-05 12:41:04.141856] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-2: parent translators are ready, attempting connect on transport Final graph: +------------------------------------------------------------------------------+ 1: volume VMs-client-0 2: type protocol/client 3: option ping-timeout 42 4: option remote-host ips4adm.hobb 5: option remote-subvolume /mnt/storage/VMs 6: option transport-type socket 7: option username 22c5474e-578b-4805-b867-49692b1218d0 8: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 9: option send-gids true 10: end-volume 11: 12: volume VMs-client-1 13: type protocol/client 14: option ping-timeout 42 15: option remote-host ips5adm.hobb 16: option remote-subvolume /mnt/storage/VMs 17: option transport-type socket 18: option username 22c5474e-578b-4805-b867-49692b1218d0 19: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 20: option send-gids true 21: end-volume 22: 23: volume VMs-client-2 24: type protocol/client 25: option ping-timeout 42 26: option remote-host ips6adm.hobb 27: option remote-subvolume /mnt/storage/VMs 28: option transport-type socket 29: option username 22c5474e-578b-4805-b867-49692b1218d0 30: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 31: option send-gids true 32: end-volume 33: 34: volume VMs-replicate-0 35: type cluster/replicate 36: subvolumes VMs-client-0 VMs-client-1 VMs-client-2 37: end-volume 38: 39: volume VMs-dht 40: type cluster/distribute 41: subvolumes VMs-replicate-0 42: end-volume 43: 44: volume VMs-write-behind 45: type performance/write-behind [2016-07-05 12:41:04.142208] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) 46: subvolumes VMs-dht 47: end-volume 48: 49: volume VMs 50: type debug/io-stats 51: option log-level INFO 52: option latency-measurement off 53: option count-fop-hits off 54: subvolumes VMs-write-behind 55: end-volume 56: 57: volume nfs-server 58: type nfs/server 59: option rpc-auth.auth-glusterfs on 60: option rpc-auth.auth-unix on 61: option rpc-auth.auth-null on 62: option rpc-auth.ports.insecure on 63: option rpc-auth-allow-insecure on 64: option transport-type socket 65: option transport.socket.listen-port 2049 66: option nfs.dynamic-volumes on 67: option nfs.nlm on 68: option nfs.drc off 69: option rpc-auth.addr.VMs.allow * 70: option nfs3.VMs.volume-id c5272382-d0c8-4aa4-aced-dd25a064e45c 71: subvolumes VMs 72: end-volume 73: +------------------------------------------------------------------------------+ [2016-07-05 12:41:04.142323] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:41:04.142405] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-0: Connected to VMs-client-0, attached to remote volume '/mnt/storage/VMs'. [2016-07-05 12:41:04.142416] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-0: Server and Client lk-version numbers are not same, reopening the fds [2016-07-05 12:41:04.142436] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-1: changing port to 49152 (from 0) [2016-07-05 12:41:04.142464] I [MSGID: 108005] [afr-common.c:4142:afr_notify] 0-VMs-replicate-0: Subvolume 'VMs-client-0' came back up; going online. [2016-07-05 12:41:04.142476] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:41:04.142502] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-0: Server lk version = 1 [2016-07-05 12:41:04.142550] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-2: changing port to 49152 (from 0) [2016-07-05 12:41:04.143000] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-05 12:41:04.143139] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-05 12:41:04.143285] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-1: Connected to VMs-client-1, attached to remote volume '/mnt/storage/VMs'. [2016-07-05 12:41:04.143294] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-1: Server and Client lk-version numbers are not same, reopening the fds [2016-07-05 12:41:04.143379] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-2: Connected to VMs-client-2, attached to remote volume '/mnt/storage/VMs'. [2016-07-05 12:41:04.143388] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-2: Server and Client lk-version numbers are not same, reopening the fds [2016-07-05 12:41:04.143434] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-1: Server lk version = 1 [2016-07-05 12:41:04.143795] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-2: Server lk version = 1 [2016-07-05 12:41:04.144414] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-05 12:43:23.224218] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:23.231436] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:23.233036] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:23.234208] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:43:23.235383] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:23.237009] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:29.124761] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:29.130118] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:29.130855] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:29.132457] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:37.061277] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:37.068563] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:37.070236] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:37.071365] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:43:37.072563] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:37.074149] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:42.184078] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:42.190920] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:42.192566] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:42.193235] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:43:42.194382] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:42.195969] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:47.172648] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:47.177991] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:47.178655] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:47.180253] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:53.437897] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:53.443461] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:53.444056] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:53.445616] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:57.717336] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:57.722864] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:43:57.723567] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:43:57.725208] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:02.381959] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:02.387516] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:02.388165] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:02.389835] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:07.376219] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:07.381668] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:07.382343] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:07.383937] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:13.389663] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:14.405382] I [MSGID: 100030] [glusterfsd.c:2338:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.12 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/559cc0c18054901c23a85cb8653b6ce2.socket) [2016-07-05 12:44:14.408411] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-07-05 12:44:14.410616] I [rpcsvc.c:2196:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-07-05 12:44:14.417419] W [MSGID: 112153] [mount3.c:3936:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-07-05 12:44:14.426696] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:44:14.426714] I [MSGID: 112110] [nfs.c:1505:init] 0-nfs: NFS service started [2016-07-05 12:44:14.428656] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-07-05 12:44:14.429237] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth.auth-glusterfs' is not recognized [2016-07-05 12:44:14.429281] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth-allow-insecure' is not recognized [2016-07-05 12:44:14.429314] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'transport-type' is not recognized [2016-07-05 12:44:14.429378] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-0: parent translators are ready, attempting connect on transport [2016-07-05 12:44:14.429680] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-1: parent translators are ready, attempting connect on transport [2016-07-05 12:44:14.429862] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-0: changing port to 49152 (from 0) [2016-07-05 12:44:14.429917] I [MSGID: 114020] [client.c:2106:notify] 0-VMs-client-2: parent translators are ready, attempting connect on transport Final graph: +------------------------------------------------------------------------------+ 1: volume VMs-client-0 2: type protocol/client 3: option ping-timeout 42 4: option remote-host ips4adm.hobb 5: option remote-subvolume /mnt/storage/VMs 6: option transport-type socket 7: option username 22c5474e-578b-4805-b867-49692b1218d0 8: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 9: option filter-O_DIRECT enable 10: option send-gids true 11: end-volume 12: 13: volume VMs-client-1 14: type protocol/client 15: option ping-timeout 42 16: option remote-host ips5adm.hobb 17: option remote-subvolume /mnt/storage/VMs 18: option transport-type socket 19: option username 22c5474e-578b-4805-b867-49692b1218d0 20: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 21: option filter-O_DIRECT enable 22: option send-gids true 23: end-volume 24: 25: volume VMs-client-2 26: type protocol/client 27: option ping-timeout 42 28: option remote-host ips6adm.hobb 29: option remote-subvolume /mnt/storage/VMs 30: option transport-type socket 31: option username 22c5474e-578b-4805-b867-49692b1218d0 32: option password 0ce822cf-558b-451a-8473-e66ca232e0b8 33: option filter-O_DIRECT enable 34: option send-gids true 35: end-volume 36: 37: volume VMs-replicate-0 38: type cluster/replicate 39: option eager-lock enable 40: option quorum-type auto 41: subvolumes VMs-client-0 VMs-client-1 VMs-client-2 42: end-volume 43: 44: volume VMs-dht 45: type cluster/distribute 46: subvolumes VMs-replicate-0 47: end-volume 48: 49: volume VMs-shard 50: type features/shard 51: subvolumes VMs-dht 52: end-volume 53: 54: volume VMs-write-behind 55: type performance/write-behind 56: subvolumes VMs-shard 57: end-volume 58: 59: volume VMs 60: type debug/io-stats 61: option log-level INFO 62: option latency-measurement off 63: option count-fop-hits off 64: subvolumes VMs-write-behind 65: end-volume 66: 67: volume nfs-server 68: type nfs/server 69: option rpc-auth.auth-glusterfs on 70: option rpc-auth.auth-unix on 71: option rpc-auth.auth-null on 72: option rpc-auth.ports.insecure on 73: option rpc-auth-allow-insecure on 74: option transport-type socket 75: option transport.socket.listen-port 2049 76: option nfs.dynamic-volumes on 77: option nfs.nlm on 78: option nfs.drc off 79: option rpc-auth.addr.VMs.allow * 80: option nfs3.VMs.volume-id c5272382-d0c8-4aa4-aced-dd25a064e45c 81: subvolumes VMs 82: end-volume 83: +------------------------------------------------------------------------------+ [2016-07-05 12:44:14.430369] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-05 12:44:14.430623] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-0: Connected to VMs-client-0, attached to remote volume '/mnt/storage/VMs'. [2016-07-05 12:44:14.430634] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-0: Server and Client lk-version numbers are not same, reopening the fds [2016-07-05 12:44:14.430662] I [MSGID: 108005] [afr-common.c:4142:afr_notify] 0-VMs-replicate-0: Subvolume 'VMs-client-0' came back up; going online. [2016-07-05 12:44:14.430683] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-0: Server lk version = 1 [2016-07-05 12:44:15.425571] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-1: changing port to 49152 (from 0) [2016-07-05 12:44:15.425937] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-2: changing port to 49152 (from 0) [2016-07-05 12:44:15.426083] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-05 12:44:15.426395] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-05 12:44:15.426442] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-1: Connected to VMs-client-1, attached to remote volume '/mnt/storage/VMs'. [2016-07-05 12:44:15.426451] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-1: Server and Client lk-version numbers are not same, reopening the fds [2016-07-05 12:44:15.426596] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-1: Server lk version = 1 [2016-07-05 12:44:15.426741] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-2: Connected to VMs-client-2, attached to remote volume '/mnt/storage/VMs'. [2016-07-05 12:44:15.426757] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-2: Server and Client lk-version numbers are not same, reopening the fds [2016-07-05 12:44:15.426997] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-2: Server lk version = 1 [2016-07-05 12:44:15.427510] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-05 12:44:23.039151] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:23.047164] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:23.048991] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:23.050182] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:44:23.051293] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:23.052901] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:29.037988] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:29.045947] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:29.047842] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed [2016-07-05 12:44:29.049066] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-07-05 12:44:29.050162] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 12:44:29.051783] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing [2016-07-05 13:00:00.009084] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-05 13:25:48.958817] I [MSGID: 109036] [dht-common.c:8888:dht_log_new_layout_for_dir_selfheal] 0-VMs-dht: Setting layout of /images/108 with [Subvol_name: VMs-replicate-0, Err: -1 , Start: 0 , Stop: 4294967295 , Hash: 1 ], [2016-07-05 14:22:58.835003] I [MSGID: 109036] [dht-common.c:8888:dht_log_new_layout_for_dir_selfheal] 0-VMs-dht: Setting layout of /images/103 with [Subvol_name: VMs-replicate-0, Err: -1 , Start: 0 , Stop: 4294967295 , Hash: 1 ], [2016-07-07 02:44:34.625903] C [rpc-clnt-ping.c:165:rpc_clnt_ping_timer_expired] 0-VMs-client-2: server 10.10.0.6:49152 has not responded in the last 42 seconds, disconnecting. [2016-07-07 02:44:34.626265] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:40.783318 (xid=0x5a4283) [2016-07-07 02:44:34.626288] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:44:34.626455] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.798145 (xid=0x5a4285) [2016-07-07 02:44:34.626586] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.798639 (xid=0x5a4286) [2016-07-07 02:44:34.626706] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.798750 (xid=0x5a4287) [2016-07-07 02:44:34.626828] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.798871 (xid=0x5a4288) [2016-07-07 02:44:34.626944] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.798944 (xid=0x5a4289) [2016-07-07 02:44:34.627067] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799010 (xid=0x5a428a) [2016-07-07 02:44:34.627187] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799075 (xid=0x5a428b) [2016-07-07 02:44:34.627235] I [socket.c:3429:socket_submit_request] 0-VMs-client-2: not connected (priv->connected = 0) [2016-07-07 02:44:34.627249] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5a42a1 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:44:34.627309] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799150 (xid=0x5a428c) [2016-07-07 02:44:34.627343] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5a42a2 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:44:34.627427] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799249 (xid=0x5a428d) [2016-07-07 02:44:34.627535] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799330 (xid=0x5a428e) [2016-07-07 02:44:34.627676] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799401 (xid=0x5a428f) [2016-07-07 02:44:34.627802] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799833 (xid=0x5a4290) [2016-07-07 02:44:34.627929] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.799928 (xid=0x5a4291) [2016-07-07 02:44:34.628065] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.800019 (xid=0x5a4292) [2016-07-07 02:44:34.628113] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-2: changing port to 49152 (from 0) [2016-07-07 02:44:34.628210] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.800121 (xid=0x5a4293) [2016-07-07 02:44:34.628273] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.627880 (xid=0x5a42a9) [2016-07-07 02:44:34.628313] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:43:41.800205 (xid=0x5a4294) [2016-07-07 02:44:34.628488] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] )))))/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:43:39.619834 (xid=0x5a4282) [2016-07-07 02:44:34.628495] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] )))))/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.628107 (xid=0x5a42aa) [2016-07-07 02:44:34.628523] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 02:44:34.628673] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:43:41.485450 (xid=0x5a4284) [2016-07-07 02:44:34.628687] W [MSGID: 114031] [client-rpc-fops.c:845:client3_3_statfs_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:44:34.628835] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:43:46.364941 (xid=0x5a4295) [2016-07-07 02:44:34.628968] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:43:51.563475 (xid=0x5a4296) [2016-07-07 02:44:34.629101] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GF-DUMP) op(NULL(2)) called at 2016-07-07 02:43:52.621262 (xid=0x5a4297) [2016-07-07 02:44:34.629115] W [rpc-clnt-ping.c:208:rpc_clnt_ping_cbk] 0-VMs-client-2: socket disconnected [2016-07-07 02:44:34.629182] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:43:56.427050 (xid=0x5a4298) [2016-07-07 02:44:34.629335] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:01.637613 (xid=0x5a4299) [2016-07-07 02:44:34.629469] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:06.529826 (xid=0x5a429a) [2016-07-07 02:44:34.629606] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:09.977815 (xid=0x5a429b) [2016-07-07 02:44:34.629733] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:11.680935 (xid=0x5a429c) [2016-07-07 02:44:34.629864] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:16.590565 (xid=0x5a429d) [2016-07-07 02:44:34.630006] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:21.787257 (xid=0x5a429e) [2016-07-07 02:44:34.630140] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:26.656256 (xid=0x5a429f) [2016-07-07 02:44:34.630272] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:31.823798 (xid=0x5a42a0) [2016-07-07 02:44:34.630334] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-VMs-client-2: disconnected from VMs-client-2. Client process will keep trying to connect to glusterd until brick's port is available The message "W [MSGID: 114031] [client-rpc-fops.c:845:client3_3_statfs_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 11 times between [2016-07-07 02:44:34.628687] and [2016-07-07 02:44:34.630284] The message "E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 32 times between [2016-07-07 02:44:34.626288] and [2016-07-07 02:44:34.631396] [2016-07-07 02:45:12.694005] W [socket.c:701:__socket_rwv] 0-VMs-client-2: readv on 10.10.0.6:49152 failed (Connection timed out) [2016-07-07 02:45:12.694283] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.629290 (xid=0x5a42ac) [2016-07-07 02:45:12.694300] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:45:12.694467] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.629307 (xid=0x5a42ad) [2016-07-07 02:45:12.694641] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.629599 (xid=0x5a42ae) [2016-07-07 02:45:12.694788] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.629844 (xid=0x5a42af) [2016-07-07 02:45:12.694938] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:44:34.630106 (xid=0x5a42b1) [2016-07-07 02:45:12.695118] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GF-DUMP) op(DUMP(1)) called at 2016-07-07 02:44:34.628988 (xid=0x5a42ab) [2016-07-07 02:45:12.695132] W [MSGID: 114032] [client-handshake.c:1623:client_dump_version_cbk] 0-VMs-client-2: received RPC status error [Transport endpoint is not connected] [2016-07-07 02:45:12.695217] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:44:34.630050 (xid=0x5a42b0) [2016-07-07 02:45:12.695229] W [MSGID: 114031] [client-rpc-fops.c:845:client3_3_statfs_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:46:19.697926] E [socket.c:2395:socket_connect_finish] 0-VMs-client-2: connection to 10.10.0.6:24007 failed (No route to host) The message "E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 7 times between [2016-07-07 02:45:12.694300] and [2016-07-07 02:45:12.695567] [2016-07-07 02:46:47.651026] E [MSGID: 114058] [client-handshake.c:1524:client_query_portmap_cbk] 0-VMs-client-2: failed to get the port number for remote subvolume. Please run 'gluster volume status' on server to see if brick process is running. [2016-07-07 02:46:47.651049] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-VMs-client-2: disconnected from VMs-client-2. Client process will keep trying to connect to glusterd until brick's port is available [2016-07-07 02:46:50.651899] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-2: changing port to 49152 (from 0) [2016-07-07 02:46:50.652358] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-07 02:46:50.653757] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-2: Connected to VMs-client-2, attached to remote volume '/mnt/storage/VMs'. [2016-07-07 02:46:50.653768] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-2: Server and Client lk-version numbers are not same, reopening the fds [2016-07-07 02:46:50.653895] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-2: Server lk version = 1 [2016-07-07 02:46:53.266785] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 71edce44-057b-49fd-8e2e-1f821882614c. sources=[0] 1 sinks=2 [2016-07-07 02:46:56.534366] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on ce2fb70f-7c1e-436e-b65b-8079e23d9f4b. sources=[0] 1 sinks=2 [2016-07-07 02:46:56.596994] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 9beadb32-76a0-4d25-9ac9-2fccb7a91041. sources=[0] 1 sinks=2 [2016-07-07 02:46:57.709218] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 09a14ce4-3376-4d0b-b166-e62104aad6be. sources=[0] 1 sinks=2 [2016-07-07 02:46:57.748435] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 1ea24784-16be-4565-8d85-050bc9a35134. sources=[0] 1 sinks=2 [2016-07-07 02:47:00.538107] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 7d77d958-fca2-47ac-bcb7-063859d4f382. sources=[0] 1 sinks=2 [2016-07-07 02:47:00.659729] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 9bf4d9ec-43eb-4d4d-81dd-baf1e75b53c2. sources=[0] 1 sinks=2 [2016-07-07 02:47:00.685488] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on dbe3626f-7e34-4f60-a019-3474e3d1a05d. sources=[0] 1 sinks=2 [2016-07-07 02:47:01.790632] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-07 02:47:09.126720] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on b60444c2-2637-4f07-96cf-2f75a02621a9. sources=[0] 1 sinks=2 [2016-07-07 02:47:09.793772] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 687450fb-cb1d-464c-b82f-d78ef7b9715d. sources=[0] 1 sinks=2 [2016-07-07 02:47:09.818472] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 41641151-3bc8-4a0c-8fe6-db529aac896f. sources=[0] 1 sinks=2 [2016-07-07 02:47:09.860977] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 0ee7b966-c933-48d0-b1ac-410de895f126. sources=[0] 1 sinks=2 [2016-07-07 02:47:09.970184] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 46f26449-4d79-4456-a0f8-1dcda3b3fcfb. sources=[0] 1 sinks=2 [2016-07-07 02:47:10.100182] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 4cf1e749-4258-42df-b690-cfbdacb68d9e. sources=[0] 1 sinks=2 [2016-07-07 02:47:10.103413] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10. sources=[0] 1 sinks=2 [2016-07-07 02:47:10.944979] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on c399a3e5-15e2-4096-964c-fed487127efb. sources=[0] 1 sinks=2 [2016-07-07 02:47:16.222247] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 6057fc4c-dcaf-46c8-a2de-db84f062f1ef. sources=[0] 1 sinks=2 [2016-07-07 02:47:19.151950] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 39f3c931-057d-41bb-bc80-d59ccdb77e9e. sources=[0] 1 sinks=2 [2016-07-07 02:47:19.169369] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4. sources=[0] 1 sinks=2 [2016-07-07 02:47:19.174762] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 89f0bfc7-4cf3-4954-ab1a-d2e753b557ab. sources=[0] 1 sinks=2 [2016-07-07 02:47:19.322609] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 5d0246c4-73db-4f66-8760-e311115245cc. sources=[0] 1 sinks=2 [2016-07-07 02:47:19.325555] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 5591358a-515e-43a6-ab24-edb946ee85d2. sources=[0] 1 sinks=2 [2016-07-07 02:47:19.426813] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 282fdace-df6f-4af9-8318-d4f17a33dae6. sources=[0] 1 sinks=2 [2016-07-07 02:47:37.513968] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 83236652-955d-4bcb-8a34-8965426733ee. sources=[0] 1 sinks=2 [2016-07-07 02:47:37.521275] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 8cc8181f-e649-445e-9b92-bef0d0ef62d9. sources=[0] 1 sinks=2 [2016-07-07 02:47:37.763110] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on d1077060-b55c-463a-a162-0bc5eaf63e5d. sources=[0] 1 sinks=2 [2016-07-07 02:47:37.768217] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on c4243a9c-050c-401f-88c4-471c5289e4c5. sources=[0] 1 sinks=2 [2016-07-07 02:47:39.118100] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 9999ce72-432d-4633-a3c4-b58d6f4603b9. sources=[0] 1 sinks=2 [2016-07-07 02:47:39.166907] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on af1b2dcf-2ae2-44f2-8e41-4c310cfb45ce. sources=[0] 1 sinks=2 [2016-07-07 02:47:40.537079] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on efc7b5df-b7bb-4394-9f34-336062e72315. sources=[0] 1 sinks=2 [2016-07-07 02:47:50.948865] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 6f16a550-4fa8-466b-8c81-b28615d99509. sources=[0] 1 sinks=2 [2016-07-07 02:48:10.431962] I [MSGID: 108026] [afr-self-heal-common.c:770:afr_log_selfheal] 0-VMs-replicate-0: Completed data selfheal on 34dfb74e-226e-498d-a5ca-606ee639369f. sources=[0] 1 sinks=2 [2016-07-07 02:59:38.782745] C [rpc-clnt-ping.c:165:rpc_clnt_ping_timer_expired] 0-VMs-client-2: server 10.10.0.6:49152 has not responded in the last 42 seconds, disconnecting. [2016-07-07 02:59:38.783109] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.255139 (xid=0x5b5803) [2016-07-07 02:59:38.783131] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:59:38.783254] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.255376 (xid=0x5b5806) [2016-07-07 02:59:38.783369] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.256008 (xid=0x5b580a) [2016-07-07 02:59:38.783496] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.256258 (xid=0x5b580d) [2016-07-07 02:59:38.783598] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.256494 (xid=0x5b580f) [2016-07-07 02:59:38.783704] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.257150 (xid=0x5b5812) [2016-07-07 02:59:38.783808] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.257196 (xid=0x5b5813) [2016-07-07 02:59:38.783966] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:58:47.257816 (xid=0x5b5816) [2016-07-07 02:59:38.784070] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.254291 (xid=0x5b57fc) [2016-07-07 02:59:38.784081] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 02:59:38.784119] I [socket.c:3429:socket_submit_request] 0-VMs-client-2: not connected (priv->connected = 0) [2016-07-07 02:59:38.784135] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5b5829 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:59:38.784149] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5b582a Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:59:38.784238] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.254322 (xid=0x5b57fd) [2016-07-07 02:59:38.784250] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5b582b Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:59:38.784398] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.254456 (xid=0x5b57ff) [2016-07-07 02:59:38.784532] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.255026 (xid=0x5b5801) [2016-07-07 02:59:38.784695] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.255054 (xid=0x5b5802) [2016-07-07 02:59:38.784850] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.255283 (xid=0x5b5804) [2016-07-07 02:59:38.784973] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2016-07-07 02:58:47.255351 (xid=0x5b5805) [2016-07-07 02:59:38.784985] W [MSGID: 114031] [client-rpc-fops.c:907:client3_3_writev_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:59:38.785023] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-VMs-client-2: changing port to 49152 (from 0) [2016-07-07 02:59:38.785071] I [socket.c:3429:socket_submit_request] 0-VMs-client-2: not connected (priv->connected = -1) [2016-07-07 02:59:38.785080] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5b5836 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:59:38.785108] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2016-07-07 02:58:47.255668 (xid=0x5b5807) [2016-07-07 02:59:38.785233] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:59:38.784756 (xid=0x5b5831) [2016-07-07 02:59:38.785330] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2016-07-07 02:59:38.784896 (xid=0x5b5833) [2016-07-07 02:59:38.785404] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5b5837 Program: GlusterFS 3.3, ProgVers: 330, Proc: 16) to rpc-transport (VMs-client-2) [2016-07-07 02:59:38.785419] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:59:38.785422] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2016-07-07 02:59:38.784880 (xid=0x5b5832) [2016-07-07 02:59:38.785446] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected] [2016-07-07 02:59:38.785555] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.255911 (xid=0x5b5808) [2016-07-07 02:59:38.785560] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2016-07-07 02:59:38.785016 (xid=0x5b5834) [2016-07-07 02:59:38.785595] W [rpc-clnt.c:1606:rpc_clnt_submit] 0-VMs-client-2: failed to submit rpc-request (XID: 0x5b5838 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (VMs-client-2) [2016-07-07 02:59:38.785648] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2016-07-07 02:59:38.785035 (xid=0x5b5835) [2016-07-07 02:59:38.785683] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2016-07-07 02:58:47.255971 (xid=0x5b5809) [2016-07-07 02:59:38.785862] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.256166 (xid=0x5b580b) [2016-07-07 02:59:38.785997] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2016-07-07 02:58:47.256238 (xid=0x5b580c) [2016-07-07 02:59:38.786131] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.256404 (xid=0x5b580e) [2016-07-07 02:59:38.786244] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.257046 (xid=0x5b5810) [2016-07-07 02:59:38.786351] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.257119 (xid=0x5b5811) [2016-07-07 02:59:38.786531] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.257548 (xid=0x5b5814) [2016-07-07 02:59:38.786638] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2016-07-07 02:58:47.257733 (xid=0x5b5815) [2016-07-07 02:59:38.786760] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.257844 (xid=0x5b5817) [2016-07-07 02:59:38.786967] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:47.257866 (xid=0x5b5818) [2016-07-07 02:59:38.787127] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:48.777035 (xid=0x5b5819) [2016-07-07 02:59:38.787265] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:48.777064 (xid=0x5b581a) [2016-07-07 02:59:38.787393] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:48.777091 (xid=0x5b581b) [2016-07-07 02:59:38.787518] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2016-07-07 02:58:48.777114 (xid=0x5b581c) [2016-07-07 02:59:38.787654] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:58:51.816857 (xid=0x5b581d) The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed" repeated 17 times between [2016-07-07 02:59:38.784081] and [2016-07-07 02:59:38.787533] [2016-07-07 02:59:38.787666] W [MSGID: 114031] [client-rpc-fops.c:845:client3_3_statfs_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:59:38.787817] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GF-DUMP) op(NULL(2)) called at 2016-07-07 02:58:56.778052 (xid=0x5b581e) [2016-07-07 02:59:38.787829] W [rpc-clnt-ping.c:208:rpc_clnt_ping_cbk] 0-VMs-client-2: socket disconnected [2016-07-07 02:59:38.787892] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:58:56.922954 (xid=0x5b581f) [2016-07-07 02:59:38.788036] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:01.892142 (xid=0x5b5820) [2016-07-07 02:59:38.788165] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:06.985568 (xid=0x5b5821) [2016-07-07 02:59:38.788293] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:11.935288 (xid=0x5b5822) [2016-07-07 02:59:38.788415] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:12.476480 (xid=0x5b5823) [2016-07-07 02:59:38.788536] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:16.083228 (xid=0x5b5824) [2016-07-07 02:59:38.788659] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:22.020516 (xid=0x5b5825) [2016-07-07 02:59:38.788781] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:26.102430 (xid=0x5b5826) [2016-07-07 02:59:38.788904] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:31.134277 (xid=0x5b5827) [2016-07-07 02:59:38.789024] E [rpc-clnt.c:362:saved_frames_unwind] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7fcce58a2723] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7fcce566d3ff] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fcce566d51e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x7e)[0x7fcce566ed2e] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fcce566f548] ))))) 0-VMs-client-2: forced unwinding frame type(GlusterFS 3.3) op(STATFS(14)) called at 2016-07-07 02:59:36.162105 (xid=0x5b5828) The message "W [MSGID: 114031] [client-rpc-fops.c:845:client3_3_statfs_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 10 times between [2016-07-07 02:59:38.787666] and [2016-07-07 02:59:38.789038] [2016-07-07 02:59:38.789083] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-VMs-client-2: disconnected from VMs-client-2. Client process will keep trying to connect to glusterd until brick's port is available The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 5 times between [2016-07-07 02:59:38.785419] and [2016-07-07 02:59:38.793410] [2016-07-07 02:59:38.793416] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected] [2016-07-07 02:59:38.794530] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 02:59:38.794554] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected] [2016-07-07 02:59:38.796858] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected]" repeated 4 times between [2016-07-07 02:59:38.785446] and [2016-07-07 02:59:38.785752] The message "W [MSGID: 114031] [client-rpc-fops.c:907:client3_3_writev_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 4 times between [2016-07-07 02:59:38.784985] and [2016-07-07 02:59:38.786649] [2016-07-07 02:59:38.797066] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed The message "E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 19 times between [2016-07-07 02:59:38.783131] and [2016-07-07 02:59:38.797380] [2016-07-07 03:10:07.881745] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-VMs-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-07-07 03:10:07.881923] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 03:10:07.882568] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.882626] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.882641] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected] The message "E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 2 times between [2016-07-07 03:10:07.882568] and [2016-07-07 03:10:07.882774] [2016-07-07 03:10:07.885728] W [MSGID: 114031] [client-rpc-fops.c:907:client3_3_writev_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.885808] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.885813] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected] [2016-07-07 03:10:07.885841] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] The message "E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected]" repeated 2 times between [2016-07-07 03:10:07.885841] and [2016-07-07 03:10:07.885972] [2016-07-07 03:10:07.886012] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.886054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Transport endpoint is not connected] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed" repeated 2 times between [2016-07-07 03:10:07.881923] and [2016-07-07 03:10:07.886117] [2016-07-07 03:10:07.886139] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.886202] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 03:10:07.886223] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.886264] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed" repeated 2 times between [2016-07-07 03:10:07.886264] and [2016-07-07 03:10:07.887323] [2016-07-07 03:10:07.887346] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887428] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887464] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 03:10:07.887528] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887573] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 03:10:07.887603] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887619] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887662] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [2016-07-07 03:10:07.887692] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887710] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Transport endpoint is not connected] [2016-07-07 03:10:07.887843] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-VMs-client-2: Connected to VMs-client-2, attached to remote volume '/mnt/storage/VMs'. [2016-07-07 03:10:07.887887] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-VMs-client-2: Server and Client lk-version numbers are not same, reopening the fds [2016-07-07 03:10:07.888172] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-VMs-client-2: Server lk version = 1 [2016-07-07 03:10:07.888573] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted]" repeated 2 times between [2016-07-07 03:10:07.888573] and [2016-07-07 03:10:07.890232] [2016-07-07 03:10:07.890259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:07.890592] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:07.891230] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.891252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.891298] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:07.891355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.891859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.892445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:07.892506] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:07.893074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.894043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3f272b16-c488-43bf-9409-255e9ebe65fa> (3f272b16-c488-43bf-9409-255e9ebe65fa) [Input/output error] [2016-07-07 03:10:07.894766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:71edce44-057b-49fd-8e2e-1f821882614c> (71edce44-057b-49fd-8e2e-1f821882614c) [Input/output error] [2016-07-07 03:10:07.895359] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:07.896616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.896828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.896848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] [2016-07-07 03:10:07.896915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] [2016-07-07 03:10:07.896932] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.897098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Input/output error] [2016-07-07 03:10:07.897131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] [2016-07-07 03:10:07.897157] I [MSGID: 108031] [afr-common.c:1913:afr_local_discovery_cbk] 0-VMs-replicate-0: selecting local read_child VMs-client-0 [2016-07-07 03:10:07.899026] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:07.900745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.900904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] [2016-07-07 03:10:07.900951] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3f272b16-c488-43bf-9409-255e9ebe65fa> (3f272b16-c488-43bf-9409-255e9ebe65fa) [Input/output error] [2016-07-07 03:10:07.901003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.901040] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:71edce44-057b-49fd-8e2e-1f821882614c> (71edce44-057b-49fd-8e2e-1f821882614c) [Input/output error] [2016-07-07 03:10:07.901107] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.901224] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.901237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.901257] E [MSGID: 114031] [client-rpc-fops.c:1676:client3_3_finodelk_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.901267] E [MSGID: 108010] [afr-lk-common.c:665:afr_unlock_inodelk_cbk] 0-VMs-replicate-0: path=(null) gfid=00000000-0000-0000-0000-000000000000: unlock failed on subvolume VMs-client-2 with lock owner 706a02d8cc7f0000 [Invalid argument] [2016-07-07 03:10:07.901813] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.901838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Input/output error] [2016-07-07 03:10:07.901852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Input/output error] [2016-07-07 03:10:07.901864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.902225] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] The message "E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error]" repeated 2 times between [2016-07-07 03:10:07.902225] and [2016-07-07 03:10:07.902419] [2016-07-07 03:10:07.902429] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:07.902482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.902610] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.902726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] [2016-07-07 03:10:07.903381] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] [2016-07-07 03:10:07.903419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Read-only file system]" repeated 4 times between [2016-07-07 03:10:07.903419] and [2016-07-07 03:10:07.904952] [2016-07-07 03:10:07.904966] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.905003] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.905249] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.905274] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.905339] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.905356] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.905441] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.905464] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.905981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:07.906264] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.906295] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.906536] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:07.906536] and [2016-07-07 03:10:07.907119] [2016-07-07 03:10:07.907159] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:07.907391] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.908373] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.908392] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.908514] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.908533] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.908951] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.909438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:71edce44-057b-49fd-8e2e-1f821882614c> (71edce44-057b-49fd-8e2e-1f821882614c) [Input/output error] [2016-07-07 03:10:07.909556] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.909593] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.909936] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:07.921955] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.921988] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.922506] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:07.922506] and [2016-07-07 03:10:07.922686] [2016-07-07 03:10:07.923328] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.923365] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.923527] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.923552] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.923693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10> (1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) [Input/output error] [2016-07-07 03:10:07.923756] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.923876] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.923973] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:07.924557] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:07.924557] and [2016-07-07 03:10:07.925836] [2016-07-07 03:10:07.926026] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.926053] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927146] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.927229] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.927251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927355] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.927372] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927412] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.927438] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927464] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.927497] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927562] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.927589] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927700] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.927739] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.927803] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:07.927803] and [2016-07-07 03:10:07.930205] [2016-07-07 03:10:07.930552] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.930589] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931362] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.931381] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931409] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.931470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.931484] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931507] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.931525] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931556] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.931572] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931804] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.931829] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931873] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.931883] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.931894] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:07.931894] and [2016-07-07 03:10:07.932832] [2016-07-07 03:10:07.932996] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.933033] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.933117] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:07.933117] and [2016-07-07 03:10:07.933937] [2016-07-07 03:10:07.946759] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.946786] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.946999] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947013] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947113] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947136] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947232] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947247] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947292] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.947370] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947384] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947428] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947438] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947475] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.947503] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947512] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947563] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.947574] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.947615] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 9 times between [2016-07-07 03:10:07.947615] and [2016-07-07 03:10:07.949182] [2016-07-07 03:10:07.950203] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.950251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.950273] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.950286] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.950390] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.950409] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.950484] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.950498] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.950577] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:07.950577] and [2016-07-07 03:10:07.951695] [2016-07-07 03:10:07.952062] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.952094] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.952307] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.952332] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.952495] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.952509] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.952691] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.952984] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.952996] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.953015] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.953243] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:07.953243] and [2016-07-07 03:10:07.953634] [2016-07-07 03:10:07.954322] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.954359] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.954763] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:07.954763] and [2016-07-07 03:10:07.955606] [2016-07-07 03:10:07.955856] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.955881] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.956086] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.956155] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.956173] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.956583] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.956612] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.956623] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.956773] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.956980] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.957040] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.957061] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.957121] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:07.957121] and [2016-07-07 03:10:07.957755] [2016-07-07 03:10:07.957914] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.957950] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.958156] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.958179] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.958209] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:07.958209] and [2016-07-07 03:10:07.958402] [2016-07-07 03:10:07.959138] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.959162] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.959182] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.959235] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.959256] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.959932] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.960045] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:07.960069] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:07.960236] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:07.961377] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.851254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4cf1e749-4258-42df-b690-cfbdacb68d9e> (4cf1e749-4258-42df-b690-cfbdacb68d9e) [Input/output error] [2016-07-07 03:10:09.851618] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.852314] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.852314] and [2016-07-07 03:10:09.852646] [2016-07-07 03:10:09.859553] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.859581] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.859641] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.859654] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.859689] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.859702] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.859993] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:09.859993] and [2016-07-07 03:10:09.861457] [2016-07-07 03:10:09.868548] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.868576] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.868605] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.868617] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.868701] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.868712] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.868751] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.868763] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.869140] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:09.869140] and [2016-07-07 03:10:09.870756] [2016-07-07 03:10:09.878180] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878207] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878220] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878228] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878240] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878248] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878429] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878456] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878486] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878496] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878509] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878516] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878581] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.878593] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.878857] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:09.878857] and [2016-07-07 03:10:09.881120] [2016-07-07 03:10:09.881163] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.883209] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.885598] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.885659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:45b14fac-d5aa-4732-9580-e90a12af6118> (45b14fac-d5aa-4732-9580-e90a12af6118) [Input/output error] [2016-07-07 03:10:09.888257] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888278] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:6057fc4c-dcaf-46c8-a2de-db84f062f1ef> (6057fc4c-dcaf-46c8-a2de-db84f062f1ef) [Input/output error] [2016-07-07 03:10:09.888422] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.888482] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888496] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888507] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.888549] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888566] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888579] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888586] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888595] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888601] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888609] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888616] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888624] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.888859] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.888875] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.888920] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.888940] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.889000] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.889034] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.889091] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.889139] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.889173] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.889173] and [2016-07-07 03:10:09.889401] [2016-07-07 03:10:09.889408] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.889434] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6057fc4c-dcaf-46c8-a2de-db84f062f1ef) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.889459] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.889492] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.889503] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.892733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.892758] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.892768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:a0aefa82-933d-4e7e-b5b6-aa4655f60a08> (a0aefa82-933d-4e7e-b5b6-aa4655f60a08) [Input/output error] [2016-07-07 03:10:09.892795] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.894115] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.894352] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.894732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:6f6442dd-c304-4fc6-a731-6a8f90678f13> (6f6442dd-c304-4fc6-a731-6a8f90678f13) [Input/output error] [2016-07-07 03:10:09.895037] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.895103] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.895401] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.895508] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.895524] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.897502] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.897523] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.897547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:e98c05ab-7528-4282-8c1d-ed4930657064> (e98c05ab-7528-4282-8c1d-ed4930657064) [Input/output error] [2016-07-07 03:10:09.897564] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.897577] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.897594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:ce2fb70f-7c1e-436e-b65b-8079e23d9f4b> (ce2fb70f-7c1e-436e-b65b-8079e23d9f4b) [Input/output error] [2016-07-07 03:10:09.897642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:93d20afe-384d-4a87-ae5e-0b9d59282604> (93d20afe-384d-4a87-ae5e-0b9d59282604) [Input/output error] [2016-07-07 03:10:09.898284] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.898353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:09a14ce4-3376-4d0b-b166-e62104aad6be> (09a14ce4-3376-4d0b-b166-e62104aad6be) [Input/output error] [2016-07-07 03:10:09.898396] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.898468] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.898566] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.898627] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.898645] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.898667] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.898721] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:e98c05ab-7528-4282-8c1d-ed4930657064> (e98c05ab-7528-4282-8c1d-ed4930657064) [Input/output error] [2016-07-07 03:10:09.898771] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.898819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.898908] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.898927] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.898959] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:93d20afe-384d-4a87-ae5e-0b9d59282604> (93d20afe-384d-4a87-ae5e-0b9d59282604) [Input/output error] [2016-07-07 03:10:09.899730] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.899762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:9bf4d9ec-43eb-4d4d-81dd-baf1e75b53c2> (9bf4d9ec-43eb-4d4d-81dd-baf1e75b53c2) [Input/output error] [2016-07-07 03:10:09.899804] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.900397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:a7e3f088-60ee-4f69-9f75-183c18bdce06> (a7e3f088-60ee-4f69-9f75-183c18bdce06) [Input/output error] [2016-07-07 03:10:09.900499] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.900607] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.900798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: /template (43589534-6f73-4879-bd70-e123e1c58421) [Input/output error] [2016-07-07 03:10:09.900885] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.901051] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.901086] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.901137] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.901150] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.901426] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.901447] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.904032] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.904053] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e98c05ab-7528-4282-8c1d-ed4930657064) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.904510] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.904558] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.904701] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.904717] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ce2fb70f-7c1e-436e-b65b-8079e23d9f4b) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.904733] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.904847] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.904858] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(93d20afe-384d-4a87-ae5e-0b9d59282604) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.906317] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.906372] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:919c2509-61c0-4da6-9bb8-e107f729a36e> (919c2509-61c0-4da6-9bb8-e107f729a36e) [Input/output error] [2016-07-07 03:10:09.906623] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.906635] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(09a14ce4-3376-4d0b-b166-e62104aad6be) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.906648] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.907121] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.907137] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.908775] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.908847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:919c2509-61c0-4da6-9bb8-e107f729a36e> (919c2509-61c0-4da6-9bb8-e107f729a36e) [Input/output error] [2016-07-07 03:10:09.908898] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.909030] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.909048] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.909114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:919c2509-61c0-4da6-9bb8-e107f729a36e> (919c2509-61c0-4da6-9bb8-e107f729a36e) [Input/output error] [2016-07-07 03:10:09.909137] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.909176] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.909313] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.909593] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.909657] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.909928] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.909951] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(9bf4d9ec-43eb-4d4d-81dd-baf1e75b53c2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.910013] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.910013] and [2016-07-07 03:10:09.910180] [2016-07-07 03:10:09.910339] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.910361] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.910416] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.910534] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.910671] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.910696] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.910843] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.910859] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.910913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:e4fa5d1e-3115-443a-ade9-8fc60f49b1ee> (e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) [Input/output error] [2016-07-07 03:10:09.910998] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.911192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: /template (43589534-6f73-4879-bd70-e123e1c58421) [Read-only file system] [2016-07-07 03:10:09.911461] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.911481] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.911600] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.911676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-1: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.911752] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.911772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.911773] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.911927] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.911973] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.912000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:e98c05ab-7528-4282-8c1d-ed4930657064> (e98c05ab-7528-4282-8c1d-ed4930657064) [Input/output error] [2016-07-07 03:10:09.912030] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.912778] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.912802] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.912887] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.913090] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.913126] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:09.913126] and [2016-07-07 03:10:09.913400] [2016-07-07 03:10:09.913428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:93d20afe-384d-4a87-ae5e-0b9d59282604> (93d20afe-384d-4a87-ae5e-0b9d59282604) [Input/output error] [2016-07-07 03:10:09.913491] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.913562] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.913612] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.913652] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.913662] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.913741] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.913834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1f11a138-62aa-4227-9bff-ffbe1363f70a> (1f11a138-62aa-4227-9bff-ffbe1363f70a) [Input/output error] [2016-07-07 03:10:09.913990] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.914126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Read-only file system] [2016-07-07 03:10:09.914164] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914686] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914713] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914737] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.914748] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.914761] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914797] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.914829] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914841] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.914848] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.914858] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914868] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914880] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.914911] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.914943] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914962] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.914985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cbe7a475-3ef4-487f-878c-364f79fe3013> (cbe7a475-3ef4-487f-878c-364f79fe3013) [Input/output error] [2016-07-07 03:10:09.918925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cbe7a475-3ef4-487f-878c-364f79fe3013> (cbe7a475-3ef4-487f-878c-364f79fe3013) [Input/output error] [2016-07-07 03:10:09.919055] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.919966] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.919985] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.920013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cbe7a475-3ef4-487f-878c-364f79fe3013> (cbe7a475-3ef4-487f-878c-364f79fe3013) [Input/output error] [2016-07-07 03:10:09.920741] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.920840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cbe7a475-3ef4-487f-878c-364f79fe3013> (cbe7a475-3ef4-487f-878c-364f79fe3013) [Input/output error] [2016-07-07 03:10:09.920889] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.921475] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.921504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cbe7a475-3ef4-487f-878c-364f79fe3013> (cbe7a475-3ef4-487f-878c-364f79fe3013) [Input/output error] [2016-07-07 03:10:09.921874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cbe7a475-3ef4-487f-878c-364f79fe3013> (cbe7a475-3ef4-487f-878c-364f79fe3013) [Input/output error] [2016-07-07 03:10:09.921967] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.921997] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.922025] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.922025] and [2016-07-07 03:10:09.922275] [2016-07-07 03:10:09.922365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3a85d230-a26a-40de-a81f-a7be9ecf1ebf> (3a85d230-a26a-40de-a81f-a7be9ecf1ebf) [Input/output error] [2016-07-07 03:10:09.922485] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.922485] and [2016-07-07 03:10:09.922875] [2016-07-07 03:10:09.923304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3a85d230-a26a-40de-a81f-a7be9ecf1ebf> (3a85d230-a26a-40de-a81f-a7be9ecf1ebf) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3a85d230-a26a-40de-a81f-a7be9ecf1ebf> (3a85d230-a26a-40de-a81f-a7be9ecf1ebf) [Input/output error]" repeated 2 times between [2016-07-07 03:10:09.923304] and [2016-07-07 03:10:09.923792] [2016-07-07 03:10:09.924012] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.924049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3a85d230-a26a-40de-a81f-a7be9ecf1ebf> (3a85d230-a26a-40de-a81f-a7be9ecf1ebf) [Input/output error] [2016-07-07 03:10:09.924076] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:09.924076] and [2016-07-07 03:10:09.925282] [2016-07-07 03:10:09.925833] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.925865] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.926048] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.926066] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.926108] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.926125] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.926284] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.926849] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.926863] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.926903] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.926913] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927009] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927034] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927123] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927136] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927181] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927198] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927248] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927259] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927302] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.927342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:225feab3-8dbc-43ea-9f85-0bb5676549bc> (225feab3-8dbc-43ea-9f85-0bb5676549bc) [Input/output error] [2016-07-07 03:10:09.927424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927450] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927533] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927551] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927648] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927662] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927726] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.927774] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927799] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.927872] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.927932] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.927948] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.928029] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.928044] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.928137] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.928177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:abd96590-aa77-4620-9a3e-b79df9b5b601> (abd96590-aa77-4620-9a3e-b79df9b5b601) [Input/output error] [2016-07-07 03:10:09.928195] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:09.928195] and [2016-07-07 03:10:09.928658] [2016-07-07 03:10:09.928687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:225feab3-8dbc-43ea-9f85-0bb5676549bc> (225feab3-8dbc-43ea-9f85-0bb5676549bc) [Input/output error] [2016-07-07 03:10:09.928776] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.928813] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.929388] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.929388] and [2016-07-07 03:10:09.929442] [2016-07-07 03:10:09.929458] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.930113] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.930163] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.930189] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.930904] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.931532] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.931594] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.932227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:022a18a0-5b39-4aa3-930c-e8284209ce2d> (022a18a0-5b39-4aa3-930c-e8284209ce2d) [Input/output error] [2016-07-07 03:10:09.932323] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:dbe3626f-7e34-4f60-a019-3474e3d1a05d> (dbe3626f-7e34-4f60-a019-3474e3d1a05d) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:dbe3626f-7e34-4f60-a019-3474e3d1a05d> (dbe3626f-7e34-4f60-a019-3474e3d1a05d) [Input/output error]" repeated 2 times between [2016-07-07 03:10:09.932323] and [2016-07-07 03:10:09.932471] [2016-07-07 03:10:09.932488] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:ed8cadd0-785a-44da-93e6-56a640b44b73> (ed8cadd0-785a-44da-93e6-56a640b44b73) [Input/output error] [2016-07-07 03:10:09.932528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:211e8118-0521-4ad2-9247-8eeee03cd357> (211e8118-0521-4ad2-9247-8eeee03cd357) [Input/output error] [2016-07-07 03:10:09.932563] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.932606] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:022a18a0-5b39-4aa3-930c-e8284209ce2d> (022a18a0-5b39-4aa3-930c-e8284209ce2d) [Input/output error] [2016-07-07 03:10:09.932627] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.932627] and [2016-07-07 03:10:09.934555] [2016-07-07 03:10:09.934681] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.934705] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.934946] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.935431] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.935485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: /dump (7af01a6c-fb98-4a3c-be36-5e65b847263e) [Read-only file system] [2016-07-07 03:10:09.935983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:418b4a6e-9153-481a-afe9-08df80021fd2> (418b4a6e-9153-481a-afe9-08df80021fd2) [Input/output error] [2016-07-07 03:10:09.936122] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.936135] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.936224] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.936236] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.936248] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.936255] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.936278] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.936287] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.936677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-1: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.936776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.936820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.936861] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:09.936861] and [2016-07-07 03:10:09.937323] [2016-07-07 03:10:09.937374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Read-only file system] [2016-07-07 03:10:09.937690] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.937705] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(418b4a6e-9153-481a-afe9-08df80021fd2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.937749] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.937949] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.938081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: /private (37b55a53-a04e-4022-8e22-4b0e89442253) [Read-only file system] [2016-07-07 03:10:09.938381] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.938399] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.938786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.938827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.938841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-1: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.938988] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.939305] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:09.939872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Read-only file system] [2016-07-07 03:10:09.939910] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.940581] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.940848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: /images (fb3789af-852f-4bc7-9c03-296e77bfd8f2) [Read-only file system] [2016-07-07 03:10:09.941119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:d1077060-b55c-463a-a162-0bc5eaf63e5d> (d1077060-b55c-463a-a162-0bc5eaf63e5d) [Input/output error] [2016-07-07 03:10:09.941143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.941227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-1: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.941252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:8cc8181f-e649-445e-9b92-bef0d0ef62d9> (8cc8181f-e649-445e-9b92-bef0d0ef62d9) [Input/output error] [2016-07-07 03:10:09.941293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Invalid argument] [2016-07-07 03:10:09.941323] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.941762] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.941941] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Read-only file system] [2016-07-07 03:10:09.942581] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted]" repeated 2 times between [2016-07-07 03:10:09.942581] and [2016-07-07 03:10:09.943959] [2016-07-07 03:10:09.944682] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.944708] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d1077060-b55c-463a-a162-0bc5eaf63e5d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.944824] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.945675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:ad4c7a2c-fa30-4458-ac35-b8f1466c8d28> (ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:ad4c7a2c-fa30-4458-ac35-b8f1466c8d28> (ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) [Input/output error]" repeated 4 times between [2016-07-07 03:10:09.945675] and [2016-07-07 03:10:09.946225] [2016-07-07 03:10:09.946282] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:09.946282] and [2016-07-07 03:10:09.946365] [2016-07-07 03:10:09.946378] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.946413] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.946449] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.946472] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.946512] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.946552] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.946580] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.946607] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.946627] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:09.946627] and [2016-07-07 03:10:09.946782] [2016-07-07 03:10:09.947085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3c78f4c1-3d9b-447a-859f-66ffd6276dfb> (3c78f4c1-3d9b-447a-859f-66ffd6276dfb) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3c78f4c1-3d9b-447a-859f-66ffd6276dfb> (3c78f4c1-3d9b-447a-859f-66ffd6276dfb) [Input/output error]" repeated 3 times between [2016-07-07 03:10:09.947085] and [2016-07-07 03:10:09.948455] [2016-07-07 03:10:09.948701] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.948727] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.948756] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.948934] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.948953] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949001] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.949023] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949032] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949182] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949201] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949224] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949233] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949242] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.949256] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949264] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949435] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.949453] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949461] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949492] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.949517] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949532] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949701] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949715] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949817] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.949830] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.949914] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.950026] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.950041] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ad4c7a2c-fa30-4458-ac35-b8f1466c8d28) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.950106] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:09.950106] and [2016-07-07 03:10:09.950287] [2016-07-07 03:10:09.950324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.950345] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.950359] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.950417] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.950470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.950502] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.950525] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.950541] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.950559] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:09.950559] and [2016-07-07 03:10:09.950680] [2016-07-07 03:10:09.950728] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.950758] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.950825] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.950947] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.951223] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.951244] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.951516] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:09.951516] and [2016-07-07 03:10:09.951852] [2016-07-07 03:10:09.951943] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.952521] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.953120] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.953146] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.953270] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.953874] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.954384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.954401] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.954626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1548fd18-0f45-4c88-adc0-9fb13374fd1b> (1548fd18-0f45-4c88-adc0-9fb13374fd1b) [Input/output error] [2016-07-07 03:10:09.954714] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.954754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1548fd18-0f45-4c88-adc0-9fb13374fd1b> (1548fd18-0f45-4c88-adc0-9fb13374fd1b) [Input/output error] [2016-07-07 03:10:09.954772] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.954874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:af1b2dcf-2ae2-44f2-8e41-4c310cfb45ce> (af1b2dcf-2ae2-44f2-8e41-4c310cfb45ce) [Input/output error] [2016-07-07 03:10:09.954903] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:09.954903] and [2016-07-07 03:10:09.955612] [2016-07-07 03:10:09.955654] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.955685] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.955890] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.955908] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956091] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956110] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956146] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.956170] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956184] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956242] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956259] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956292] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956306] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956333] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956376] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956391] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956419] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.956491] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.956536] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956550] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(af1b2dcf-2ae2-44f2-8e41-4c310cfb45ce) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956586] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956603] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1548fd18-0f45-4c88-adc0-9fb13374fd1b) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956626] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.956677] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956692] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1548fd18-0f45-4c88-adc0-9fb13374fd1b) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956711] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.956755] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956767] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6057fc4c-dcaf-46c8-a2de-db84f062f1ef) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956898] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.956911] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6057fc4c-dcaf-46c8-a2de-db84f062f1ef) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.956959] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:09.956959] and [2016-07-07 03:10:09.959286] [2016-07-07 03:10:09.959867] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.959892] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.960182] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.962299] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.963452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:fce569c2-64ec-44ff-b298-82b918717c37> (fce569c2-64ec-44ff-b298-82b918717c37) [Input/output error] [2016-07-07 03:10:09.963605] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:09.963925] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.964155] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.965815] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.965844] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.965970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.965985] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.966074] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.966208] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.967842] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:09.968545] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:09.969370] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:09.970181] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.970361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:21ae8d43-34c0-4a76-90fe-47cbae31ce3d> (21ae8d43-34c0-4a76-90fe-47cbae31ce3d) [Input/output error] [2016-07-07 03:10:09.970550] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.970824] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:09.971119] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.971139] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.971666] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.971798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.971983] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.972018] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.972690] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.972714] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.972830] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.972990] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.973011] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.973421] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.973444] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.974460] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:09.974460] and [2016-07-07 03:10:09.976053] [2016-07-07 03:10:09.977786] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.977830] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.978222] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.979875] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:09.980543] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:09.980578] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:09.980814] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.009835] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.010573] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.010606] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d1077060-b55c-463a-a162-0bc5eaf63e5d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.010840] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.013038] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.014306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.014344] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.014547] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.015486] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.015947] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.015979] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.016257] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.016257] and [2016-07-07 03:10:10.017179] [2016-07-07 03:10:10.024137] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.024198] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.027862] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.027905] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.028454] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.028454] and [2016-07-07 03:10:10.029644] [2016-07-07 03:10:10.031088] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.031124] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.031369] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.032135] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.033025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:d8182ff3-c587-4b64-9ce7-4da05a0bf0b2> (d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) [Input/output error] [2016-07-07 03:10:10.033132] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.038940] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.038967] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.039218] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.040274] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.041904] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.041934] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.042320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.043381] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.043992] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.044014] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.044283] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.045293] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.045657] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted]" repeated 2 times between [2016-07-07 03:10:10.045657] and [2016-07-07 03:10:10.045915] [2016-07-07 03:10:10.045999] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.046029] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.046118] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:10.046118] and [2016-07-07 03:10:10.046684] [2016-07-07 03:10:10.047044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:687450fb-cb1d-464c-b82f-d78ef7b9715d> (687450fb-cb1d-464c-b82f-d78ef7b9715d) [Input/output error] [2016-07-07 03:10:10.047418] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.047470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:687450fb-cb1d-464c-b82f-d78ef7b9715d> (687450fb-cb1d-464c-b82f-d78ef7b9715d) [Input/output error] [2016-07-07 03:10:10.047514] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.047562] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.048307] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.048422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:687450fb-cb1d-464c-b82f-d78ef7b9715d> (687450fb-cb1d-464c-b82f-d78ef7b9715d) [Input/output error] [2016-07-07 03:10:10.048817] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:10.048817] and [2016-07-07 03:10:10.049122] [2016-07-07 03:10:10.049378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.049999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.050189] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.050352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.050388] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.050397] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.050531] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.050543] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.050580] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.050623] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.050632] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.050680] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.050689] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.050772] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.050781] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.053579] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.053622] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.053665] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.053712] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.053724] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.053767] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.053859] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.053868] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.055692] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.055928] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.055940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:8b7ee223-e765-47b5-91c1-089f16bb1c31> (8b7ee223-e765-47b5-91c1-089f16bb1c31) [Input/output error] [2016-07-07 03:10:10.057453] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.057497] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.057516] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.057765] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.057866] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.057926] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:10.057960] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.057975] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.058002] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.058024] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.058060] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.058077] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.058093] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.058113] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.058136] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.058243] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.060734] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.060753] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.060950] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.060950] and [2016-07-07 03:10:10.061231] [2016-07-07 03:10:10.061245] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.061265] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.061278] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.061312] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.061335] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.061348] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.061384] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.061434] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.061490] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.061520] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.061589] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:10.061589] and [2016-07-07 03:10:10.062022] [2016-07-07 03:10:10.062790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4> (7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) [Input/output error] [2016-07-07 03:10:10.063198] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.063770] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.064101] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.065709] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.065737] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.065780] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.065790] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.066001] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.066001] and [2016-07-07 03:10:10.066874] [2016-07-07 03:10:10.067373] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.067398] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.067643] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.068790] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.070136] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.070161] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.070520] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.071442] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.072486] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.072508] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.072837] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.073699] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.074310] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.074331] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.074579] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.081707] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.085658] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.085707] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.085978] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:10.085978] and [2016-07-07 03:10:10.090936] [2016-07-07 03:10:10.091125] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.091177] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.091206] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.091226] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.093774] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.093808] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.097920] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.097949] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.102203] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.102232] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.104574] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.106827] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.106855] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.109043] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.109085] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.111135] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.111164] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.113382] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.115720] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.115748] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.117833] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.120110] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.120145] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.120624] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.120643] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.121031] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:10.121031] and [2016-07-07 03:10:10.122574] [2016-07-07 03:10:10.124197] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.124226] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.124347] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.124363] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.124491] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.124491] and [2016-07-07 03:10:10.125514] [2016-07-07 03:10:10.126014] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.126041] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.126295] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:10.126295] and [2016-07-07 03:10:10.128003] [2016-07-07 03:10:10.128169] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.128848] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.129508] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.129542] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.129614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.129680] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.130403] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.130420] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.130478] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.131112] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.131126] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.131175] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.131798] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.131811] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.131847] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.131857] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.131937] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.131955] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.132048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.132087] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.132102] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.132461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.132678] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.132779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.132797] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.132887] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.132934] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.132974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.133011] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.133138] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.133259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:39f3c931-057d-41bb-bc80-d59ccdb77e9e> (39f3c931-057d-41bb-bc80-d59ccdb77e9e) [Input/output error] [2016-07-07 03:10:10.133300] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.133386] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.133436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:41641151-3bc8-4a0c-8fe6-db529aac896f> (41641151-3bc8-4a0c-8fe6-db529aac896f) [Input/output error] [2016-07-07 03:10:10.133467] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.133467] and [2016-07-07 03:10:10.133510] [2016-07-07 03:10:10.133541] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.133566] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.133627] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.134045] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.134098] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.134756] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.134785] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.135392] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.135442] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.135496] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.135527] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.135589] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.135606] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.135653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.135666] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.135961] E [MSGID: 114031] [client-rpc-fops.c:466:client3_3_open_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:41641151-3bc8-4a0c-8fe6-db529aac896f> (41641151-3bc8-4a0c-8fe6-db529aac896f) [Input/output error] [2016-07-07 03:10:10.136000] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.136016] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.136139] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.136155] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.136228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5591358a-515e-43a6-ab24-edb946ee85d2> (5591358a-515e-43a6-ab24-edb946ee85d2) [Input/output error] [2016-07-07 03:10:10.136260] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.136273] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.136427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5591358a-515e-43a6-ab24-edb946ee85d2> (5591358a-515e-43a6-ab24-edb946ee85d2) [Input/output error] [2016-07-07 03:10:10.136550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5591358a-515e-43a6-ab24-edb946ee85d2> (5591358a-515e-43a6-ab24-edb946ee85d2) [Input/output error] [2016-07-07 03:10:10.136583] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:10.136583] and [2016-07-07 03:10:10.136891] [2016-07-07 03:10:10.136965] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.136987] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.137079] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.137100] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(39f3c931-057d-41bb-bc80-d59ccdb77e9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.137668] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.137748] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.137806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:41641151-3bc8-4a0c-8fe6-db529aac896f> (41641151-3bc8-4a0c-8fe6-db529aac896f) [Input/output error] [2016-07-07 03:10:10.137876] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.137905] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5591358a-515e-43a6-ab24-edb946ee85d2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.138025] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.138042] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5591358a-515e-43a6-ab24-edb946ee85d2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.138134] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.138154] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5591358a-515e-43a6-ab24-edb946ee85d2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.138175] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.138391] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.138634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:89f0bfc7-4cf3-4954-ab1a-d2e753b557ab> (89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) [Input/output error] [2016-07-07 03:10:10.138659] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.138774] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.138879] W [MSGID: 114031] [client-rpc-fops.c:1515:client3_3_ftruncate_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.139954] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.140909] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.140926] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.141254] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.142086] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.142673] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.142695] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.142987] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.142987] and [2016-07-07 03:10:10.144579] [2016-07-07 03:10:10.144970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.144994] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.145118] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.145130] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.145268] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.145268] and [2016-07-07 03:10:10.146254] [2016-07-07 03:10:10.147616] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.147643] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.148022] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.148933] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.149447] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.149481] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.149734] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.150683] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.151219] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.151252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.151510] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.152594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.153161] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.153193] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.153498] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.153573] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.154672] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.154707] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.154965] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.157191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.157832] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.157868] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.158170] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.159468] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.160170] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.160203] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.160562] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.161643] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.162877] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.162920] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.163211] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.164260] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.164938] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.164983] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.165369] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:10.165369] and [2016-07-07 03:10:10.183570] [2016-07-07 03:10:10.183971] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.184006] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.184022] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.184030] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.184125] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.184147] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.184222] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.184240] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.184296] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:10.184296] and [2016-07-07 03:10:10.185512] [2016-07-07 03:10:10.186993] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.187020] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.187282] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.188142] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:10.188663] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.188991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:b60444c2-2637-4f07-96cf-2f75a02621a9> (b60444c2-2637-4f07-96cf-2f75a02621a9) [Input/output error] [2016-07-07 03:10:10.189227] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.189246] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.189420] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.189469] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.190054] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.190095] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.190348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.191564] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.192254] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.192285] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.192538] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.193565] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.194970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.195010] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.195269] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.198409] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.198872] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.198903] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.199165] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.200306] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.200968] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.201002] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.201254] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.214820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.216375] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.216420] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.216723] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.217853] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.218460] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.218488] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.218724] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.219149] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.219663] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.219685] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.220053] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.226584] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.228293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.228325] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.228578] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.230085] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.230612] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.230640] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.230871] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:10.230871] and [2016-07-07 03:10:10.233250] [2016-07-07 03:10:10.233419] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.233459] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.233704] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.233704] and [2016-07-07 03:10:10.233853] [2016-07-07 03:10:10.233922] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.233990] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.234086] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.234143] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.234162] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.234325] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.234452] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.234472] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.234494] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.234521] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.234536] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.238444] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.238478] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.238581] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:10.238581] and [2016-07-07 03:10:10.239884] [2016-07-07 03:10:10.241432] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.241477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.241744] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.242716] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.243468] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.243501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.243765] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.245664] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.246255] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.246299] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.246480] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.246579] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.247150] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.247181] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.247531] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.248490] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.250346] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.250373] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.250586] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.251959] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.252487] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.252511] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.252875] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.259318] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.259880] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.259912] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.260208] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.266805] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.268638] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.268677] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.268974] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:10.268974] and [2016-07-07 03:10:10.270607] [2016-07-07 03:10:10.271057] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.271087] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.271185] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.271201] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.271238] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.271254] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.271329] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.271342] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.271575] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:10.271575] and [2016-07-07 03:10:10.272810] [2016-07-07 03:10:10.273644] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.273680] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.273964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.275148] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.276691] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.276726] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.276941] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.278112] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.278742] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.278773] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.279065] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.280411] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.281035] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.281059] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.281340] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.281340] and [2016-07-07 03:10:10.285369] [2016-07-07 03:10:10.287027] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.287067] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.287475] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.287489] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.291851] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.291851] and [2016-07-07 03:10:10.293032] [2016-07-07 03:10:10.294718] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.294756] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.295152] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.296197] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.296912] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.296933] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.297230] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.297230] and [2016-07-07 03:10:10.299328] [2016-07-07 03:10:10.299790] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.299833] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.299908] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.299926] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.300057] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.300057] and [2016-07-07 03:10:10.301358] [2016-07-07 03:10:10.302686] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.302708] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.303021] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.303817] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.304512] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.304533] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.304805] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.305588] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.306333] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.306355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.306592] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.306592] and [2016-07-07 03:10:10.307878] [2016-07-07 03:10:10.308130] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.308165] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.308441] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.308462] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.308502] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.308502] and [2016-07-07 03:10:10.308906] [2016-07-07 03:10:10.309439] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.309488] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.309716] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.310900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.311452] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.311485] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.311807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.312164] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:10.314292] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.315500] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.315793] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.315886] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.317400] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.317597] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.317611] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.317959] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.318819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.319574] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.319594] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.319839] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.320797] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.321532] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.321567] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.321768] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.321768] and [2016-07-07 03:10:10.321860] [2016-07-07 03:10:10.326791] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.326819] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.326926] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.326950] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.327058] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.327058] and [2016-07-07 03:10:10.328045] [2016-07-07 03:10:10.328611] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.328645] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.328907] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.328907] and [2016-07-07 03:10:10.330107] [2016-07-07 03:10:10.331619] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.331645] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.331873] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.331897] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.331973] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.331973] and [2016-07-07 03:10:10.333585] [2016-07-07 03:10:10.334228] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.334279] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.334523] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.335495] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.336117] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.336150] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.336423] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.336423] and [2016-07-07 03:10:10.337839] [2016-07-07 03:10:10.338210] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.338233] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.338336] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.338354] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.338530] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:10.338530] and [2016-07-07 03:10:10.339931] [2016-07-07 03:10:10.342233] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.342266] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.342466] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.342482] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.342721] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.342721] and [2016-07-07 03:10:10.343864] [2016-07-07 03:10:10.344409] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.344433] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.344735] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.345697] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.346293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.346325] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.346402] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.346599] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.346939] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.346964] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.347252] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.348141] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.348718] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.348738] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.349003] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.349003] and [2016-07-07 03:10:10.349930] [2016-07-07 03:10:10.351151] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.351175] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.351257] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.351267] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.351459] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:10.351459] and [2016-07-07 03:10:10.352387] [2016-07-07 03:10:10.353085] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.353121] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.353416] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.354362] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.354955] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.354987] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.355333] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.356317] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.356855] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.356884] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.357120] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.358422] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.359097] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.359129] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.359482] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.360563] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.361877] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.361930] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.362280] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.363262] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.363855] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.363879] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.364140] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.365131] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.365810] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.365841] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.366176] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.367111] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.367805] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.367828] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.368124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.369013] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.369481] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.369503] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.369796] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.370616] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.371359] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.371382] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.371634] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.372441] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.373204] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.373238] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.373520] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.374448] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.374931] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.374962] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.375219] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.376080] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.376657] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.376685] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.377066] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.378028] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.378981] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.379016] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.379261] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.380305] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.380771] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.380792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.381118] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.729656] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.730258] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.730292] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.730541] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.731532] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.732764] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.732789] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.733155] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.734252] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.734866] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.734886] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.735251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.739938] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.742006] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.742062] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.742458] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.743495] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.744227] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.744264] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.744518] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.746287] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.746801] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.746831] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:10.747083] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.999183] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:10.999737] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:10.999768] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.000026] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.002616] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.004221] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.004252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.004512] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.004512] and [2016-07-07 03:10:11.005824] [2016-07-07 03:10:11.006286] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.006311] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.006424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.006437] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.006591] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:11.006591] and [2016-07-07 03:10:11.007666] [2016-07-07 03:10:11.008152] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.008175] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.008342] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.008356] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.008410] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.008410] and [2016-07-07 03:10:11.009445] [2016-07-07 03:10:11.009970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.009993] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.010171] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.018212] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.018780] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.018811] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.019064] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.020095] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.021776] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.021801] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.022064] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.022941] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.023446] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.023478] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.023709] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.025016] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.025641] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.025662] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.025914] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.026851] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.028494] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.028516] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.028747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.029785] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.030502] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.030538] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.030796] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.035532] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.036200] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.036237] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.036488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.037532] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.038745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.038773] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.038991] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.039885] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.040458] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.040490] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.040721] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.045323] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.046156] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.046199] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.046457] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.047580] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.048185] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.048216] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.048463] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.049191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.049700] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.049722] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.049974] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.051631] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.052174] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.052196] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.052406] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.053124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.053771] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.053792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.054130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.054948] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.055440] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.055460] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.055686] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.056423] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.056960] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.056981] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.057196] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.057908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.058442] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.058463] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.058686] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.059491] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.059968] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.059989] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.060232] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.060975] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.061922] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.061956] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.062327] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.063253] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.063827] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.063857] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.064090] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.064781] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.065352] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.065372] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.065634] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.066517] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.067111] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.067132] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.067342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.070155] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.070815] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.070841] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.071088] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.071887] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.072376] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.072397] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.072652] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.073571] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.074067] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.074103] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.074400] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.075522] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.076316] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.076355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.076629] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.077507] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.078105] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.078130] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.078345] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.079440] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.079935] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.079959] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.080194] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.081118] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.082164] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.082187] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.082452] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.083277] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.083888] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.083909] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.084137] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.097324] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.097951] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.097996] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.098296] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.099134] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.100050] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.100074] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.100310] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.101148] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.101641] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.101664] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.101922] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.115388] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.116108] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.116151] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.116544] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.117617] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.118548] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.118586] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.118820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.119836] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.120364] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.120393] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.120628] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.121755] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.122344] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.122387] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.122633] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.123605] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.124347] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.124371] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.124604] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.125556] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.126036] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.126060] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.126293] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.128917] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.129451] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.129475] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.129690] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.130771] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.131759] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.131784] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.132015] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.133006] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.133521] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.133553] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.133816] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.133816] and [2016-07-07 03:10:11.136576] [2016-07-07 03:10:11.136859] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.136910] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.137068] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.137087] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.137169] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.137169] and [2016-07-07 03:10:11.138499] [2016-07-07 03:10:11.139574] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.139600] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.139827] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.140670] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.141175] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.141196] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.141447] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.142318] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.143028] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.143061] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.143120] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.143309] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.143735] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.143762] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.144000] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.145035] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.146222] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.146253] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.146481] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.147279] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.147947] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.147968] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.148256] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.148256] and [2016-07-07 03:10:11.149577] [2016-07-07 03:10:11.149968] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.149993] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.150208] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.150222] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.150264] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.150264] and [2016-07-07 03:10:11.151374] [2016-07-07 03:10:11.152737] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.152776] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.153019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.154123] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.154804] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.154836] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.155199] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.155199] and [2016-07-07 03:10:11.156507] [2016-07-07 03:10:11.157095] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.157140] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.157307] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.157324] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.157478] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.157478] and [2016-07-07 03:10:11.158618] [2016-07-07 03:10:11.159737] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.159776] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.160028] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.160863] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.161374] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.161403] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.161764] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.162787] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:11.163468] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.163949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0a22168c-bcae-4d0a-8330-bdc44d71f0b6> (0a22168c-bcae-4d0a-8330-bdc44d71f0b6) [Input/output error] [2016-07-07 03:10:11.164042] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:11.164098] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.164109] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.164137] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:11.164971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5d0246c4-73db-4f66-8760-e311115245cc> (5d0246c4-73db-4f66-8760-e311115245cc) [Input/output error] [2016-07-07 03:10:11.165513] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.165590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5d0246c4-73db-4f66-8760-e311115245cc> (5d0246c4-73db-4f66-8760-e311115245cc) [Input/output error] [2016-07-07 03:10:11.165614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.165852] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.166563] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.166593] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5d0246c4-73db-4f66-8760-e311115245cc) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.166745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.166761] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5d0246c4-73db-4f66-8760-e311115245cc) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.166845] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:11.166845] and [2016-07-07 03:10:11.167925] [2016-07-07 03:10:11.168920] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.168945] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.169266] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.170271] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.170901] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.170927] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.171157] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.177286] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.177949] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.177978] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.178225] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.179063] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.179872] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.179917] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.180169] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.181150] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.181700] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.181729] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.181974] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.185870] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.186467] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.186506] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.186854] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.187819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.188521] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.188545] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.188788] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.189680] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.190317] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.190338] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.190574] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.217236] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.218197] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.218228] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.218483] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.219499] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.220554] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.220580] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.221015] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.221870] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.222424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.222445] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.222721] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.223961] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.224712] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.224747] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.225011] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.226177] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.226911] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.226944] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.227251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.228253] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.228781] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.228813] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.229114] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.231177] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.231824] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.231852] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.232098] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.232928] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.233912] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.233935] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.234201] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.235125] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.235640] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.235660] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.235899] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.246347] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.247097] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.247127] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.247351] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.248405] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.249391] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.249415] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.249871] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.250797] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.251294] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.251315] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.251600] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.268544] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.269171] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.269219] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.269503] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.270613] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.271391] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.271424] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.271821] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.272697] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.273463] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.273496] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.273856] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.472072] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.472652] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.472682] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b60444c2-2637-4f07-96cf-2f75a02621a9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.472975] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.473787] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.475143] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.475169] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.475472] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.476296] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.476864] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.476885] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.477169] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.712772] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.713471] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.713514] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.713768] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.715069] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.716740] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.716762] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.717016] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.717914] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.718484] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.718504] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.718725] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.719883] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.720493] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.720513] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.720801] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.721642] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.722580] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.722600] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.722924] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.723858] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.724365] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.724383] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.724624] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.739202] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.740333] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.740365] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.740633] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.741853] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.742960] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.742989] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.743240] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.744019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.744651] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.744671] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.744906] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.745979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.746623] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.746642] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.746858] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.747706] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.748324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.748345] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.748612] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.749488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.749993] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.750021] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.750307] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.888226] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.888752] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.888784] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.889070] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.892295] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.893686] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.893710] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.894047] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.894955] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.895573] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.895592] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.895839] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.899870] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.901517] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.901547] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.901808] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.902924] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.903947] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.903968] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.904324] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.905260] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.905771] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.905798] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.906047] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.974123] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.974673] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.974703] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.974980] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.975948] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.976565] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.976585] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.976964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.977942] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.978450] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.978471] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.978713] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.979670] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.980158] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.980178] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.980432] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.981217] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.982217] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.982238] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.982860] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.983745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:11.984263] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:11.984283] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:11.984646] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.002079] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.002736] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.002765] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.003052] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.004075] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.005132] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.005161] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.005411] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.006426] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.006949] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.006977] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.007247] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.010588] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.012247] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.012277] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.012540] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.013381] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.014184] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.014206] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.014552] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.015806] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.016401] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.016426] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.016910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.046253] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.046870] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.046900] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.047139] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.047991] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.049446] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.049470] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.049687] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.050520] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.050978] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.051000] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.051401] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.056627] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.058388] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.058419] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.058683] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.059770] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.060612] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.060641] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.060886] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.061824] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.062356] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.062377] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.062631] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.118511] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.119210] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.119241] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.119677] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.121231] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.122217] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.122248] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.122610] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.123848] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.124322] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.124345] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.124737] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.125647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.126225] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.126252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.126487] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.127384] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.128470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.128494] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.128984] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.129934] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.130419] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.130440] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.130702] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.131768] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.132401] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.132425] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.132786] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.133761] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.134887] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.134907] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.135172] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.136129] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.136596] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.136615] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.136924] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.137712] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.138296] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.138319] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.138548] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.139383] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.140077] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.140098] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.140685] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.141525] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.142012] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.142035] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.142330] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.151348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.152966] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.152999] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.153254] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.154460] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.155614] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.155639] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.155908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.156822] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.157391] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.157412] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.157646] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.158616] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:12.159181] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:12.159739] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.159815] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:12.160432] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:12.161094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:c399a3e5-15e2-4096-964c-fed487127efb> (c399a3e5-15e2-4096-964c-fed487127efb) [Input/output error] [2016-07-07 03:10:12.161211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:c399a3e5-15e2-4096-964c-fed487127efb> (c399a3e5-15e2-4096-964c-fed487127efb) [Input/output error] [2016-07-07 03:10:12.161221] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.161238] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.161350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:c399a3e5-15e2-4096-964c-fed487127efb> (c399a3e5-15e2-4096-964c-fed487127efb) [Input/output error] [2016-07-07 03:10:12.161451] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.161509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:c399a3e5-15e2-4096-964c-fed487127efb> (c399a3e5-15e2-4096-964c-fed487127efb) [Input/output error] [2016-07-07 03:10:12.161527] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:12.161527] and [2016-07-07 03:10:12.162025] [2016-07-07 03:10:12.162489] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.162523] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.162725] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.162743] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.162973] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.162987] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.163217] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.163263] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.163274] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.163320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:12.163320] and [2016-07-07 03:10:12.164653] [2016-07-07 03:10:12.165256] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.165282] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.165638] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:12.165638] and [2016-07-07 03:10:12.167204] [2016-07-07 03:10:12.167259] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.167284] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.167551] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.167809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.167823] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.168170] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.169141] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.170074] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.170096] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.170359] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.171360] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.171871] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.171890] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.172110] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.173180] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.173918] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.173939] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.174149] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.174973] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.175986] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.176007] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.176347] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.177129] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.177667] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.177687] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.177936] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.178965] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.179623] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.179643] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.179873] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.180788] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.181742] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.181765] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.181984] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.182777] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.183254] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.183273] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.183537] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.184698] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.186342] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.186371] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.186980] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.187911] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.189060] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.189080] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.189688] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.190572] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.191052] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.191074] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.191363] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.194334] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.195270] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.195298] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.195572] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.196642] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.197380] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.197401] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.197647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.198428] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.199136] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.199156] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.199495] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.200475] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.201312] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.201333] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.201549] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.202364] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.203302] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.203324] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.203675] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.204460] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.204959] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.204978] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.205205] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.213598] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.214224] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.214269] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.214640] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.215644] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.216340] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.216373] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.216703] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.217744] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.218293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.218315] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.218562] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.219503] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.220225] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.220249] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.220464] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.221364] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.222358] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.222380] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.222926] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.224000] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.224653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.224676] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.224916] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.246215] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.246931] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.246961] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.247199] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.248203] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.249198] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.249220] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.249440] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.250397] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.250935] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.250978] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.251251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.252473] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.253030] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.253061] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.253348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.254448] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.255487] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.255515] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.255798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.256777] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.257295] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.257318] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.257536] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.277153] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.277955] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.277986] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.278244] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.279226] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.280232] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.280257] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.280631] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.281491] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.282168] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.282196] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.282419] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.283386] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.284024] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.284043] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.284282] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.285178] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.286117] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.286141] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.286537] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.287344] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.287869] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.287888] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.288143] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.288998] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.289486] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.289506] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.289768] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.290773] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.291957] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.291980] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.292239] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.293129] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.293641] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.293661] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.293908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.295019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.295609] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.295631] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.295898] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.299214] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.300311] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.300351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.300612] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.301632] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.302199] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.302225] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.302470] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.303509] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.304318] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.304345] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.304723] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.306063] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.307044] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.307076] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.307430] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.308373] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.308881] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.308904] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.309169] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.310099] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.310755] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.310775] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.310986] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.311769] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.312333] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.312351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.312607] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.313510] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.314051] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.314074] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.314296] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.315107] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.316039] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.316057] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.316331] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.317303] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.317810] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.317838] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.318159] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.318953] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.319651] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.319671] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.319894] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.324486] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.325190] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.325214] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.325438] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.326425] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.327412] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.327439] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.327705] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.328672] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.329290] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.329312] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.329497] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.330388] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.330863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.330889] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.331174] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.332263] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.333253] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.333275] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.333621] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.334476] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.335065] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.335086] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.335418] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.336394] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.336890] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.336909] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.337114] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.337908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.338489] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.338515] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.338778] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.339693] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.340278] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.340297] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.340527] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.353096] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.353818] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.353847] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.354191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.355077] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.356333] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.356355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.356717] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.357650] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.358089] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.358118] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.358374] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.359763] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.360537] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.360569] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.360843] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.361895] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.362735] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.362767] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.363159] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.365125] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.365725] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.365750] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.365980] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.474222] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.474932] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.474969] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.475199] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.476540] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.478425] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.478449] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.478819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.479937] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.480431] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.480464] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.480731] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.481824] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.482451] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.482475] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.482722] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.483719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.484766] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.484802] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.485092] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.486063] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.486515] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.486540] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.486788] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.525814] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.526856] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.526890] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.527292] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.528515] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.529717] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.529754] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.530007] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.531030] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.531510] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.531546] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.531929] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.533018] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.533611] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.533632] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.533864] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.534806] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.535746] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.535771] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.536130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.537192] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.537747] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.537777] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.538193] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.539046] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.539541] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.539578] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.539822] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.540648] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.541419] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.541439] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.541733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.542761] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.543335] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.543356] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.543617] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.553584] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.555655] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.555687] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.555927] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.556881] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.557944] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.557967] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.558226] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.559012] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.559594] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.559621] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.559982] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.561079] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.561695] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.561714] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.561957] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.562958] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.563831] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.563851] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.564131] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.565111] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.565580] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.565604] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.565859] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.573234] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.573791] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.573821] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.574068] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.574979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.575610] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.575632] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.575860] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.576645] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.577271] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.577296] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.577558] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.743019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.743659] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.743713] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.743976] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.745141] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.746635] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.746681] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.746952] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.747950] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.748529] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.748560] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.748878] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.754637] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.757374] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.757419] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.757828] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.759002] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.759804] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.759837] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.760127] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.761042] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.761676] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.761708] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.761979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.772442] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.773060] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.773111] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.773376] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.774596] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.775285] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.775316] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.775560] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.776348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.776808] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.776837] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.777221] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.789688] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.792432] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.792465] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.792908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.793911] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.794967] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.794988] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.795249] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.796100] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.796575] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.796599] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.796978] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.814156] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.814730] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.814760] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.815019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.816154] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.817227] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.817251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.817621] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.819086] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.819694] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.819715] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.819956] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.845583] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.848310] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.848342] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.848772] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.849902] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.851134] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.851166] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.851415] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.852363] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.852972] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.852994] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.853244] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.867339] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.867927] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.867970] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.868220] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.869524] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.870414] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.870438] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.870714] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.871615] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.872118] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.872141] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.872547] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.883474] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.886215] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.886243] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.886684] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.887731] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.888714] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.888738] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.889079] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.889819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.890400] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.890421] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.890719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.898512] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.899028] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.899064] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.906587] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.914405] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.915683] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.915729] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.916029] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.917114] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.917634] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.917658] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.917900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.919208] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.920088] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.920125] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.920384] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.921614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.922494] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.922528] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.922951] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.925004] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.926296] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.926393] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.926808] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.935926] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.938363] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.938403] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.942337] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.944489] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.945338] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.945387] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.945811] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.946787] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.947430] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.947469] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.947865] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.949487] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.951269] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.951307] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.951679] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.952747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.953348] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.953378] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.953760] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.955217] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.956052] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.956088] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.958789] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.962866] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.963654] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.963701] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.964065] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.965358] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.966387] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.966424] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.967466] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.969281] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.970465] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.970505] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.971096] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.973204] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.975100] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.975137] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.978541] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.979543] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.980111] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.980133] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.980388] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.981211] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.982195] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.982229] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.982478] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.983864] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.986072] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.986112] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.986413] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.988319] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.989298] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.989323] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.989543] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.990445] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.994709] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:12.994758] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:12.995045] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.997403] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:12.999965] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.000006] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.000366] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.001413] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.002297] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.002322] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.002636] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.003509] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.004044] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.004079] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.004533] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.006404] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.006987] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.007015] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.007279] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.008020] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.008573] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.008594] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.008817] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.009626] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.010130] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.010153] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.010473] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.019869] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.024378] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.024413] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.027120] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.031821] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.032705] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.032734] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.034956] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.041838] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.042473] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.042503] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.044729] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.051616] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.054555] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.054598] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.054962] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.056154] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.060811] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.060842] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.063011] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.065168] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.072027] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.072059] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.074046] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.075044] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.075568] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.075592] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.075964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.077242] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.079752] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.079783] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.082598] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.089795] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.093262] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.093311] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.093595] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.094751] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.095268] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.095292] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.095613] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.096459] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.097690] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.097712] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.099060] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.100403] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.101145] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.101180] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.101426] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.107307] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.111044] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.111079] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.111343] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.114774] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.119477] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.119512] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.121502] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.123032] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.123928] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.123960] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.124144] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.125496] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.126181] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.126212] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.126483] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.127389] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.127863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.127885] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.128123] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.129340] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.131273] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.131312] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.131737] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.132962] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.133621] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.133652] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.133864] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.134613] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.135306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.135336] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.135572] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.136612] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.138296] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.138319] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.138683] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.139466] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.140142] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.140163] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.140511] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.141271] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.141816] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.141856] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.142085] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.146630] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.149180] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.149225] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.149495] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.150497] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.151495] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.151527] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.151783] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.152807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.153355] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.153384] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.153648] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.154531] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.155305] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.155336] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.155702] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.156705] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.157336] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.157365] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.157707] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.158514] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.159098] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.159139] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.159387] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.162446] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.170428] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.170470] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.170727] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.171713] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.172509] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.172541] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.172864] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.173920] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.174517] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.174549] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.174781] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:13.174781] and [2016-07-07 03:10:13.180057] [2016-07-07 03:10:13.180084] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted]" repeated 6 times between [2016-07-07 03:10:13.180084] and [2016-07-07 03:10:13.184041] [2016-07-07 03:10:13.184639] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.184675] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.184800] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.184819] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.184954] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.184968] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.185009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0ee7b966-c933-48d0-b1ac-410de895f126> (0ee7b966-c933-48d0-b1ac-410de895f126) [Input/output error] [2016-07-07 03:10:13.185029] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.185037] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.185092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0ee7b966-c933-48d0-b1ac-410de895f126> (0ee7b966-c933-48d0-b1ac-410de895f126) [Input/output error] [2016-07-07 03:10:13.185127] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.185141] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.185178] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.185188] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.185227] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.185236] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.185305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0ee7b966-c933-48d0-b1ac-410de895f126> (0ee7b966-c933-48d0-b1ac-410de895f126) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0ee7b966-c933-48d0-b1ac-410de895f126> (0ee7b966-c933-48d0-b1ac-410de895f126) [Input/output error]" repeated 2 times between [2016-07-07 03:10:13.185305] and [2016-07-07 03:10:13.185459] [2016-07-07 03:10:13.185474] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.185840] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.185944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0ee7b966-c933-48d0-b1ac-410de895f126> (0ee7b966-c933-48d0-b1ac-410de895f126) [Input/output error] [2016-07-07 03:10:13.186041] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.186107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0ee7b966-c933-48d0-b1ac-410de895f126> (0ee7b966-c933-48d0-b1ac-410de895f126) [Input/output error] [2016-07-07 03:10:13.186135] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 13 times between [2016-07-07 03:10:13.186135] and [2016-07-07 03:10:13.187003] [2016-07-07 03:10:13.187026] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.187047] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.187082] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.187094] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.187099] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.187110] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.187325] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.187357] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.187559] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.187584] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.188048] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.188071] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.188083] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.188102] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.193113] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.193147] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.193183] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.193628] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.193651] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.193753] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.193968] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.193997] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194022] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.194043] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.194068] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.194096] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194207] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.194226] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194294] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.194313] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194348] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.194362] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194380] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.194393] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194407] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.194419] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.194441] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:13.194441] and [2016-07-07 03:10:13.194964] [2016-07-07 03:10:13.195051] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.195083] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.195149] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:13.195149] and [2016-07-07 03:10:13.195252] [2016-07-07 03:10:13.195343] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.195382] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.195462] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:13.195462] and [2016-07-07 03:10:13.195982] [2016-07-07 03:10:13.196033] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.196065] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.196211] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:13.196211] and [2016-07-07 03:10:13.196387] [2016-07-07 03:10:13.196428] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.196459] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.196595] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:13.196595] and [2016-07-07 03:10:13.196710] [2016-07-07 03:10:13.196747] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.196775] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.196908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:13.196908] and [2016-07-07 03:10:13.196993] [2016-07-07 03:10:13.197028] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.197055] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.197105] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.197137] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.197145] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.197164] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.197189] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.197201] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.197372] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:13.197372] and [2016-07-07 03:10:13.198566] [2016-07-07 03:10:13.202666] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.202710] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.202770] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.202817] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.202831] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.202860] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.202874] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.202916] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.202940] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.203018] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.203034] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.203180] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.203197] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.203471] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:13.203471] and [2016-07-07 03:10:13.204996] [2016-07-07 03:10:13.205590] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.205624] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.205899] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.207026] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.207869] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.207897] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.208248] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.209276] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.209781] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.209813] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.210070] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.211977] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.212965] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.212998] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.213323] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.214364] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.214922] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.214955] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.215257] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.216261] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.216809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.216831] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.217052] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.221004] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.221562] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.221593] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.221829] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.223229] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.224011] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.224036] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.224371] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.225333] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.226037] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.226069] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.226438] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.227915] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.228719] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.228752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.228940] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.229800] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.230513] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.230549] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.230768] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.231852] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.232400] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.232434] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.232788] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.261263] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.261975] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.262029] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.262275] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.263118] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.264146] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.264168] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.264426] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.265163] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.265682] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.265702] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.265942] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.269074] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.270725] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.270751] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.270961] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.274067] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.274835] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.274871] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.275108] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.276028] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.276571] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.276593] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.276783] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.281749] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.282395] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.282436] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.282842] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.284019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.284735] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.284770] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.285018] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.286160] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.286871] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.286905] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.287137] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.296299] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.299873] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.299907] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.300236] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.301235] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.302232] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.302262] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.302568] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.303561] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.304080] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.304122] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.304486] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.319181] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.319964] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.319996] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.320394] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.321470] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.322142] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.322175] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.322500] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.323633] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.324454] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.324477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.324723] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.330637] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.333180] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.333218] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.333818] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.334778] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.335499] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.335535] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.335805] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.336681] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.337561] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.337603] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.337820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.468158] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.468754] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.468784] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.468994] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.473769] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.474337] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.474365] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.474590] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.475556] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.476930] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.476956] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.477180] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.478512] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.479086] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.479111] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.479366] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.483032] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.484500] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.484528] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.484759] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.485669] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.486864] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.486895] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.487149] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.488329] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.488826] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.488854] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.489042] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.538768] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.539290] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.539330] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.539659] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.540983] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.542121] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.542156] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.542406] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.543401] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.544008] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.544030] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.544247] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.547730] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.549532] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.549578] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.549849] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.550979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.551763] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.551796] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.554607] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.555782] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:13.556361] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:13.556395] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:13.556726] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.090830] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.091480] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.091520] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.091772] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.092879] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.094223] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.094251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.094564] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.095859] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.096517] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.096542] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.096902] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.098499] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.101664] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.101702] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.101999] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.103044] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.104000] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.104035] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.104326] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.105301] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.105912] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.105941] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.106195] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.107538] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.109572] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.109609] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.109924] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.111205] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.111889] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.111919] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.112212] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.113251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.113929] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.113960] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.114356] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.115287] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.116149] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.116183] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.116508] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.117731] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.118684] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.118718] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.119015] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.120211] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.120885] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.120913] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.121144] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.123476] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.126629] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.126666] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.126961] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.129455] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.130425] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.130456] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.130780] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.131918] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.132477] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.132505] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.132798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.134101] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.136283] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.136322] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.136588] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.137563] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.138281] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.138316] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.138562] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.139517] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.140221] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.140252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.140521] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.155753] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.165304] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.165351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.165984] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.167410] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.168101] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.168131] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.168383] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.169277] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.170019] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.170056] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.170306] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.173950] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.174983] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.175066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:46f26449-4d79-4456-a0f8-1dcda3b3fcfb> (46f26449-4d79-4456-a0f8-1dcda3b3fcfb) [Input/output error] [2016-07-07 03:10:14.175277] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 14 times between [2016-07-07 03:10:14.175277] and [2016-07-07 03:10:14.180197] [2016-07-07 03:10:14.181089] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181129] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181145] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181156] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181172] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181193] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181371] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.181425] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181440] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181455] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181466] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181479] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181490] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181506] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181520] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181543] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181554] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181623] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181638] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181663] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181675] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181685] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181698] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181708] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181721] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181731] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181782] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.181824] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181837] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181909] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181925] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.181984] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.181998] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.182012] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:14.182012] and [2016-07-07 03:10:14.182209] [2016-07-07 03:10:14.182303] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.182331] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.182360] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 18 times between [2016-07-07 03:10:14.182360] and [2016-07-07 03:10:14.184623] [2016-07-07 03:10:14.184718] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.184752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.184766] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.184820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.184866] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.184886] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.184910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.185165] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.185181] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.185230] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.185230] and [2016-07-07 03:10:14.187149] [2016-07-07 03:10:14.187365] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187395] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187420] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.187501] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187517] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187531] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.187582] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187601] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187621] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187643] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187671] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187687] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187703] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187715] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187730] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187741] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187757] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187770] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187919] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187936] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.187984] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.187997] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.188054] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.188067] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.188186] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.188264] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.188280] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.188335] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.188353] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.188402] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:14.188402] and [2016-07-07 03:10:14.190345] [2016-07-07 03:10:14.191131] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.191170] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.191484] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.192609] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.193205] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.193237] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.193472] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.237199] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.237867] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.237919] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.238155] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.479511] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.480289] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.480326] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.480611] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.481805] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.483447] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.483482] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.483752] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.484736] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.485341] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.485383] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.485637] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.488806] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.490236] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.490270] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.490537] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.491739] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.492579] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.492608] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.492866] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.493905] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.494730] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.494763] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.495068] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.516167] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.516801] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.516831] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.517070] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.518181] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.519009] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.519033] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.519284] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.520193] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.520797] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.520818] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.521052] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.524338] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.525958] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.525983] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.526273] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.528577] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.529731] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.529763] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.530013] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.531098] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.531819] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.531849] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.532120] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.574107] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.574739] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.574766] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.575150] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.576185] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.577186] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.577222] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.577592] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.578538] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.579240] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.579270] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.579548] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.583719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.585621] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.585652] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.585944] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.586951] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.587590] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.587611] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.587895] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.588794] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.589420] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.589450] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.589663] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.618112] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.618749] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.618792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.619211] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.621397] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.622508] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.622555] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.622807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.623800] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.624473] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.624504] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.624769] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.625835] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.626412] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.626444] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.626674] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.627757] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.628424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.628457] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.628725] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.629863] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.630413] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.630452] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.630712] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.631734] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.632422] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.632454] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.632800] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.636117] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.636736] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.636781] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.637018] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.637928] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.638653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.638686] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.638910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.640475] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.643095] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.643140] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.643397] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.644427] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.645151] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.645182] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.645570] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.646839] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.647417] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.647451] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.647836] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.649245] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.651019] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.651055] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.651414] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.652712] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.653595] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.653628] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.653922] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.654932] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.655515] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.655539] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.655869] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.668671] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.669301] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.669343] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.669614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.670677] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.671369] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.671401] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.671661] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.672563] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.673194] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.673226] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.673626] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.678047] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.680019] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.680071] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.680355] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.681506] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.682152] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.682185] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.682486] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.683755] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.684461] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.684498] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.684890] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.723401] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.724183] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.724229] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.724508] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.725599] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.726347] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.726383] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.726642] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.727626] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.728324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.728362] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.728629] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.732831] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.733561] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.733618] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.734023] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.735020] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.735698] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.735730] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.736148] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.737031] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.737564] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.737593] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.737966] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.739351] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.741190] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.741229] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.741493] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.758411] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.759236] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.759281] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.759687] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.760770] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.761674] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.761705] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.761986] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.763003] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.763552] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.763582] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.763909] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.768360] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.770270] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.770318] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.770709] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.771962] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.772688] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.772718] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.772961] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.773910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.774495] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.774528] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.774893] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.774893] and [2016-07-07 03:10:14.786139] [2016-07-07 03:10:14.791158] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.791218] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.794011] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.800644] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.800672] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.800796] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.800813] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.801248] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.801424] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.801818] E [MSGID: 114031] [client-rpc-fops.c:972:client3_3_flush_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.802714] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.803840] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.803856] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.804226] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.805181] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.805791] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.805811] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.806053] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.808021] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.808757] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.808793] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.808866] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:14.808866] and [2016-07-07 03:10:14.810676] [2016-07-07 03:10:14.810713] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.810737] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.810910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.810977] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.810997] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811038] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.811069] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.811099] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.811113] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811197] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.811220] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811288] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.811342] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.811359] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811425] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.811511] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.811530] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.811679] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.811696] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811752] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.811800] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.811815] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.811871] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.811871] and [2016-07-07 03:10:14.812204] [2016-07-07 03:10:14.812272] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.812297] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.812431] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.812453] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.812676] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.812779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.812798] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.812864] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.812972] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.813037] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.813059] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.813281] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.813364] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.813386] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.813488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.813562] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.813582] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.813646] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.813729] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.813746] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.813779] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.813982] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.814082] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.814099] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.814181] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.814353] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.814374] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.814505] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:14.814505] and [2016-07-07 03:10:14.815145] [2016-07-07 03:10:14.815191] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.815223] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.815285] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.815338] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.815355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.815411] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:14.815411] and [2016-07-07 03:10:14.816418] [2016-07-07 03:10:14.817736] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.817769] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818038] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818058] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818127] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818142] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818222] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818239] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818307] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818329] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818399] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818414] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818482] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818496] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818561] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.818626] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818640] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818707] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.818773] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818788] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818854] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818869] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.818929] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.818944] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.819006] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.819076] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.819279] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.819308] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.819366] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.819449] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.819531] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.819562] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.819617] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:14.819617] and [2016-07-07 03:10:14.820333] [2016-07-07 03:10:14.820349] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.820396] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.820448] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.820459] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.820506] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.820549] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.820582] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.820602] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.820694] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.820757] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.820781] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.820798] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.820838] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:14.820838] and [2016-07-07 03:10:14.821613] [2016-07-07 03:10:14.821702] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.821723] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.821771] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:14.821771] and [2016-07-07 03:10:14.822060] [2016-07-07 03:10:14.822155] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.822180] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.822299] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.822342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.822364] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.822378] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.822408] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.822438] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.822447] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.822459] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.822470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.822476] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.822485] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.822555] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.822565] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.822577] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.822584] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.822595] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:14.822595] and [2016-07-07 03:10:14.826729] [2016-07-07 03:10:14.830846] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.830877] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.830994] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.831010] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.831057] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:14.831057] and [2016-07-07 03:10:14.831212] [2016-07-07 03:10:14.831292] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.831323] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.831348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.831418] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.831432] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.831508] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.831533] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.831544] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.831733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.831783] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.831803] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.831859] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.831859] and [2016-07-07 03:10:14.832096] [2016-07-07 03:10:14.832862] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.832884] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.833113] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.833355] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.833389] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.833406] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.833453] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.833542] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.833632] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.833659] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.833723] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.833820] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.833834] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.833900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.833979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.834020] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834040] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.834101] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.834148] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834163] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.834226] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.834271] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834282] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.834327] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834341] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.834385] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.834423] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834432] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.834472] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.834514] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834524] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.834579] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:14.834579] and [2016-07-07 03:10:14.834776] [2016-07-07 03:10:14.834862] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.834882] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.835002] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:14.835002] and [2016-07-07 03:10:14.835603] [2016-07-07 03:10:14.835671] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.836233] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.836820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.836906] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.836927] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.836993] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.837552] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.837634] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.837648] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.837774] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.838466] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.838482] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.838526] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.839116] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.839135] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.839224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:efc7b5df-b7bb-4394-9f34-336062e72315> (efc7b5df-b7bb-4394-9f34-336062e72315) [Input/output error] [2016-07-07 03:10:14.839308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7ab0b975-ab2e-4596-abba-28bd31f7397d> (7ab0b975-ab2e-4596-abba-28bd31f7397d) [Input/output error] [2016-07-07 03:10:14.839340] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.839503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7ab0b975-ab2e-4596-abba-28bd31f7397d> (7ab0b975-ab2e-4596-abba-28bd31f7397d) [Input/output error] [2016-07-07 03:10:14.839570] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.839570] and [2016-07-07 03:10:14.839798] [2016-07-07 03:10:14.839950] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.839978] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(8cc8181f-e649-445e-9b92-bef0d0ef62d9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.840077] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.840174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:7d77d958-fca2-47ac-bcb7-063859d4f382> (7d77d958-fca2-47ac-bcb7-063859d4f382) [Input/output error] [2016-07-07 03:10:14.840205] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:14.840205] and [2016-07-07 03:10:14.840276] [2016-07-07 03:10:14.840316] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5975a5cc-c0cf-4d91-b375-1321b25fb5a4> (5975a5cc-c0cf-4d91-b375-1321b25fb5a4) [Input/output error] [2016-07-07 03:10:14.840354] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.840738] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.840784] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.842304] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.843485] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.843494] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.843510] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.843637] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.843661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:202ec536-8988-4d8c-91ae-a20609adb22c> (202ec536-8988-4d8c-91ae-a20609adb22c) [Input/output error] [2016-07-07 03:10:14.844719] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.844733] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.846209] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.846221] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846237] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.846259] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846275] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.846356] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.846368] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7ab0b975-ab2e-4596-abba-28bd31f7397d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.846397] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(efc7b5df-b7bb-4394-9f34-336062e72315) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846632] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.846650] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7ab0b975-ab2e-4596-abba-28bd31f7397d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846668] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.846682] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7d77d958-fca2-47ac-bcb7-063859d4f382) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.846956] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:14.846956] and [2016-07-07 03:10:14.847500] [2016-07-07 03:10:14.847525] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.847550] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5591358a-515e-43a6-ab24-edb946ee85d2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.847608] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.847626] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(202ec536-8988-4d8c-91ae-a20609adb22c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.848050] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:14.848050] and [2016-07-07 03:10:14.849554] [2016-07-07 03:10:14.850355] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.850378] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.850593] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.851724] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.852303] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.852321] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.852538] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.853645] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.854154] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.854178] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.854419] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.855442] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.856065] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.856083] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.856329] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.861200] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.861800] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.861822] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.862023] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.863304] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.865902] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.865926] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.866147] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.867862] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.868559] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.868583] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.868791] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.869647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.870334] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.870353] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.870593] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.870593] and [2016-07-07 03:10:14.877545] [2016-07-07 03:10:14.877900] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.877937] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.880386] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.889894] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.889921] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.891944] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.891967] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.892695] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.892852] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.893207] E [MSGID: 114031] [client-rpc-fops.c:972:client3_3_flush_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.893998] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.894688] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.894708] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.894989] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.895815] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.896430] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.896450] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.896681] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:14.896681] and [2016-07-07 03:10:14.900139] [2016-07-07 03:10:14.900896] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.900925] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.900961] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.900971] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901014] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.901166] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901180] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901216] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901231] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901281] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901292] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901341] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901394] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901423] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901432] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901480] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901490] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901523] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.901630] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.901671] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.901686] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.901730] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 14 times between [2016-07-07 03:10:14.901730] and [2016-07-07 03:10:14.908415] [2016-07-07 03:10:14.908426] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.908453] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909354] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.909379] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909402] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.909416] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909502] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.909528] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909551] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.909565] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909583] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.909596] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909613] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.909625] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.909988] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:14.909988] and [2016-07-07 03:10:14.910532] [2016-07-07 03:10:14.910582] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.910638] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.910778] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.910790] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.910801] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:14.910801] and [2016-07-07 03:10:14.914597] [2016-07-07 03:10:14.914698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:6f16a550-4fa8-466b-8c81-b28615d99509> (6f16a550-4fa8-466b-8c81-b28615d99509) [Input/output error] [2016-07-07 03:10:14.915677] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.915700] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.915709] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.915718] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.915725] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.916582] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.916598] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.916811] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.916820] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.918825] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.918890] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.918906] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.918953] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.919084] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.919106] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.919170] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.919226] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:14.919910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:14.919910] and [2016-07-07 03:10:14.920143] [2016-07-07 03:10:14.920163] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.920193] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.920249] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.920298] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.920344] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.920369] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.920442] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.920509] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.920527] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.920591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.920609] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.920715] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.920733] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.920799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:282fdace-df6f-4af9-8318-d4f17a33dae6> (282fdace-df6f-4af9-8318-d4f17a33dae6) [Input/output error] [2016-07-07 03:10:14.920884] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.920994] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.920999] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.921013] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.921038] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:14.921038] and [2016-07-07 03:10:14.921116] [2016-07-07 03:10:14.921163] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.921178] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.921575] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.922027] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.922327] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.922347] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(282fdace-df6f-4af9-8318-d4f17a33dae6) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.922534] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.923598] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.924200] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.924224] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.924464] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.925220] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.925846] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.925868] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.926219] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.927843] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.929012] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.929032] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.929378] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.930699] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.931463] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.931485] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.931672] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.932494] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.933144] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.933164] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.933430] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:14.933430] and [2016-07-07 03:10:14.934558] [2016-07-07 03:10:14.935188] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.935214] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.935306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.935323] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.935347] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.935361] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.935449] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.935465] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.935648] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:14.935648] and [2016-07-07 03:10:14.936825] [2016-07-07 03:10:14.937464] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.937486] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.937740] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.938621] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.939255] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.939277] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.939463] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.940346] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.940842] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.940862] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.941111] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.941961] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.942695] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.942717] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.942900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.943688] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.944343] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.944369] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.944589] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.985619] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.986101] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.986134] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.986375] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.987375] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.988376] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.988412] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.988856] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.989893] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.990505] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.990537] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.990913] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.996719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:14.999434] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:14.999476] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:14.999729] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.000726] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.001429] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.001454] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.001809] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.002652] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.003194] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.003220] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.003455] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.034104] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.034665] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.034695] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.034906] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.035731] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.036728] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.036752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.037056] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.037887] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.038387] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.038408] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.038636] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:15.038636] and [2016-07-07 03:10:15.051654] [2016-07-07 03:10:15.060570] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.060606] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.065649] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.065665] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.067235] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.068037] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.068058] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.068106] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.068342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.068736] E [MSGID: 114031] [client-rpc-fops.c:972:client3_3_flush_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:15.069323] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.070064] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.070079] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.070285] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.071144] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.071638] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.071657] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.071908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:15.071908] and [2016-07-07 03:10:15.075016] [2016-07-07 03:10:15.075560] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:15.076085] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076098] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076354] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076370] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076392] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076405] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076480] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.076540] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076555] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076613] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076629] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076679] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.076732] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076747] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076762] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.076812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:5ca516cc-c387-4302-b4d8-baa055a40404> (5ca516cc-c387-4302-b4d8-baa055a40404) [Input/output error] [2016-07-07 03:10:15.076863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.076878] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.076964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.076992] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.077001] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.077012] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.077019] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.077032] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.077038] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.077048] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.077059] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.077069] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.077080] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.077179] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.077195] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.077419] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:15.077419] and [2016-07-07 03:10:15.077718] [2016-07-07 03:10:15.077745] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:15.078043] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:15.078043] and [2016-07-07 03:10:15.078403] [2016-07-07 03:10:15.078428] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.078448] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.078528] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.078551] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.078559] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.078569] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.078576] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.079178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:3020a0cc-c491-4f90-b367-c424a8a8a7e2> (3020a0cc-c491-4f90-b367-c424a8a8a7e2) [Input/output error] [2016-07-07 03:10:15.079328] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 16 times between [2016-07-07 03:10:15.079328] and [2016-07-07 03:10:15.081331] [2016-07-07 03:10:15.082250] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082274] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(efc7b5df-b7bb-4394-9f34-336062e72315) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082285] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082293] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082330] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082344] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(efc7b5df-b7bb-4394-9f34-336062e72315) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082588] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082597] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082608] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.082618] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082625] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082633] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082639] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:15.082647] and [2016-07-07 03:10:15.082684] [2016-07-07 03:10:15.082739] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082762] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082780] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3020a0cc-c491-4f90-b367-c424a8a8a7e2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082817] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082839] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082858] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082867] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082895] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082912] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.082924] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.082935] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.082945] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.083007] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.083044] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.083055] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.083094] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.083131] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.083143] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.083476] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:15.083476] and [2016-07-07 03:10:15.083794] [2016-07-07 03:10:15.083833] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.083877] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.083974] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.084105] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.084189] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.084216] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.084283] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.084344] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.084388] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.084420] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.084441] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 15 times between [2016-07-07 03:10:15.084441] and [2016-07-07 03:10:15.086174] [2016-07-07 03:10:15.086474] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.086514] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.087221] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:15.087221] and [2016-07-07 03:10:15.088147] [2016-07-07 03:10:15.088178] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.088209] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.088385] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.088399] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.088460] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.088482] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.088551] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.088568] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.088797] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.088817] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.088900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.089275] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.089308] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.089336] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.089393] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.089449] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.089465] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.089523] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.089546] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.089604] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.089693] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.089722] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.089747] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.089807] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.089824] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.089899] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.089941] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.089957] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5591358a-515e-43a6-ab24-edb946ee85d2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.090001] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.090027] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.090036] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5591358a-515e-43a6-ab24-edb946ee85d2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.090067] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.090076] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(5d0246c4-73db-4f66-8760-e311115245cc) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.090108] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.090117] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(39f3c931-057d-41bb-bc80-d59ccdb77e9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.090147] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:15.090147] and [2016-07-07 03:10:15.094146] [2016-07-07 03:10:15.100585] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.100626] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.100790] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.100817] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.101024] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.101045] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.101113] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.101130] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.101195] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:15.101195] and [2016-07-07 03:10:15.101385] [2016-07-07 03:10:15.101735] E [MSGID: 114031] [client-rpc-fops.c:972:client3_3_flush_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:15.102801] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.103430] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.103452] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.103874] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.104599] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.105182] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.105203] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.105424] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.107771] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.112354] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.112391] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.112652] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.113820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.114573] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.114614] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.114830] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.115727] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.116452] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.116485] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.116846] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:15.116846] and [2016-07-07 03:10:15.118389] [2016-07-07 03:10:15.122474] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.122517] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.122609] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.122626] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.122666] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.122686] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.122814] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:15.122814] and [2016-07-07 03:10:15.124172] [2016-07-07 03:10:15.125100] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.125133] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.125450] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.126433] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.127087] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.127119] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.127361] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:15.127361] and [2016-07-07 03:10:15.129055] [2016-07-07 03:10:15.131555] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.131578] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.131719] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.131729] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.131951] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:15.131951] and [2016-07-07 03:10:15.133087] [2016-07-07 03:10:15.133787] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.133820] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.134128] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.134978] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.135467] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.135485] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.135841] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.154205] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.154956] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.154997] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.155297] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.156278] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.157224] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.157256] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.157902] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.158934] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.159579] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.159611] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.159994] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.161582] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.164115] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.164139] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.164370] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.165141] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.166031] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.166053] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.166373] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.167238] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.167857] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.167879] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.168214] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:15.168214] and [2016-07-07 03:10:15.169609] [2016-07-07 03:10:15.171739] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.171779] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.171979] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.171995] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.172049] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.172070] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.172115] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.172130] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.172184] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.172198] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.172251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:15.172251] and [2016-07-07 03:10:15.173570] [2016-07-07 03:10:15.174172] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.174208] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.174570] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.175751] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.176401] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.176432] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.176680] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.201658] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.202237] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.202267] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.202568] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.203481] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.204442] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.204463] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.204845] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.205766] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.206444] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.206464] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.206681] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.212300] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.215057] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.215087] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.215337] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.216275] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.217286] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.217309] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.217542] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.218607] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.219394] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.219417] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.219680] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.220717] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.221364] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.221386] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.221628] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.222997] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.223501] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.223522] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.223784] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.224529] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.225061] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.225083] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.225310] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.226314] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.228043] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.228064] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.228342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.229221] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.229866] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.229898] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.230104] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.230922] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.231541] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.231563] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.231766] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.232950] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.234903] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.234926] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.235154] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.236010] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.236726] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.236752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.237084] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.237896] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.238681] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.238700] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.238878] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.239887] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.240364] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.240383] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.240918] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.241746] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.242333] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.242352] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.242555] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.243322] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.243969] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.243993] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.244331] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.246324] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.248387] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.248407] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.248745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.249616] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.250551] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.250576] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.250802] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.251560] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.252230] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.252248] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.252492] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.253696] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.255591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.255624] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.256059] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.256835] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.257406] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.257425] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.257609] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.258706] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.259329] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.259348] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.259681] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.329034] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.329722] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.329752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.330001] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.330954] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.331986] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.332004] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.332275] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.333051] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.333782] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.333801] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.334006] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.341982] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.344729] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.344751] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.345127] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.346167] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.346704] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.346729] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.347108] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.348107] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.348786] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.348805] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.349178] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.398577] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.399283] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.399320] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.399734] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.400755] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.401811] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.401836] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.402114] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.402976] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.403452] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.403470] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.403719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.409254] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.412591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.412622] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.413016] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.414290] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.415223] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.415243] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(a0aefa82-933d-4e7e-b5b6-aa4655f60a08) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.415603] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.416251] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:15.450069] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.450722] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.450740] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.450961] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.459804] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.461575] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.461604] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.462119] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.466545] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.468340] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.468364] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.468630] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.481619] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.482306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.482335] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.482577] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.491643] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.494414] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.494448] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.494700] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.543929] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.544829] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.544860] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.545118] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.553809] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.556632] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.556660] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.556927] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.567895] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.568702] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.568733] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.569002] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.577130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:15.579923] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:15.579952] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:15.580526] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.069325] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.070112] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.070140] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.070344] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.077330] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.079262] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.079284] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.079567] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.156599] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.160771] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.160801] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.161033] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.165821] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.170271] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.170308] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.170598] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.256662] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.257552] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.257582] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.257909] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.299014] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.299745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.299775] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.300092] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.309571] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.312462] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.312487] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.313042] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.340685] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.341484] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.341513] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.341745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.349266] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.350027] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.350053] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.350342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.359172] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.362109] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.362144] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.362398] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.366604] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.367426] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.367449] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.367674] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.374765] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:16.376736] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:16.376766] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:16.377426] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.156225] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.157193] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.157231] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.157639] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.162809] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.166659] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.166688] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.166914] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.171304] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.175409] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.175435] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.175921] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.316200] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.317160] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.317190] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.317402] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.329084] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.331912] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.331937] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.332579] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.347339] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.348124] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.348153] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.348348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.360043] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.362878] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.362907] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.363166] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.921427] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.922786] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.922831] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.923340] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.957602] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:17.958162] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:17.958732] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.958815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:6b5f8c30-040b-4905-aa96-47348e9f8be9> (6b5f8c30-040b-4905-aa96-47348e9f8be9) [Input/output error] [2016-07-07 03:10:17.959028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:eabb92a4-ee57-404c-8d39-7f41ee535d9a> (eabb92a4-ee57-404c-8d39-7f41ee535d9a) [Input/output error] [2016-07-07 03:10:17.959075] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.962396] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.962495] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.962519] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.963776] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:17.964065] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.964076] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.964458] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:17.964474] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(eabb92a4-ee57-404c-8d39-7f41ee535d9a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:17.964603] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:17.964603] and [2016-07-07 03:10:18.035531] [2016-07-07 03:10:18.036285] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.036317] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.036384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.036394] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.036835] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:18.036835] and [2016-07-07 03:10:18.119941] [2016-07-07 03:10:18.120183] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120218] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120429] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120446] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120496] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120507] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120559] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120576] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120617] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120627] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120671] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120685] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120740] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120794] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120806] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.120850] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.120968] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.120980] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.121031] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.121044] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.121093] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.121160] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.121172] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.121230] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 9 times between [2016-07-07 03:10:18.121230] and [2016-07-07 03:10:18.156185] [2016-07-07 03:10:18.156961] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.156990] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.157238] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.162195] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.163072] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.163099] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.163359] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.163359] and [2016-07-07 03:10:18.167604] [2016-07-07 03:10:18.170334] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.170365] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(eabb92a4-ee57-404c-8d39-7f41ee535d9a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.171624] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.171637] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.171723] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.171723] and [2016-07-07 03:10:18.175211] [2016-07-07 03:10:18.176032] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.176057] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.176320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.176971] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.177893] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.177921] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.178133] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.179164] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.183374] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.183397] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.183891] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.184738] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.185825] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.185848] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.186068] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.188910] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.189921] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.189942] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.190166] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.193138] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.194205] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.194226] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.194457] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.194501] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.195100] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.195118] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.195354] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.195354] and [2016-07-07 03:10:18.200422] [2016-07-07 03:10:18.200671] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.200710] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.200875] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.201062] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.201211] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.201231] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.201452] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.201609] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.201624] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.201837] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.205590] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.206462] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.206482] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.206733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.206733] and [2016-07-07 03:10:18.207815] [2016-07-07 03:10:18.208450] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.208473] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.208628] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.208644] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.208886] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.208886] and [2016-07-07 03:10:18.211108] [2016-07-07 03:10:18.212057] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.212084] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.212276] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.212276] and [2016-07-07 03:10:18.215708] [2016-07-07 03:10:18.215857] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.215880] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.216166] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.216401] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.216415] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.216604] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.216604] and [2016-07-07 03:10:18.221739] [2016-07-07 03:10:18.222381] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.222403] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.222590] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.222604] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.222684] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.222684] and [2016-07-07 03:10:18.223552] [2016-07-07 03:10:18.224638] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.224661] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.225057] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.229389] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.230384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.230409] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.230674] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.231238] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.231928] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.231948] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.232259] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.232962] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.233988] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.234009] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.234325] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.234325] and [2016-07-07 03:10:18.237750] [2016-07-07 03:10:18.238054] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.238077] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.238463] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.238477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.238518] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.238518] and [2016-07-07 03:10:18.242379] [2016-07-07 03:10:18.243075] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.243099] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.243616] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.250252] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.251042] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.251067] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.251312] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.251312] and [2016-07-07 03:10:18.252240] [2016-07-07 03:10:18.252770] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.252792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.252888] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.252902] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.253131] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:18.253131] and [2016-07-07 03:10:18.254181] [2016-07-07 03:10:18.254822] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.254847] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.254917] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.254933] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.255163] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.255163] and [2016-07-07 03:10:18.257147] [2016-07-07 03:10:18.257809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.257830] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.258187] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.258187] and [2016-07-07 03:10:18.259957] [2016-07-07 03:10:18.260193] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.260214] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.260536] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.260648] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.260662] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.260995] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.261805] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.262673] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.262693] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.262935] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:18.262935] and [2016-07-07 03:10:18.266468] [2016-07-07 03:10:18.266916] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.266940] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.267067] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.267084] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.267161] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.267171] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.267261] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:18.267261] and [2016-07-07 03:10:18.271043] [2016-07-07 03:10:18.271749] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.271774] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.271996] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.271996] and [2016-07-07 03:10:18.273471] [2016-07-07 03:10:18.274048] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.274076] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.274229] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.274241] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.274333] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.274333] and [2016-07-07 03:10:18.275819] [2016-07-07 03:10:18.276370] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.276391] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.276575] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:18.276575] and [2016-07-07 03:10:18.280650] [2016-07-07 03:10:18.281145] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.281170] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.281434] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.281449] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.281582] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.281640] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.281652] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.281785] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.281785] and [2016-07-07 03:10:18.284974] [2016-07-07 03:10:18.285729] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.285751] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.285993] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.285993] and [2016-07-07 03:10:18.287877] [2016-07-07 03:10:18.288603] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.288626] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.288756] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.288773] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.288874] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.288874] and [2016-07-07 03:10:18.289827] [2016-07-07 03:10:18.290466] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.290489] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.290746] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.290746] and [2016-07-07 03:10:18.295547] [2016-07-07 03:10:18.295680] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.295703] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.295966] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.296124] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.296141] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.296460] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.300964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.301857] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.301885] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.302213] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.302307] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.302813] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.302833] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.303152] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.307024] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.307903] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.307922] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.308125] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.309900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.310917] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.310937] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.311161] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.312348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.313240] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.313259] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.313517] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.317685] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.318426] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.318449] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.318599] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.318697] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.319407] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.319431] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.319764] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.319764] and [2016-07-07 03:10:18.325182] [2016-07-07 03:10:18.325934] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.325957] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.325987] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.325996] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.326234] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.326234] and [2016-07-07 03:10:18.331068] [2016-07-07 03:10:18.331807] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.331829] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.331858] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.332097] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.332564] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.332582] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.332837] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.337332] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.338034] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.338054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.338324] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.339366] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.340445] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.340468] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.340737] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.342521] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.343303] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.343322] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.343671] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.346504] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.347130] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.347152] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.347348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.347401] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.347879] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.347897] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.348257] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.352414] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.353087] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.353109] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.353331] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.353381] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.353969] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.353991] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.354257] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.357154] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.357811] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.357836] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.358130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.361650] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.362745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.362765] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.363185] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.363237] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.363890] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.363909] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.364220] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.364220] and [2016-07-07 03:10:18.369221] [2016-07-07 03:10:18.370100] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.370125] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.370263] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.370280] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.370372] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:18.370372] and [2016-07-07 03:10:18.375047] [2016-07-07 03:10:18.375795] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.375819] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.376039] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.376095] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.376999] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.377025] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.377268] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.380842] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.381471] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.381490] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.381913] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.383184] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.383925] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.383943] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.384130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.387626] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.388267] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.388286] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.388517] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.390036] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.390827] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.390846] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.391096] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.393952] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.394688] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.394706] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.394946] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.397224] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.397978] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.398001] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.398360] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.400396] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.401284] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.401303] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.401534] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.404110] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.404879] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.404898] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.405091] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.407125] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.408042] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.408061] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.408381] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.410974] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.411821] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.411840] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.412102] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.414908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.415957] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.415982] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.416328] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.418193] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.418975] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.418995] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.419237] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.422897] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.424029] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.424049] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.424316] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.424983] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.425779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.425797] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.426108] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.430594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.431684] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.431707] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.431979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.432621] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.433610] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.433630] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.433909] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.438293] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.439331] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.439355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.439624] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.441316] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.442369] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.442389] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.442794] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.445681] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.446476] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.446495] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.446739] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.449174] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.450124] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.450143] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.450620] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.451361] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.452096] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.452114] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.452323] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.461609] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.462951] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.462978] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.463556] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.469423] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.470509] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.470530] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.470751] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.477171] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.478150] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.478171] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.478733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.484821] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.485772] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.485792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.486126] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.492734] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.493750] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.493771] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.494044] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.502255] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.503302] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.503324] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.503998] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.509725] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.510551] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.510571] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.510777] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.517120] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.517900] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.517926] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.518168] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.574484] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.575213] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.575243] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.575488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.589301] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.589962] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.589987] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.590332] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.602208] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.602843] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.602865] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.603139] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.614487] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.615217] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.615239] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.615506] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.627794] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.628540] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.628570] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.628836] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.643657] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.644458] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.644478] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.644704] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.661878] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.662515] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.662543] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.662864] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.679648] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.680438] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.680465] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.680676] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.694124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.694875] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.694901] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.695159] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.707445] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.708242] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.708264] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.708740] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.721076] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.721754] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.721782] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.722172] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.734535] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.735150] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.735171] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.735447] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.748716] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.749532] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.749563] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.749969] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.750019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.750601] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.750620] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.750887] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.759550] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.761618] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.761643] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.761908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.766411] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.767204] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.767225] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.767517] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.778845] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.779475] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.779495] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.779915] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.797960] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.798847] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.798870] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.799068] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.810124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.810885] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.810909] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.811267] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.830173] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.830847] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.830869] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.831125] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.841163] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.841993] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.842014] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.842363] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.851798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.852844] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.852867] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.853286] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.865028] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.865831] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.865854] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.866142] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.877445] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.878258] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.878279] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.878468] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.902479] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.903192] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.903212] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.903503] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.924390] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.925226] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.925247] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.925543] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.949382] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.950019] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.950038] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.950434] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.974962] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.975842] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.975876] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.976145] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.986147] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.986943] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.986964] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.987237] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.997022] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:18.997825] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:18.997844] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:18.998142] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.011391] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.012146] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.012166] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.012423] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.027350] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.028101] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.028121] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.028394] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.038186] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.038972] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.038990] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.039403] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.050498] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.051557] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.051579] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.051803] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.062970] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.063566] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.063586] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.064061] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.073490] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.074315] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.074335] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.074523] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.083185] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.084037] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.084056] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.084347] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.092812] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.093634] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.093653] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.093895] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.107348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.108108] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.108128] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.108392] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.118716] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.119395] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.119416] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.120060] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.128761] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.129545] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.129565] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.129850] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.140495] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.141168] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.141187] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.141409] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.151946] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.152561] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.152580] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.152868] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.157245] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.161252] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.161278] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.161536] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.161770] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.162452] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.162476] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.162745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:19.162745] and [2016-07-07 03:10:19.169034] [2016-07-07 03:10:19.172024] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.172049] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.172306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.172317] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.172327] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.172334] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.172512] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:19.172512] and [2016-07-07 03:10:19.172807] [2016-07-07 03:10:19.172863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.172881] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.172905] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.173126] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.173146] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.173264] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:19.173264] and [2016-07-07 03:10:19.181706] [2016-07-07 03:10:19.182425] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.182447] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.182705] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.195936] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.196634] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.196653] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.197016] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.209965] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.210900] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.210922] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.211264] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.220979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.221657] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.221679] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.221985] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.231513] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.232417] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.232438] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.232687] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.248093] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.248841] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.248863] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.249265] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.266979] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.267796] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.267816] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.268018] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.279352] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.280105] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.280125] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.280384] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.292306] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.292973] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.292992] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.293389] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.307082] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.307899] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.307918] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.308313] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.319454] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.320263] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.320285] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.320550] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.327479] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.328093] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.328116] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.328429] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.335790] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.336696] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.336738] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.337102] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.347483] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.348441] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.348469] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.348720] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.356813] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.357496] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.357517] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.357818] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.370328] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.370933] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.370958] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.371286] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.382216] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.382934] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.382957] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.383373] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.396124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.396767] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.396790] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.397052] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.408191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.408888] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.408919] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.409131] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.413387] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.414008] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.414030] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.414286] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.420166] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.422960] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.422987] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.423387] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.430799] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.431435] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.431459] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.431689] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.440848] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.441825] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.441849] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.442116] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.446546] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.447419] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.447440] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.447747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.452632] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.453280] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.453301] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.453647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.457266] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.457948] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.457971] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.458259] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.465259] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.466018] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.466038] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.466271] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:19.466271] and [2016-07-07 03:10:19.473120] [2016-07-07 03:10:19.475862] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.475908] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.475956] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.476003] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.476264] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:19.476264] and [2016-07-07 03:10:19.481058] [2016-07-07 03:10:19.481809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.481839] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.482212] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.489931] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.490634] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.490663] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.490901] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.498260] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.498961] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.498993] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.499292] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.548250] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.549006] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.549036] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.549426] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.601580] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.602505] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.602535] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.602800] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.613057] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.613868] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.613897] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.614273] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.626466] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.627286] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.627307] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.627518] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.651767] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.652330] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.652357] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.652784] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.671208] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.672056] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.672080] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.672351] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.683747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.684498] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.684519] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.684885] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.695435] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.696341] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.696364] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.696628] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.710328] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.711032] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.711054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.711363] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.725904] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.726622] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.726651] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.726912] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.744246] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.745397] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.745423] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.746484] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.747581] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.748140] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.748159] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.748510] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.749062] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.749898] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.749917] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.750178] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.772321] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.773102] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.773125] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.773372] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.783000] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.783911] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.783932] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.784252] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.792605] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.793280] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.793303] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.793698] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.806993] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.807630] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.807652] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.808184] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.822449] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.823251] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.823274] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.823552] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.854124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.854973] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.854999] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.855289] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.882615] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.883401] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.883425] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.883678] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.893244] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.894009] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.894029] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.894272] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.903473] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.904515] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.904535] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.904834] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.914339] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.915082] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.915108] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.915349] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.925691] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.926433] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.926455] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.926775] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.940895] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.941779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.941801] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.942029] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.958756] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.959706] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.959736] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.960095] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.969525] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.970453] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.970485] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.970874] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.979788] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.980646] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.980667] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.980908] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.990762] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:19.991502] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:19.991522] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:19.991904] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.002622] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.003403] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.003433] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.003742] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.020850] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.021637] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.021668] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.021916] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.037925] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.038816] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.038840] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.039077] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.045964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.046541] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.046568] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.046807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.053202] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.054051] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.054071] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.054352] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.061044] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.061933] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.061954] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.062316] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.068756] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.069753] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.069773] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.070021] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.076337] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.077271] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.077291] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.077587] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.083904] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.084616] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.084644] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.084853] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.094298] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.095278] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.095309] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.095723] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.105288] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.106244] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.106272] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.106530] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.118253] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.118904] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.118929] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.119215] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.130740] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.131526] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.131547] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.131811] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.140266] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.141039] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.141060] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.141285] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.149942] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.150600] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.150630] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.150849] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.158024] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.158939] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.158958] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.159168] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.163927] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.164655] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.164678] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.164990] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.166894] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.170844] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.170867] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.171306] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:20.171306] and [2016-07-07 03:10:20.176323] [2016-07-07 03:10:20.180351] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.180377] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.180419] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.180429] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.180665] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:20.180665] and [2016-07-07 03:10:20.187321] [2016-07-07 03:10:20.189291] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.189321] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.189685] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.192620] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.193433] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.193455] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.193662] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.195454] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.199337] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.199359] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.199580] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:20.199580] and [2016-07-07 03:10:20.205981] [2016-07-07 03:10:20.206150] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.206178] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.206191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.207225] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.207241] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.207719] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.207730] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208453] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.208468] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208543] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.208620] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.208640] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208683] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.208694] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208728] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.208737] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208774] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.208812] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.208866] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.208882] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208920] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.208934] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.208995] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.209030] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.209080] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.209096] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.209134] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.209143] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.209225] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.209279] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.209294] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.209307] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.209346] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.209382] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.209391] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.209478] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:20.209478] and [2016-07-07 03:10:20.214377] [2016-07-07 03:10:20.215051] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.215074] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.215348] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.215591] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:20.216592] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:20.216611] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:20.216888] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.012857] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.013702] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.013731] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.013974] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.020865] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.022837] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.022859] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.023383] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.222426] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.223317] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.223345] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.223748] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.229737] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.237065] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.237088] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.237591] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:21.237591] and [2016-07-07 03:10:21.242013] [2016-07-07 03:10:21.246615] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.246638] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.249081] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.249094] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.249276] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.249423] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.370286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: /images (fb3789af-852f-4bc7-9c03-296e77bfd8f2) [Input/output error] [2016-07-07 03:10:21.835574] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.836424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.836439] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.836659] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.846073] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.849012] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.849036] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.849283] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.859800] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.860492] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.860526] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.860845] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.869488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:21.872417] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:21.872442] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:21.872709] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.223552] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.224470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.224584] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.224848] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.231594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.239358] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.239381] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.239880] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:22.239880] and [2016-07-07 03:10:22.245993] [2016-07-07 03:10:22.246037] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.246071] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.246092] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.246240] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.246252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.246261] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.246267] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.246284] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.246324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.246333] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.246421] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.246438] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.246519] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.246535] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.247845] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.247859] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.248917] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.249165] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.249175] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.250295] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.250312] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.250319] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.250341] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.250365] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.250370] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.250385] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.250395] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.250410] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.250417] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.250432] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.250684] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.250695] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.251417] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:22.252252] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.252268] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.252339] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:22.252351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:22.252362] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:22.252362] and [2016-07-07 03:10:23.224973] [2016-07-07 03:10:23.225754] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:23.225785] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.004792] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.009928] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.010825] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.010847] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.011257] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:24.011257] and [2016-07-07 03:10:24.020872] [2016-07-07 03:10:24.024175] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.024200] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.025310] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.025581] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.025620] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.026765] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:24.026765] and [2016-07-07 03:10:24.034984] [2016-07-07 03:10:24.037764] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.037789] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.040167] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.040180] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.040191] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.040202] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.040214] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.040220] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.040305] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.040313] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.041292] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.041310] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.041324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.041331] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.041532] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.041542] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.041594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:24.041594] and [2016-07-07 03:10:24.226627] [2016-07-07 03:10:24.233469] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.233507] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.233970] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 15 times between [2016-07-07 03:10:24.233970] and [2016-07-07 03:10:24.242201] [2016-07-07 03:10:24.242353] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.242377] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.244398] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.244415] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.244640] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.244651] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245297] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245313] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245549] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.245568] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245589] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245606] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245620] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245650] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245658] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245679] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245687] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245704] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245717] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245741] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245755] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245831] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245846] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.245910] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.245942] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.246026] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.246040] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.246096] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.246160] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.246172] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.246181] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.246239] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.246273] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.246288] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.246325] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 11 times between [2016-07-07 03:10:24.246325] and [2016-07-07 03:10:24.849820] [2016-07-07 03:10:24.850575] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.850606] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.850819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.860614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.863699] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.863726] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.864001] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.875633] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.876336] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.876365] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.876575] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.885492] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:24.888305] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:24.888328] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:24.888585] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.225549] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.226627] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.226657] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.226866] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.232935] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.239847] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.239883] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.240167] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 11 times between [2016-07-07 03:10:25.240167] and [2016-07-07 03:10:25.245668] [2016-07-07 03:10:25.246633] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.246658] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.246875] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.246886] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.246924] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.246934] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.246964] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.247116] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247126] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.247161] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247169] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.247179] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247185] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.247193] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247200] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.247235] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.247293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247320] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.247373] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247383] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.247425] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.247435] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.249770] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.249815] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:25.249829] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.249842] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.249875] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:25.249875] and [2016-07-07 03:10:25.251991] [2016-07-07 03:10:25.252293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:25.252316] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:25.252691] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.212163] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.213035] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.213069] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.213338] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.222555] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.225567] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.225590] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.226132] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.228294] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.236809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.236837] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.237452] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:26.237452] and [2016-07-07 03:10:26.241087] [2016-07-07 03:10:26.241102] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.241126] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.241183] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:26.241183] and [2016-07-07 03:10:26.241699] [2016-07-07 03:10:26.241904] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.241929] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.241970] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.242139] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242156] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242170] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242183] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242398] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242436] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.242473] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242483] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242493] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.242707] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.242750] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242779] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242825] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242836] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242875] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.242929] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.242939] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.242972] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.242998] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.243082] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.243098] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.245319] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:26.245319] and [2016-07-07 03:10:26.247580] [2016-07-07 03:10:26.247589] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.247612] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.247626] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.249482] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.249501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.249653] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:26.249653] and [2016-07-07 03:10:26.256599] [2016-07-07 03:10:26.258450] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.258483] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.258742] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.501690] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.502481] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.502510] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.502930] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.511667] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.514496] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.514521] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.514778] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.525503] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.526121] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.526146] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.526399] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.535114] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.537962] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.537985] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.538247] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.951597] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.952391] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.952420] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.952645] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.962465] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.965427] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.965452] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.966112] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.980096] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.980910] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.980940] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.981185] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.990609] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:26.993358] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:26.993384] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:26.994041] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:27.226623] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:27.227367] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.227507] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.227733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:27.234266] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:27.240970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.240995] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.241547] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:27.241547] and [2016-07-07 03:10:27.246174] [2016-07-07 03:10:27.248925] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.248951] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.251101] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.251112] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.252359] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.252376] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.252451] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.252473] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.252551] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:27.252600] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:27.252609] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:27.252647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:27.252647] and [2016-07-07 03:10:28.227996] [2016-07-07 03:10:28.228781] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:28.228809] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:28.229037] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:28.234830] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:28.241316] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:28.241343] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:28.241970] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:28.246676] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:28.253116] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:28.253141] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:28.253743] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:28.507359] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:28.508083] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:28.508113] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:28.508319] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:28.508319] and [2016-07-07 03:10:28.515544] [2016-07-07 03:10:28.517124] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:28.517157] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:28.517572] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:28.517586] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:28.517815] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:28.517815] and [2016-07-07 03:10:29.228183] [2016-07-07 03:10:29.228887] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.228916] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.229154] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.234909] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.241243] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.241276] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.241676] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:29.241676] and [2016-07-07 03:10:29.247994] [2016-07-07 03:10:29.248001] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.248041] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.248064] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.248228] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.248247] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.248287] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.248339] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.248356] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.248417] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.248436] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.248489] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.248501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.248545] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.248559] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.250666] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:29.250666] and [2016-07-07 03:10:29.251226] [2016-07-07 03:10:29.252438] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.252460] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.252490] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.252508] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.252638] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.252651] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.252803] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.252815] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.252854] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:29.252854] and [2016-07-07 03:10:29.449382] [2016-07-07 03:10:29.450124] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.450156] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.450416] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.458998] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.461876] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.461916] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.462209] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.473064] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.473591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.473620] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.473893] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.482243] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:29.485092] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:29.485115] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:29.485471] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.229278] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.229963] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.229993] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.230322] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.236107] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.242146] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.242170] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.242819] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:30.242819] and [2016-07-07 03:10:30.248203] [2016-07-07 03:10:30.248499] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.248525] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.250877] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.250894] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.250971] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.250981] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.252495] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.252839] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.252867] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.252888] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.252938] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:30.252938] and [2016-07-07 03:10:30.258031] [2016-07-07 03:10:30.258971] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.258996] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.259317] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.263255] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.264456] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.264480] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.264745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.266303] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.270007] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.270029] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.270297] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:30.270297] and [2016-07-07 03:10:30.275745] [2016-07-07 03:10:30.277220] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.277249] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.278807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.278852] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.278864] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.278906] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.278915] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.278950] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.278963] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.279051] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.279068] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.279174] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:30.279174] and [2016-07-07 03:10:30.282703] [2016-07-07 03:10:30.283396] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.283418] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.283619] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.913252] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.914041] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.914071] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.914488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.920553] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:30.922726] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:30.922754] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:30.922967] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.289148] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.294487] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:31.294518] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:31.295142] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.299719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.305241] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:31.305264] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:31.305762] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.688867] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.689774] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:31.689806] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:31.690096] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.699756] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.702617] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:31.702644] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:31.702900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.713665] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.714588] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:31.714617] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:31.714855] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.724007] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:31.727018] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:31.727052] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:31.727724] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:32.288287] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:32.288957] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:32.288995] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:32.289429] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:32.295030] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:32.300217] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:32.300243] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:32.300480] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:32.304469] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:32.309528] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:32.309553] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:32.310221] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.164795] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.165688] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.165717] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.165997] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.172802] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.174753] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.174774] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.175019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.291299] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.296459] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.296491] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.297077] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:33.297077] and [2016-07-07 03:10:33.302346] [2016-07-07 03:10:33.305146] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.305170] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306179] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.306192] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306228] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.306237] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306331] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.306349] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306374] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.306385] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306422] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.306431] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306520] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.306559] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.306568] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.306863] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:33.306863] and [2016-07-07 03:10:33.307208] [2016-07-07 03:10:33.878371] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory]" repeated 3 times between [2016-07-07 03:10:33.878371] and [2016-07-07 03:10:33.882717] [2016-07-07 03:10:33.951383] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.952208] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.952223] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.952469] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.962298] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.965203] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.965228] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.965894] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.977279] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.978027] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.978057] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.978342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.987466] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:33.990323] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:33.990351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:33.990761] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:34.291848] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:34.292778] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:34.292808] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:34.293155] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:34.298247] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:34.302080] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:34.302107] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:34.302686] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:34.302686] and [2016-07-07 03:10:34.306816] [2016-07-07 03:10:34.310001] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:34.310027] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:34.310077] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:34.310095] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:34.310224] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:34.310237] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:34.310372] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:34.310372] and [2016-07-07 03:10:35.292596] [2016-07-07 03:10:35.293416] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.293449] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.293747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:35.299054] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:35.302247] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.302278] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.302699] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:35.302699] and [2016-07-07 03:10:35.307243] [2016-07-07 03:10:35.309873] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.309918] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.309950] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.309959] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.310098] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.310117] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.310134] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.310142] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.310240] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:35.310240] and [2016-07-07 03:10:35.379219] [2016-07-07 03:10:35.379952] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.379983] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.380250] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:35.386299] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:35.388367] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:35.388392] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:35.388706] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.140252] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.141028] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.141059] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.141302] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.150386] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.153738] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.153766] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.154149] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.164393] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.165408] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.165432] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.165665] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.174225] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.177061] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.177083] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.177564] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.294891] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:36.300395] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.300425] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.301057] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:36.301057] and [2016-07-07 03:10:36.306142] [2016-07-07 03:10:36.310414] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.310439] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.310460] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.310469] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.310553] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.310563] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.310670] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:36.310681] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:36.310820] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:36.310820] and [2016-07-07 03:10:37.295915] [2016-07-07 03:10:37.298324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:37.298361] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:37.299020] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:37.299020] and [2016-07-07 03:10:37.304538] [2016-07-07 03:10:37.306098] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:37.306126] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:37.306293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:37.306306] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:37.306594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:37.306726] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:37.952147] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:37.952441] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:37.954137] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:37.954165] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e98c05ab-7528-4282-8c1d-ed4930657064) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:37.954258] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(93d20afe-384d-4a87-ae5e-0b9d59282604) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument]" repeated 5 times between [2016-07-07 03:10:37.954137] and [2016-07-07 03:10:38.297999] [2016-07-07 03:10:38.298006] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:37.952147] and [2016-07-07 03:10:38.302362] [2016-07-07 03:10:38.304194] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:38.304223] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:38.304480] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.297065] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.299335] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.299375] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.299681] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.305593] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.305598] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:39.299681] and [2016-07-07 03:10:39.769711] [2016-07-07 03:10:39.770408] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.770441] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.770773] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.779763] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.782643] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.782667] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.783186] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.796060] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.796876] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.796904] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.797097] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.806115] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.808930] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.808953] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.809175] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.823444] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.824152] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.824179] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.824423] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.833228] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.836315] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.836336] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.836780] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.845944] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.846613] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.846638] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.846849] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.855368] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.858664] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.858687] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.858905] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.868416] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.869274] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.869298] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.869699] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.878182] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.881148] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.881173] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.881440] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.893980] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.894840] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.894866] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.895134] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.903394] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.906194] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.906216] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.906480] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.916499] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.917182] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.917208] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.917381] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.926428] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.929458] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.929479] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.929912] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.940911] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.941777] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.941810] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.942019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.949833] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.952618] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.952639] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.953038] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.967033] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:39.967578] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.967631] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:39.968188] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.968222] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:39.968764] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.968798] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory]" repeated 2 times between [2016-07-07 03:10:37.952441] and [2016-07-07 03:10:39.969354] [2016-07-07 03:10:39.969362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:83236652-955d-4bcb-8a34-8965426733ee> (83236652-955d-4bcb-8a34-8965426733ee) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:83236652-955d-4bcb-8a34-8965426733ee> (83236652-955d-4bcb-8a34-8965426733ee) [Input/output error]" repeated 3 times between [2016-07-07 03:10:39.969362] and [2016-07-07 03:10:39.969644] [2016-07-07 03:10:39.970320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:39.970320] and [2016-07-07 03:10:39.971024] [2016-07-07 03:10:39.971172] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.971196] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.971213] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.971286] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.971303] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.971336] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.971426] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.971447] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.972250] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:39.972312] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.972425] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.972438] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.972544] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.972557] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973063] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.973111] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973120] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973168] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.973189] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973196] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973229] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973237] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973275] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973285] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973344] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973400] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973409] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973534] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973550] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973741] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.973754] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(83236652-955d-4bcb-8a34-8965426733ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.973866] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:39.973866] and [2016-07-07 03:10:39.974085] [2016-07-07 03:10:39.974107] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:39.974680] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:39.974680] and [2016-07-07 03:10:39.975694] [2016-07-07 03:10:39.976462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:34dfb74e-226e-498d-a5ca-606ee639369f> (34dfb74e-226e-498d-a5ca-606ee639369f) [Input/output error] [2016-07-07 03:10:39.976715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:34dfb74e-226e-498d-a5ca-606ee639369f> (34dfb74e-226e-498d-a5ca-606ee639369f) [Input/output error] [2016-07-07 03:10:39.976882] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted]" repeated 3 times between [2016-07-07 03:10:39.968798] and [2016-07-07 03:10:39.977628] [2016-07-07 03:10:39.978104] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978136] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978151] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978162] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978175] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978194] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978350] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978371] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978442] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:c7a892f0-6da7-4855-87e7-189e2c44aa02> (c7a892f0-6da7-4855-87e7-189e2c44aa02) [Input/output error] [2016-07-07 03:10:39.978691] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978709] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978750] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978766] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(34dfb74e-226e-498d-a5ca-606ee639369f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978794] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978809] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.978886] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.978902] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 15 times between [2016-07-07 03:10:39.976882] and [2016-07-07 03:10:39.978935] [2016-07-07 03:10:39.978981] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.979008] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(34dfb74e-226e-498d-a5ca-606ee639369f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.979032] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 3 times between [2016-07-07 03:10:39.978902] and [2016-07-07 03:10:39.979184] [2016-07-07 03:10:39.979190] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument]" repeated 3 times between [2016-07-07 03:10:39.979032] and [2016-07-07 03:10:39.979329] [2016-07-07 03:10:39.979334] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.979384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.979399] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 24 times between [2016-07-07 03:10:39.979190] and [2016-07-07 03:10:39.981079] [2016-07-07 03:10:39.981198] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.981230] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.981280] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.981863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.981869] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:39.981280] and [2016-07-07 03:10:39.982239] [2016-07-07 03:10:39.982249] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982289] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982389] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.982426] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982441] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982482] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982500] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982530] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982545] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982622] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982638] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982684] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.982745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982771] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982791] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.982820] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982835] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982855] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982869] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982894] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.982907] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.982924] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.983144] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.983162] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cbe7a475-3ef4-487f-878c-364f79fe3013) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.983207] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:39.983207] and [2016-07-07 03:10:39.983880] [2016-07-07 03:10:39.983929] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.983959] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.983996] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.984092] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.984163] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.984188] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.984210] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.984218] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.984229] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.984264] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.984293] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.984311] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.984522] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:39.984522] and [2016-07-07 03:10:39.984898] [2016-07-07 03:10:39.985005] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.985035] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.985338] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.985435] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.985453] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.985517] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:39.985517] and [2016-07-07 03:10:39.985846] [2016-07-07 03:10:39.985902] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.985932] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.986050] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.986067] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.986127] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.986317] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.986334] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.986600] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.986760] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.986785] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.986909] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.987005] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.987064] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.987099] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.987151] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.987185] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.987200] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3a85d230-a26a-40de-a81f-a7be9ecf1ebf) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.987250] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 11 times between [2016-07-07 03:10:39.987250] and [2016-07-07 03:10:39.987873] [2016-07-07 03:10:39.987976] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988009] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988039] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988092] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988351] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988377] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988399] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988461] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988469] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988493] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988553] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988657] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988706] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988731] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988762] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988780] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(dbe3626f-7e34-4f60-a019-3474e3d1a05d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988823] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988873] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988889] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.988905] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988943] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.988956] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.988978] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.989048] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.989064] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.989080] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:39.989080] and [2016-07-07 03:10:39.989307] [2016-07-07 03:10:39.989577] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.989606] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(9bf4d9ec-43eb-4d4d-81dd-baf1e75b53c2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.989646] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.989665] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(9bf4d9ec-43eb-4d4d-81dd-baf1e75b53c2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.989687] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.989731] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.989788] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.989813] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.989830] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:39.989830] and [2016-07-07 03:10:39.989867] [2016-07-07 03:10:39.990040] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.990069] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.990102] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.990118] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.990241] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.990314] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.990334] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.990357] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.990435] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:39.990435] and [2016-07-07 03:10:39.990606] [2016-07-07 03:10:39.990811] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.990839] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.990927] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.991032] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.991049] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.991074] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:39.991074] and [2016-07-07 03:10:39.992004] [2016-07-07 03:10:39.992015] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.992045] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.992251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:39.992251] and [2016-07-07 03:10:39.992498] [2016-07-07 03:10:39.992508] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.992538] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.992745] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.992779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.992797] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.992826] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.992973] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:39.993531] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.993544] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.993588] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.993619] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.993651] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.993670] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.993732] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:39.993732] and [2016-07-07 03:10:39.993896] [2016-07-07 03:10:39.993950] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.993980] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.994039] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.994056] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.994109] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.994334] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.994408] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.994436] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.994597] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.994681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:cc3ebc6f-6ef4-4b00-b00f-0b75cdc23f4e> (cc3ebc6f-6ef4-4b00-b00f-0b75cdc23f4e) [Input/output error] [2016-07-07 03:10:39.994827] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.994970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.994987] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995037] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.995072] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995083] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995131] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.995178] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995193] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995242] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995254] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995315] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995329] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995380] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.995449] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995466] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995519] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995530] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995608] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.995653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.995669] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ed8cadd0-785a-44da-93e6-56a640b44b73) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.995779] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:39.996275] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:39.996275] and [2016-07-07 03:10:39.996969] [2016-07-07 03:10:39.997048] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.997078] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cc3ebc6f-6ef4-4b00-b00f-0b75cdc23f4e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.997265] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:39.997902] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.997923] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(cc3ebc6f-6ef4-4b00-b00f-0b75cdc23f4e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.998360] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.998427] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:39.999136] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.999152] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(418b4a6e-9153-481a-afe9-08df80021fd2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.999308] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.999436] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:39.999454] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(418b4a6e-9153-481a-afe9-08df80021fd2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:39.999919] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.999969] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:39.999997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:0cd7a74f-ddbb-4cdb-aab2-c898b075db1c> (0cd7a74f-ddbb-4cdb-aab2-c898b075db1c) [Input/output error] [2016-07-07 03:10:40.000030] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:40.000030] and [2016-07-07 03:10:40.000796] [2016-07-07 03:10:40.001591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.001619] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.002233] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.002370] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.002410] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.002432] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.002478] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.002513] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.002526] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.002616] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.002671] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.002688] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.002736] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.002846] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.002864] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.002926] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.003004] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003018] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003077] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003098] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003157] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003171] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003227] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003252] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003310] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003322] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0cd7a74f-ddbb-4cdb-aab2-c898b075db1c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003392] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003408] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003453] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.003542] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.003602] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003618] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003673] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.003745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003757] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.003863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003876] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003927] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.003939] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.003990] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:40.003990] and [2016-07-07 03:10:40.004115] [2016-07-07 03:10:40.004139] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.004161] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(919c2509-61c0-4da6-9bb8-e107f729a36e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.004198] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:40.004198] and [2016-07-07 03:10:40.006235] [2016-07-07 03:10:40.006982] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.007005] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.007465] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.008265] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.009408] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.009430] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6057fc4c-dcaf-46c8-a2de-db84f062f1ef) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.009692] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.010320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.011731] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.011750] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3c78f4c1-3d9b-447a-859f-66ffd6276dfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.012350] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.013800] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory]" repeated 2 times between [2016-07-07 03:10:40.013800] and [2016-07-07 03:10:40.013906] [2016-07-07 03:10:40.029798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.030557] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.030562] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:40.029798] and [2016-07-07 03:10:40.042783] [2016-07-07 03:10:40.046722] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.046751] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.047380] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.066786] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.066792] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:40.047380] and [2016-07-07 03:10:40.075282] [2016-07-07 03:10:40.078344] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.078367] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.078643] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.298215] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.298220] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:40.078643] and [2016-07-07 03:10:40.304957] [2016-07-07 03:10:40.310783] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.310809] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.311073] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument]" repeated 2 times between [2016-07-07 03:10:40.310783] and [2016-07-07 03:10:40.340003] [2016-07-07 03:10:40.340009] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:40.311073] and [2016-07-07 03:10:40.342374] [2016-07-07 03:10:40.349536] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 2 times between [2016-07-07 03:10:40.340009] and [2016-07-07 03:10:40.349589] [2016-07-07 03:10:40.350263] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.350379] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.350778] E [MSGID: 114031] [client-rpc-fops.c:972:client3_3_flush_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:40.355675] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument]" repeated 5 times between [2016-07-07 03:10:40.349536] and [2016-07-07 03:10:40.374195] [2016-07-07 03:10:40.374201] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.374245] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.374262] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.374291] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument]" repeated 2 times between [2016-07-07 03:10:40.374291] and [2016-07-07 03:10:40.381261] [2016-07-07 03:10:40.381266] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 17 times between [2016-07-07 03:10:40.355675] and [2016-07-07 03:10:40.386149] [2016-07-07 03:10:40.393053] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 2 times between [2016-07-07 03:10:40.381266] and [2016-07-07 03:10:40.397011] [2016-07-07 03:10:40.397304] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument]" repeated 2 times between [2016-07-07 03:10:40.393053] and [2016-07-07 03:10:40.403318] [2016-07-07 03:10:40.403322] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 15 times between [2016-07-07 03:10:40.397304] and [2016-07-07 03:10:40.403562] [2016-07-07 03:10:40.403618] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.403647] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.403655] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.404128] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.404134] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.406338] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.406354] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:40.403655] and [2016-07-07 03:10:40.406582] [2016-07-07 03:10:40.406594] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.406615] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.406655] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.406669] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.406677] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.406686] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.406692] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.406702] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.406713] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.406715] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.408633] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.408646] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.408653] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.408670] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.408678] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.408878] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.408891] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.410871] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.410890] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.411120] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.411143] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.411145] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.413166] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.413278] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.413298] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.413316] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.413372] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.413382] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.413488] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:40.413488] and [2016-07-07 03:10:40.413760] [2016-07-07 03:10:40.413779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.413798] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.413836] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:40.413836] and [2016-07-07 03:10:40.413867] [2016-07-07 03:10:40.414041] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.414066] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.414086] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:40.414086] and [2016-07-07 03:10:40.418825] [2016-07-07 03:10:40.419688] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.419711] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.420059] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.424441] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.428221] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.428242] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.428614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:40.428614] and [2016-07-07 03:10:40.432867] [2016-07-07 03:10:40.436194] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.436219] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.436322] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.436334] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.436604] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:40.436604] and [2016-07-07 03:10:40.440615] [2016-07-07 03:10:40.441303] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.441328] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.441550] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.798246] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.798838] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.798880] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.799128] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.808389] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.811236] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.811263] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.811529] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.879733] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.880438] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.880468] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.880696] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.889477] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.892354] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.892378] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.892640] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.951660] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.952267] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.952296] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.952518] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.962671] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.965456] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.965480] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.965900] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:40.965900] and [2016-07-07 03:10:40.978341] [2016-07-07 03:10:40.983438] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.983481] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.986464] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.993336] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.993355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.993444] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:40.993454] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:40.993807] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.993903] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:40.994260] E [MSGID: 114031] [client-rpc-fops.c:972:client3_3_flush_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:40.999436] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 14 times between [2016-07-07 03:10:40.999436] and [2016-07-07 03:10:41.001585] [2016-07-07 03:10:41.001828] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.001852] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.001905] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.001944] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.001954] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.001995] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.002066] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002076] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002114] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002138] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002557] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002569] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002614] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002624] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002655] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002663] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002799] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002815] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002870] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002880] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.002915] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.002925] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.003054] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003104] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.003121] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.003163] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003228] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003280] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.003297] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.003340] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003415] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003456] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.003477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.003514] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003639] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003688] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.003705] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.003825] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.003906] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.003917] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.003982] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.004036] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.004047] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.004152] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.004214] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.004225] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.004268] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 18 times between [2016-07-07 03:10:41.004268] and [2016-07-07 03:10:41.006386] [2016-07-07 03:10:41.006412] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006434] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.006544] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.006585] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006596] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.006635] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.006670] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006680] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.006715] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.006791] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006809] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.006872] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006883] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.006922] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006933] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.006966] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.006975] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.007009] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.007017] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.007046] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.007054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.007130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.007257] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.007268] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.007303] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:41.007303] and [2016-07-07 03:10:41.007620] [2016-07-07 03:10:41.007708] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.007745] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.007806] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.007872] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.007884] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.007937] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:41.007937] and [2016-07-07 03:10:41.009918] [2016-07-07 03:10:41.009929] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.009947] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.010280] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.010295] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.010510] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.010523] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.010530] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.010542] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.012515] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.013606] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.013618] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.014083] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.014139] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.014344] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.014376] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.014435] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 13 times between [2016-07-07 03:10:41.014435] and [2016-07-07 03:10:41.015495] [2016-07-07 03:10:41.015521] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.015545] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.015720] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.015746] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.015754] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.015947] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.015963] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.016194] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.016210] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.016218] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.016441] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.016457] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.016495] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.016506] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.016690] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.016731] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.016766] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.016782] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.016818] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.016829] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.016869] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:41.016869] and [2016-07-07 03:10:41.017029] [2016-07-07 03:10:41.017070] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.017090] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.017129] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:41.017129] and [2016-07-07 03:10:41.017174] [2016-07-07 03:10:41.017231] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.017249] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.017340] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.017352] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.017433] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.017477] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.017487] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.017521] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.017530] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.017566] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.017642] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.017793] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.017810] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.017954] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.018048] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.018060] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.018109] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:41.018109] and [2016-07-07 03:10:41.018332] [2016-07-07 03:10:41.018369] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.018390] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.018427] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.018533] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.018577] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.018593] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.018647] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:41.018647] and [2016-07-07 03:10:41.020251] [2016-07-07 03:10:41.020306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.020328] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.021428] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.021575] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.021624] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.021638] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.021872] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:41.021872] and [2016-07-07 03:10:41.022123] [2016-07-07 03:10:41.022907] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.022927] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.022968] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.023400] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.023419] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.023462] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.023472] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.023503] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.023535] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.023545] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.023635] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.023645] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(41641151-3bc8-4a0c-8fe6-db529aac896f) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.023684] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:41.023684] and [2016-07-07 03:10:41.028091] [2016-07-07 03:10:41.029474] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.029497] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.029762] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.033204] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.034592] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.034612] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(687450fb-cb1d-464c-b82f-d78ef7b9715d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.034833] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.038539] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.039023] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.039043] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.039282] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.072552] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.073200] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.073236] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.073602] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.083018] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.085990] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.086014] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.086386] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.152403] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.153195] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.153225] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.153473] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.162327] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.165061] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.165084] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.165367] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.262959] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.263626] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.263655] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.264004] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.270099] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.271700] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.271721] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.272077] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.386349] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.386975] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.387005] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.387342] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.395852] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.396497] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.396517] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.396898] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.400963] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.402611] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.402632] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.403121] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.416328] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.418167] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.418187] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.418441] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.447927] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.452925] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.452956] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.453174] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.453213] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.453730] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.453747] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.453985] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.457964] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:41.459109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:ad82b212-6509-4685-b5e5-70b1f7f5a6e1> (ad82b212-6509-4685-b5e5-70b1f7f5a6e1) [Input/output error] [2016-07-07 03:10:41.459374] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:41.459374] and [2016-07-07 03:10:41.460546] [2016-07-07 03:10:41.460687] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:41.461219] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.461275] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.461298] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(46f26449-4d79-4456-a0f8-1dcda3b3fcfb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.461350] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.461388] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.461429] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 7 times between [2016-07-07 03:10:39.305598] and [2016-07-07 03:10:41.461453] [2016-07-07 03:10:41.461575] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.461696] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.461701] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.461841] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.461869] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.461902] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.461945] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.462016] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.462021] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(0ee7b966-c933-48d0-b1ac-410de895f126) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.462095] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.462117] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.462191] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:1de34e50-4885-44e4-8de2-e10b69aa0bfe> (1de34e50-4885-44e4-8de2-e10b69aa0bfe) [Input/output error] [2016-07-07 03:10:41.462214] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.462223] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:41.461945] and [2016-07-07 03:10:41.462679] [2016-07-07 03:10:41.462697] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.462727] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.462802] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.462845] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.462850] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.462896] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.462906] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.462938] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.463110] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.463127] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.463255] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.463305] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.463315] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.463445] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.463562] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.463597] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.463623] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(1cbc56a4-c1f1-4887-b9c1-ce8d2351fe10) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.463721] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 9 times between [2016-07-07 03:10:41.463721] and [2016-07-07 03:10:41.464610] [2016-07-07 03:10:41.464695] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.464715] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.464767] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.464842] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.464879] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.464894] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c399a3e5-15e2-4096-964c-fed487127efb) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.464969] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.465014] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.465024] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.467152] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.467165] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6f16a550-4fa8-466b-8c81-b28615d99509) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.468239] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:41.468239] and [2016-07-07 03:10:41.468293] [2016-07-07 03:10:41.468316] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.468331] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.468340] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.468481] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.468484] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.468505] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.468519] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(282fdace-df6f-4af9-8318-d4f17a33dae6) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.468555] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.468600] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.468602] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.468815] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.506768] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.506776] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 9 times between [2016-07-07 03:10:41.468340] and [2016-07-07 03:10:41.516466] [2016-07-07 03:10:41.519178] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.519205] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.519428] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.530993] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.530998] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:41.519428] and [2016-07-07 03:10:41.539587] [2016-07-07 03:10:41.542332] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.542359] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.542622] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.591479] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.591484] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:41.542622] and [2016-07-07 03:10:41.600966] [2016-07-07 03:10:41.603937] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.603970] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.604251] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.654048] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.654054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:41.604251] and [2016-07-07 03:10:41.660924] [2016-07-07 03:10:41.661614] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.661639] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:41.662022] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:41.673321] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:41.673325] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:41.662022] and [2016-07-07 03:10:42.025960] [2016-07-07 03:10:42.026992] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.027024] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:42.027458] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:42.039444] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.039449] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:42.027458] and [2016-07-07 03:10:42.050739] [2016-07-07 03:10:42.051321] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.051353] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:42.051707] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:42.063209] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.063221] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:42.051707] and [2016-07-07 03:10:42.449024] [2016-07-07 03:10:42.453663] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.453702] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:42.454371] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:42.463246] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.463251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:42.463524] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.463541] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:42.454371] and [2016-07-07 03:10:42.959963] [2016-07-07 03:10:42.960977] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:42.961007] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(ce2fb70f-7c1e-436e-b65b-8079e23d9f4b) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:42.961268] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:43.448923] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:43.451727] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.451759] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:43.452041] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:43.452041] and [2016-07-07 03:10:43.456415] [2016-07-07 03:10:43.458544] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.458693] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.458697] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:43.458748] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.458769] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:43.458799] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 2 times between [2016-07-07 03:10:42.463541] and [2016-07-07 03:10:43.458808] [2016-07-07 03:10:43.458842] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:43.760934] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.760940] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:43.458842] and [2016-07-07 03:10:43.762260] [2016-07-07 03:10:43.763301] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.763327] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:43.763593] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:43.764980] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:43.764984] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(71edce44-057b-49fd-8e2e-1f821882614c) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:43.763593] and [2016-07-07 03:10:44.450937] [2016-07-07 03:10:44.453900] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:44.453975] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:44.454464] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:44.454464] and [2016-07-07 03:10:44.459540] [2016-07-07 03:10:44.461912] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:44.461940] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:44.462144] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:44.462162] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:44.462217] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:44.462234] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:44.462272] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:44.462272] and [2016-07-07 03:10:44.462504] [2016-07-07 03:10:45.011204] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.012978] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 15 times between [2016-07-07 03:10:45.012978] and [2016-07-07 03:10:45.013779] [2016-07-07 03:10:45.014068] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014098] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014148] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014159] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014326] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014344] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014529] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014550] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014564] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014572] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014586] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014607] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014632] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014644] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014768] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014780] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014792] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014799] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014852] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014863] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.014904] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.014932] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.014943] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.015042] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.015060] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.015110] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.015122] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.015162] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.015188] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.015205] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.015250] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.015277] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.015286] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.015331] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.015359] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.015369] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.015411] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 26 times between [2016-07-07 03:10:45.015411] and [2016-07-07 03:10:45.017860] [2016-07-07 03:10:45.017906] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.017933] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.017952] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.018104] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.018138] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018156] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018168] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018175] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018185] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018192] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018366] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018387] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018402] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018411] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018421] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018429] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018484] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018609] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018666] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.018762] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018777] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018788] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018795] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018811] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.018861] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018879] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018896] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018909] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.018974] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.018989] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.019028] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.019138] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.019153] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.019286] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.019286] and [2016-07-07 03:10:45.019493] [2016-07-07 03:10:45.019593] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.019618] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.019649] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.019744] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.019759] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.019854] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 20 times between [2016-07-07 03:10:45.019854] and [2016-07-07 03:10:45.021232] [2016-07-07 03:10:45.021255] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.021308] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.021367] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.021424] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.021437] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.021482] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.021521] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.021528] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.021543] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.021590] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.021590] and [2016-07-07 03:10:45.022034] [2016-07-07 03:10:45.022042] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022063] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022077] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.022306] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.022348] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022368] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022391] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022400] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022545] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022564] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022577] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022585] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.022607] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022614] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022642] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022658] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022766] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022788] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022823] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022834] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.022903] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.022916] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.023002] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.023019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.023030] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.023042] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.023072] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.023090] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.023318] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.023356] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.023369] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.023388] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.023416] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.023495] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.023508] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.023542] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:45.023542] and [2016-07-07 03:10:45.024081] [2016-07-07 03:10:45.024086] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.024107] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.024216] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.024216] and [2016-07-07 03:10:45.024381] [2016-07-07 03:10:45.024452] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.024477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.024500] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.024500] and [2016-07-07 03:10:45.024862] [2016-07-07 03:10:45.024921] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.024943] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.025003] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.025003] and [2016-07-07 03:10:45.025399] [2016-07-07 03:10:45.025773] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.025796] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.025846] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.025942] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.025962] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026030] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026047] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026062] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026077] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026119] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.026233] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.026329] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026349] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026435] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026451] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026476] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026491] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026586] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026604] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026639] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026653] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026696] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.026720] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026728] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026774] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026798] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026836] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.026862] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.026886] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026901] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.026937] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.026947] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.027033] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.027049] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.027085] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.027085] and [2016-07-07 03:10:45.027599] [2016-07-07 03:10:45.027717] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.027742] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.027776] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.027892] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.027969] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.027990] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.028019] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.028019] and [2016-07-07 03:10:45.028420] [2016-07-07 03:10:45.028518] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.028544] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.028593] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:45.028593] and [2016-07-07 03:10:45.029522] [2016-07-07 03:10:45.029791] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.029816] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.029838] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.030008] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030024] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030126] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.030212] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030228] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030257] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030267] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030300] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030311] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030354] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.030591] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030607] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030630] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030645] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030850] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030869] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.030934] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.030948] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.031035] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.031055] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.031143] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.031235] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.031251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.031323] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.031410] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.031425] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.031508] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.031593] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.031621] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.031700] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.031716] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.031764] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.031840] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.031942] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.031961] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.032063] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.032182] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.032202] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.032279] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.032361] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.032376] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.032457] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 21 times between [2016-07-07 03:10:45.032457] and [2016-07-07 03:10:45.033844] [2016-07-07 03:10:45.033875] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.033912] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.033993] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.034070] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.034085] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.034137] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.034137] and [2016-07-07 03:10:45.034205] [2016-07-07 03:10:45.034233] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.034251] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.034265] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.034330] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.034356] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.034376] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.034402] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.034412] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.034557] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.034574] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.034836] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.034926] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.034940] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035029] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035048] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035069] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035090] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035103] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035121] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035129] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035152] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035223] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035235] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035261] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035302] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035315] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035377] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035407] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035422] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035443] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035458] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035520] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035584] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035595] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035613] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035643] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035652] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035663] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.035674] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.035681] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.035690] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 13 times between [2016-07-07 03:10:45.035690] and [2016-07-07 03:10:45.036506] [2016-07-07 03:10:45.036546] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.036570] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.036621] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 8 times between [2016-07-07 03:10:45.036621] and [2016-07-07 03:10:45.037296] [2016-07-07 03:10:45.037330] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.037353] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.037379] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.037534] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.037585] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.037614] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.037636] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.037740] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.037752] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.037998] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038017] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038041] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038056] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038081] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038098] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038228] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.038472] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038490] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038525] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.038552] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038561] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038610] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.038705] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.038712] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038730] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038743] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.038764] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.038791] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.038989] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.039004] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.039090] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.039107] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.039156] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.039167] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.039228] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.039285] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.039358] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.039378] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.039448] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.039460] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.039515] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.039584] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.039644] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.039662] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.039726] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:45.039726] and [2016-07-07 03:10:45.039988] [2016-07-07 03:10:45.040053] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.040078] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.040130] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.040130] and [2016-07-07 03:10:45.040488] [2016-07-07 03:10:45.040500] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.040520] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.040565] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.040672] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.040691] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.040925] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.040943] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.041154] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.041192] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.041203] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.041300] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.041316] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.041366] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:45.041366] and [2016-07-07 03:10:45.044024] [2016-07-07 03:10:45.044062] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.044087] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.044215] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.044215] and [2016-07-07 03:10:45.044530] [2016-07-07 03:10:45.044712] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.044741] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.044796] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.044856] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.044875] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.044923] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.044970] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.044982] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045028] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045084] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045097] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045139] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045228] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045288] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045306] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045347] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045358] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045448] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045526] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045540] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045584] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045699] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045710] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045730] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045760] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045767] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045778] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.045937] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045950] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045962] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.045969] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.045983] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.046536] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.046552] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.046667] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.046830] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.046847] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.046912] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.046975] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.047046] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.047071] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.047123] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 16 times between [2016-07-07 03:10:45.047123] and [2016-07-07 03:10:45.049095] [2016-07-07 03:10:45.049142] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049166] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049220] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049283] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049295] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049340] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049421] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049448] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049456] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049478] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049500] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049524] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049544] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049572] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049584] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049614] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049711] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049757] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049770] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049809] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049817] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.049920] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.049961] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.049982] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050019] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050031] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050054] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050131] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050148] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050205] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050216] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050274] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050355] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050372] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050422] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050471] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050491] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050508] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050606] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050635] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050649] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050668] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.050810] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050863] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.050919] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.050946] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.051002] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.051021] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.051036] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.051050] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.051098] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 15 times between [2016-07-07 03:10:45.051098] and [2016-07-07 03:10:45.052268] [2016-07-07 03:10:45.052429] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.052452] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.052499] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.052561] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.052657] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.052682] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.052699] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.052856] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.052874] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053057] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053074] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053152] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.053468] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053485] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053512] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053534] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053552] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.053629] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.053687] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053705] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053779] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.053826] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053838] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053885] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053900] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.053926] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.053981] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.053991] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.054032] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.054079] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.054093] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.054120] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.054129] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.054191] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.054206] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.054225] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.054280] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.054291] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.054345] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 13 times between [2016-07-07 03:10:45.054345] and [2016-07-07 03:10:45.056070] [2016-07-07 03:10:45.056163] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.056186] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.056233] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056291] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.056332] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.056414] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056461] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.056481] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.056537] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056604] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.056615] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.056644] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056753] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056804] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.056823] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.056846] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056925] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.056938] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.056955] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.056992] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.057026] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.057045] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.057093] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.057127] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.057136] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.057155] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.057261] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.057277] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.057293] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.057309] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.057309] and [2016-07-07 03:10:45.057528] [2016-07-07 03:10:45.057567] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.057586] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.057681] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.057693] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.057761] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.057841] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.057862] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.057876] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.057876] and [2016-07-07 03:10:45.058039] [2016-07-07 03:10:45.058068] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.058094] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.058110] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.058232] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.058246] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.058298] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.058356] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.058470] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.058496] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.058510] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.058613] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.058658] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.058676] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.058719] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.058719] and [2016-07-07 03:10:45.058890] [2016-07-07 03:10:45.058937] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.058963] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.059057] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.059057] and [2016-07-07 03:10:45.059336] [2016-07-07 03:10:45.059342] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.059362] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.059543] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:45.059543] and [2016-07-07 03:10:45.059879] [2016-07-07 03:10:45.059921] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.059943] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.059969] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060027] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060046] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060066] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060159] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060182] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060212] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060223] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060264] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060283] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060504] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060520] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060556] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060607] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060623] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060701] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060755] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060767] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060798] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060846] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060905] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.060927] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.060947] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.060994] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.061009] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.061093] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.061112] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.061121] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.061284] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 14 times between [2016-07-07 03:10:45.061284] and [2016-07-07 03:10:45.063487] [2016-07-07 03:10:45.063730] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.063754] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.063765] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.063772] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.063785] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.063793] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.063983] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064000] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064053] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064064] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064219] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064248] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.064393] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064406] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064468] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064479] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064520] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.064585] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064598] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064644] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.064710] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.064723] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.064734] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.064734] and [2016-07-07 03:10:45.066250] [2016-07-07 03:10:45.066889] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.066915] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.067193] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.068113] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.068164] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.068773] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.068823] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.068942] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.068971] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.069285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:41d684a1-d007-4b41-a9ec-5c276cc5ac67> (41d684a1-d007-4b41-a9ec-5c276cc5ac67) [Input/output error] [2016-07-07 03:10:45.070113] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.070658] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.070681] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.070687] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.070700] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.071397] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.071693] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.071705] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.072471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:c4243a9c-050c-401f-88c4-471c5289e4c5> (c4243a9c-050c-401f-88c4-471c5289e4c5) [Input/output error] [2016-07-07 03:10:45.072996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:9999ce72-432d-4633-a3c4-b58d6f4603b9> (9999ce72-432d-4633-a3c4-b58d6f4603b9) [Input/output error] [2016-07-07 03:10:45.073608] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.073608] and [2016-07-07 03:10:45.074203] [2016-07-07 03:10:45.074734] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.074906] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.075100] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.075124] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(c4243a9c-050c-401f-88c4-471c5289e4c5) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.075155] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.075166] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(9999ce72-432d-4633-a3c4-b58d6f4603b9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.076170] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.076170] and [2016-07-07 03:10:45.076477] [2016-07-07 03:10:45.076771] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.076796] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(d8182ff3-c587-4b64-9ce7-4da05a0bf0b2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.077124] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.078907] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.079712] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.080289] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.080306] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.080589] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.081493] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.082440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:2555e6eb-9457-4c2f-bf24-80716d7904b6> (2555e6eb-9457-4c2f-bf24-80716d7904b6) [Input/output error] [2016-07-07 03:10:45.082535] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.083288] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.083303] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(2555e6eb-9457-4c2f-bf24-80716d7904b6) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.083648] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.083648] and [2016-07-07 03:10:45.085092] [2016-07-07 03:10:45.085796] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.086337] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086351] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086389] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086399] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086436] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086451] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086497] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086510] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086552] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086562] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086617] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086648] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086741] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.086755] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.086880] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.086880] and [2016-07-07 03:10:45.087286] [2016-07-07 03:10:45.089090] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.089621] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.089621] and [2016-07-07 03:10:45.089714] [2016-07-07 03:10:45.090165] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:4e94fb7c-35ff-41d5-a2f3-e93e7cb3e804> (4e94fb7c-35ff-41d5-a2f3-e93e7cb3e804) [Input/output error] [2016-07-07 03:10:45.090219] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted]" repeated 3 times between [2016-07-07 03:10:45.090219] and [2016-07-07 03:10:45.090504] [2016-07-07 03:10:45.090519] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.090542] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.090779] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.090788] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.090843] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.090852] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.091660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:b788588f-885a-45a0-bc26-7ebc6717a51a> (b788588f-885a-45a0-bc26-7ebc6717a51a) [Input/output error] The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:b788588f-885a-45a0-bc26-7ebc6717a51a> (b788588f-885a-45a0-bc26-7ebc6717a51a) [Input/output error]" repeated 2 times between [2016-07-07 03:10:45.091660] and [2016-07-07 03:10:45.092590] [2016-07-07 03:10:45.093186] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.093238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:b788588f-885a-45a0-bc26-7ebc6717a51a> (b788588f-885a-45a0-bc26-7ebc6717a51a) [Input/output error] [2016-07-07 03:10:45.093281] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:45.093281] and [2016-07-07 03:10:45.093933] [2016-07-07 03:10:45.094164] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.094188] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.094362] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.094379] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.094475] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.094487] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.094571] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.094578] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.094786] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:45.094786] and [2016-07-07 03:10:45.095874] [2016-07-07 03:10:45.096414] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.096436] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.096588] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.096600] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.096785] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.096785] and [2016-07-07 03:10:45.097661] [2016-07-07 03:10:45.097715] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] The message "W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory]" repeated 4 times between [2016-07-07 03:10:45.097715] and [2016-07-07 03:10:45.100065] [2016-07-07 03:10:45.100653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.100691] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.101295] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.101710] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.107480] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.108149] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.108163] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(418b4a6e-9153-481a-afe9-08df80021fd2) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.108500] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.108500] and [2016-07-07 03:10:45.109318] [2016-07-07 03:10:45.110197] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.110223] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.110448] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.110464] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.110694] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:45.110694] and [2016-07-07 03:10:45.111773] [2016-07-07 03:10:45.112586] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.112616] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.112664] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.112676] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.112951] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.112967] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.113009] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.113009] and [2016-07-07 03:10:45.114212] [2016-07-07 03:10:45.114624] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.114646] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.114948] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:45.114948] and [2016-07-07 03:10:45.116006] [2016-07-07 03:10:45.116894] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.116917] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.117135] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.117153] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.117164] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.117177] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.117225] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.117236] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.117286] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.117297] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.117375] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.117375] and [2016-07-07 03:10:45.118397] [2016-07-07 03:10:45.118824] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.118849] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(e4fa5d1e-3115-443a-ade9-8fc60f49b1ee) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.118919] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.118928] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.119209] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:45.119209] and [2016-07-07 03:10:45.120327] [2016-07-07 03:10:45.120382] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [No such file or directory] [2016-07-07 03:10:45.120986] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.121093] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.121138] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.121167] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(3f272b16-c488-43bf-9409-255e9ebe65fa) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.121235] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.121247] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.121294] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.121305] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.121477] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.121477] and [2016-07-07 03:10:45.121757] [2016-07-07 03:10:45.121812] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.121831] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.122010] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.122025] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.122174] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.122187] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.122236] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:45.122236] and [2016-07-07 03:10:45.124406] [2016-07-07 03:10:45.124499] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.124745] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.124759] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125092] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125108] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125240] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125254] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125336] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125350] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:377c654d-9163-4850-9b2b-03287ab385a8> (377c654d-9163-4850-9b2b-03287ab385a8) [Input/output error] [2016-07-07 03:10:45.125455] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.125524] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125536] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125589] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.125634] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125647] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125671] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-VMs-client-2: remote operation failed [Operation not permitted] [2016-07-07 03:10:45.125710] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125719] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125731] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.125738] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.125747] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 4 times between [2016-07-07 03:10:45.125747] and [2016-07-07 03:10:45.126734] [2016-07-07 03:10:45.126783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-VMs-client-2: remote operation failed. Path: <gfid:98957e76-9899-40bc-b197-76d6c11abad9> (98957e76-9899-40bc-b197-76d6c11abad9) [Input/output error] [2016-07-07 03:10:45.126949] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.126949] and [2016-07-07 03:10:45.127046] [2016-07-07 03:10:45.127525] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.127548] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.127609] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.127624] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.127759] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.127770] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(98957e76-9899-40bc-b197-76d6c11abad9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.127861] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.127861] and [2016-07-07 03:10:45.128787] [2016-07-07 03:10:45.129474] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.129495] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.129774] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.130463] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.131482] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.131501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(21ae8d43-34c0-4a76-90fe-47cbae31ce3d) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.131725] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.131725] and [2016-07-07 03:10:45.132562] [2016-07-07 03:10:45.133421] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.133441] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.133569] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.133580] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.133672] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 13 times between [2016-07-07 03:10:45.133672] and [2016-07-07 03:10:45.136308] [2016-07-07 03:10:45.136397] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.136420] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(b788588f-885a-45a0-bc26-7ebc6717a51a) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.136468] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.136484] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.136522] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.136531] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.136565] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.136574] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.136956] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.136968] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137031] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.137058] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137068] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137207] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137222] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137261] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.137320] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.137379] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137397] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137442] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.137498] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137509] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137546] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137559] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137594] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.137653] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137667] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137707] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.137716] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.137792] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 11 times between [2016-07-07 03:10:45.137792] and [2016-07-07 03:10:45.139132] [2016-07-07 03:10:45.139968] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.139995] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.140209] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.140221] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.140257] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.140267] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.140298] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.140306] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.140339] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.140347] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.140406] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:45.140406] and [2016-07-07 03:10:45.141511] [2016-07-07 03:10:45.142493] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.142517] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.142841] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.142841] and [2016-07-07 03:10:45.143910] [2016-07-07 03:10:45.145096] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.145119] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.145157] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.145166] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.145176] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.145183] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.145339] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.145355] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.145393] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.145403] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.145435] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.145444] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.145583] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.145583] and [2016-07-07 03:10:45.146815] [2016-07-07 03:10:45.147862] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.147882] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.148097] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.148097] and [2016-07-07 03:10:45.149626] [2016-07-07 03:10:45.150069] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150090] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150306] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150315] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150324] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150331] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150343] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150350] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150555] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150566] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150605] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.150665] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150677] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150796] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.150817] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.150827] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.150884] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 5 times between [2016-07-07 03:10:45.150884] and [2016-07-07 03:10:45.152021] [2016-07-07 03:10:45.153057] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.153080] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.153356] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.153356] and [2016-07-07 03:10:45.154727] [2016-07-07 03:10:45.155196] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.155220] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.155435] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.155445] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.155672] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.155687] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.155701] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.155714] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.155913] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.155926] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.155977] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.156042] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.156054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.156112] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 14 times between [2016-07-07 03:10:45.156112] and [2016-07-07 03:10:45.157895] [2016-07-07 03:10:45.158106] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.158127] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.158631] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.158647] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.158880] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.158893] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.158932] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.158942] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.158981] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.159049] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.159065] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.159113] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.159123] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.159160] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.159169] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.159212] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.159279] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.159291] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.159332] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.159384] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.159396] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.159436] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.159490] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.159501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.159541] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 13 times between [2016-07-07 03:10:45.159541] and [2016-07-07 03:10:45.161157] [2016-07-07 03:10:45.161454] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.161477] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162400] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162418] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162446] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.162509] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162521] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162543] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162551] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162612] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162628] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162654] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162666] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162731] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162746] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162807] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.162818] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.162877] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:45.162877] and [2016-07-07 03:10:45.164424] [2016-07-07 03:10:45.165741] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.165764] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.165801] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.165811] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.165995] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.166007] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.166045] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.166054] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.166085] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.166094] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.166126] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.166135] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.166183] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 12 times between [2016-07-07 03:10:45.166183] and [2016-07-07 03:10:45.167604] [2016-07-07 03:10:45.167941] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.167962] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168485] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.168501] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168579] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.168642] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.168654] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168727] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.168737] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168775] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.168833] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.168844] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168885] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.168894] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168928] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.168937] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.168971] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.168971] and [2016-07-07 03:10:45.170066] [2016-07-07 03:10:45.170508] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.170529] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.170568] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.170577] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.170808] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.170808] and [2016-07-07 03:10:45.172030] [2016-07-07 03:10:45.172631] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.172655] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.172863] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.172878] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.172890] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.172898] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.173115] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.173131] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.173362] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.173372] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.173417] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.173426] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.173463] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 7 times between [2016-07-07 03:10:45.173463] and [2016-07-07 03:10:45.174618] [2016-07-07 03:10:45.175164] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.175184] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.175453] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.175468] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.175691] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 10 times between [2016-07-07 03:10:45.175691] and [2016-07-07 03:10:45.177082] [2016-07-07 03:10:45.177327] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.177349] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.177813] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.177828] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178106] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178123] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178173] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.178232] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178244] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178257] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.178310] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178321] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178331] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178338] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178351] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178368] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178400] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.178453] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178464] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178509] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.178518] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.178604] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 11 times between [2016-07-07 03:10:45.178604] and [2016-07-07 03:10:45.180123] [2016-07-07 03:10:45.180833] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.180852] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.181083] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.181099] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.181139] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.181148] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.181326] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.181339] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.181377] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.181386] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.181415] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.181569] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.181625] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.181642] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.181682] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 6 times between [2016-07-07 03:10:45.181682] and [2016-07-07 03:10:45.183048] [2016-07-07 03:10:45.183625] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.183651] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.184099] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.184111] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.184149] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.184158] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.184293] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 3 times between [2016-07-07 03:10:45.184293] and [2016-07-07 03:10:45.185075] [2016-07-07 03:10:45.185908] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.185930] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.186497] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.186497] and [2016-07-07 03:10:45.187541] [2016-07-07 03:10:45.188045] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.188066] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.188192] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.188203] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.188402] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.188402] and [2016-07-07 03:10:45.189281] [2016-07-07 03:10:45.190314] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.190333] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(6b5f8c30-040b-4905-aa96-47348e9f8be9) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.190555] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.450625] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:45.453299] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.453370] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.453724] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.453724] and [2016-07-07 03:10:45.459245] [2016-07-07 03:10:45.461207] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.461230] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.461483] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:45.461502] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:45.461704] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:45.461704] and [2016-07-07 03:10:46.452910] [2016-07-07 03:10:46.455748] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:46.455781] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:46.456189] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:46.456189] and [2016-07-07 03:10:46.460908] [2016-07-07 03:10:46.462755] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:46.462783] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:46.462847] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:46.462860] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(7a2d02bf-4c06-4d0d-a1e4-84684a5aa5e4) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:46.463022] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] The message "W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state]" repeated 2 times between [2016-07-07 03:10:46.463022] and [2016-07-07 03:10:47.452992] [2016-07-07 03:10:47.455618] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:47.455703] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(45b14fac-d5aa-4732-9580-e90a12af6118) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:47.456390] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:47.460811] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:47.462841] W [MSGID: 114031] [client-rpc-fops.c:1031:client3_3_fsync_cbk] 0-VMs-client-2: remote operation failed [Invalid argument] [2016-07-07 03:10:47.462862] W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(4cf1e749-4258-42df-b690-cfbdacb68d9e) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument] [2016-07-07 03:10:47.463169] W [MSGID: 114031] [client-rpc-fops.c:1917:client3_3_fxattrop_cbk] 0-VMs-client-2: remote operation failed [File descriptor in bad state] [2016-07-07 03:10:47.692270] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-VMs-client-2: disconnected from VMs-client-2. Client process will keep trying to connect to glusterd until brick's port is available [2016-07-07 03:10:57.856078] E [MSGID: 114058] [client-handshake.c:1524:client_query_portmap_cbk] 0-VMs-client-2: failed to get the port number for remote subvolume. Please run 'gluster volume status' on server to see if brick process is running. [2016-07-07 03:10:57.856102] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-VMs-client-2: disconnected from VMs-client-2. Client process will keep trying to connect to glusterd until brick's port is available The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(93d20afe-384d-4a87-ae5e-0b9d59282604) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 3 times between [2016-07-07 03:10:37.954258] and [2016-07-07 03:10:37.955202] The message "W [MSGID: 108035] [afr-transaction.c:1734:afr_changelog_fsync_cbk] 0-VMs-replicate-0: fsync(89f0bfc7-4cf3-4954-ab1a-d2e753b557ab) failed on subvolume VMs-client-2. Transaction was WRITE [Invalid argument]" repeated 4 times between [2016-07-07 03:10:40.406354] and [2016-07-07 03:10:41.468827] [2016-07-07 07:18:21.870569] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
Attachment:
signature.asc
Description: Digital signature
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users
