Re: setfacl: testfile: Remote I/O error (zfsonlinux, gluster 3.6, CentOS 6.6)

Kiran Patil <kiran@xxxxxxxxxxxxx> · Tue, 25 Nov 2014 11:06:31 +0530

We found that it is not gluster issue but zfs.
[root@fractal-c92e mnt]# touch testfile

[root@fractal-c92e mnt]# setfacl -m u:14:r testfile
setfacl: testfile: Operation not supported

Thanks,
Kiran

On Tue, Nov 25, 2014 at 10:59 AM, Kiran Patil <kiran@xxxxxxxxxxxxx> wrote:
d-backends-brick0.log file contents:-----------------------------------------------
[2014-11-25 05:11:33.080409] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd version 3.6.1 (args: /usr/local/sbin/glusterfsd -s fractal-c92e.fractal.lan --volfile-id patchy.fractal-c92e.fractal.lan.d-backends-brick0 -p /var/lib/glusterd/vols/patchy/run/fractal-c92e.fractal.lan-d-backends-brick0.pid -S /var/run/cfe03a7c541a9c1c850d543e6e0918ac.socket --brick-name /d/backends/brick0 -l /var/log/glusterfs/bricks/d-backends-brick0.log --xlator-option *-posix.glusterd-uuid=c96fcb89-965a-4c5c-902a-6a9a80441119 --brick-port 49152 --xlator-option patchy-server.listen-port=49152)
[2014-11-25 05:11:33.116700] I [graph.c:269:gf_add_cmdline_options] 0-patchy-server: adding option 'listen-port' for volume 'patchy-server' with value '49152'
[2014-11-25 05:11:33.116761] I [graph.c:269:gf_add_cmdline_options] 0-patchy-posix: adding option 'glusterd-uuid' for volume 'patchy-posix' with value 'c96fcb89-965a-4c5c-902a-6a9a80441119'
[2014-11-25 05:11:33.119334] I [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
[2014-11-25 05:11:33.119548] W [options.c:898:xl_opt_validate] 0-patchy-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
[2014-11-25 05:11:33.174277] W [posix.c:5681:init] 0-patchy-posix: Posix access control list is not supported.
[2014-11-25 05:11:33.181185] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2014-11-25 05:11:33.181295] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-unix' is not recognized
[2014-11-25 05:11:33.181337] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-null' is not recognized
[2014-11-25 05:11:33.181406] W [graph.c:344:_log_if_unknown_option] 0-patchy-quota: option 'timeout' is not recognized
Final graph:
+------------------------------------------------------------------------------+
  1: volume patchy-posix
  2:     type storage/posix
  3:     option glusterd-uuid c96fcb89-965a-4c5c-902a-6a9a80441119
  4:     option directory /d/backends/brick0
  5:     option volume-id 3338a2e4-7c97-4462-854e-e0eee73dc707
  6: end-volume
  7:  
  8: volume patchy-changelog
  9:     type features/changelog
 10:     option changelog-brick /d/backends/brick0
 11:     option changelog-dir /d/backends/brick0/.glusterfs/changelogs
 12:     option changelog-barrier-timeout 120
 13:     subvolumes patchy-posix
 14: end-volume
 15:  
 16: volume patchy-access-control
 17:     type features/access-control
 18:     subvolumes patchy-changelog
 19: end-volume
 20:  
 21: volume patchy-locks
 22:     type features/locks
 23:     subvolumes patchy-access-control
 24: end-volume
 25:  
 26: volume patchy-io-threads
 27:     type performance/io-threads
 28:     subvolumes patchy-locks
 29: end-volume
 30:  
 31: volume patchy-barrier
 32:     type features/barrier
 33:     option barrier disable
 34:     option barrier-timeout 120
 35:     subvolumes patchy-io-threads
 36: end-volume
 37:  
 38: volume patchy-index
 39:     type features/index
 40:     option index-base /d/backends/brick0/.glusterfs/indices
 41:     subvolumes patchy-barrier
 42: end-volume
 43:  
 44: volume patchy-marker
 45:     type features/marker
 46:     option volume-uuid 3338a2e4-7c97-4462-854e-e0eee73dc707
 47:     option timestamp-file /var/lib/glusterd/vols/patchy/marker.tstamp
 48:     option xtime off
 49:     option gsync-force-xtime off
 50:     option quota off
 51:     subvolumes patchy-index
 52: end-volume
 53:  
 54: volume patchy-quota
 55:     type features/quota
 56:     option volume-uuid patchy
 57:     option server-quota off
 58:     option timeout 0
 59:     option deem-statfs off
 60:     subvolumes patchy-marker
 61: end-volume
 62:  
 63: volume /d/backends/brick0
 64:     type debug/io-stats
 65:     option latency-measurement off
 66:     option count-fop-hits off
 67:     subvolumes patchy-quota
 68: end-volume
 69:  
 70: volume patchy-server
 71:     type protocol/server
 72:     option transport.socket.listen-port 49152
 73:     option rpc-auth.auth-glusterfs on
 74:     option rpc-auth.auth-unix on
 75:     option rpc-auth.auth-null on
 76:     option transport-type tcp
 77:     option auth.login./d/backends/brick0.allow 2725ffee-f51f-4553-a3dc-143f69b50115
 78:     option auth.login.2725ffee-f51f-4553-a3dc-143f69b50115.password 18f7d813-349b-476e-81a5-3d348e661d60
 79:     option auth.addr./d/backends/brick0.allow *
 80:     subvolumes /d/backends/brick0
 81: end-volume
 82:  
+------------------------------------------------------------------------------+
[2014-11-25 05:11:37.098820] I [login.c:82:gf_auth] 0-auth/login: allowed user names: 2725ffee-f51f-4553-a3dc-143f69b50115
[2014-11-25 05:11:37.098881] I [server-handshake.c:585:server_setvolume] 0-patchy-server: accepted client from fractal-c92e.fractal.lan-2793-2014/11/25-05:11:33:79268-patchy-client-0-0-0 (version: 3.6.1)
[2014-11-25 05:12:49.700853] E [posix-helpers.c:939:posix_handle_pair] 0-patchy-posix: /d/backends/brick0/.glusterfs/b4/9b/b49bdf80-6af2-4750-a8ad-fdb56920657a: key:system.posix_acl_access flags: 0 length:44 error:Operation not supported

Thanks,
Kiran

On Tue, Nov 25, 2014 at 12:10 AM, Vijay Bellur <vbellur@xxxxxxxxxx> wrote:
On 11/24/2014 05:55 PM, Kiran Patil wrote:

getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0

lstat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0

getxattr("testfile", "system.posix_acl_access", 0x7fff9ce10d00, 132) =

-1 ENODATA (No data available)

stat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0

setxattr("testfile", "system.posix_acl_access",

"\x02\x00\x00\x00\x01\x00\x06\x00\xff\xff\xff\xff\x02\x00\x04\x00\x0e\x00\x00\x00\x04\x00\x04\x00\xff\xff\xff\xff\x10\x00\x04\x00\xff\xff\xff\xff

\x00\x04\x00\xff\xff\xff\xff", 44, 0) = -1 EREMOTEIO (Remote I/O error)

Do you happen to know from the logs which translator sends back this error? Logs from the brick that contain "testfile" and the nfs server to which the nfs client is connected would be a good place to begin with.

Thanks,

Vijay

_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-devel