Re: setfacl: testfile: Remote I/O error (zfsonlinux, gluster 3.6, CentOS 6.6)

[Kiran Patil <kiran@xxxxxxxxxxxxx>]

zfs set acltype=posixacl mnt resolved the issue.

Thanks,

Kiran.

On Tue, Nov 25, 2014 at 11:06 AM, Kiran Patil <kiran@xxxxxxxxxxxxx> wrote:

We found that it is not gluster issue but zfs.

[root@fractal-c92e mnt]# touch testfile

[root@fractal-c92e mnt]# setfacl -m u:14:r testfile

setfacl: testfile: Operation not supported

Thanks,

Kiran

On Tue, Nov 25, 2014 at 10:59 AM, Kiran Patil <kiran@xxxxxxxxxxxxx> wrote:

d-backends-brick0.log file contents:

-----------------------------------------------

[2014-11-25 05:11:33.080409] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd version 3.6.1 (args: /usr/local/sbin/glusterfsd -s fractal-c92e.fractal.lan --volfile-id patchy.fractal-c92e.fractal.lan.d-backends-brick0 -p /var/lib/glusterd/vols/patchy/run/fractal-c92e.fractal.lan-d-backends-brick0.pid -S /var/run/cfe03a7c541a9c1c850d543e6e0918ac.socket --brick-name /d/backends/brick0 -l /var/log/glusterfs/bricks/d-backends-brick0.log --xlator-option *-posix.glusterd-uuid=c96fcb89-965a-4c5c-902a-6a9a80441119 --brick-port 49152 --xlator-option patchy-server.listen-port=49152)

[2014-11-25 05:11:33.116700] I [graph.c:269:gf_add_cmdline_options] 0-patchy-server: adding option 'listen-port' for volume 'patchy-server' with value '49152'

[2014-11-25 05:11:33.116761] I [graph.c:269:gf_add_cmdline_options] 0-patchy-posix: adding option 'glusterd-uuid' for volume 'patchy-posix' with value 'c96fcb89-965a-4c5c-902a-6a9a80441119'

[2014-11-25 05:11:33.119334] I [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64

[2014-11-25 05:11:33.119548] W [options.c:898:xl_opt_validate] 0-patchy-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction

[2014-11-25 05:11:33.174277] W [posix.c:5681:init] 0-patchy-posix: Posix access control list is not supported.

[2014-11-25 05:11:33.181185] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-glusterfs' is not recognized

[2014-11-25 05:11:33.181295] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-unix' is not recognized

[2014-11-25 05:11:33.181337] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-null' is not recognized

[2014-11-25 05:11:33.181406] W [graph.c:344:_log_if_unknown_option] 0-patchy-quota: option 'timeout' is not recognized

Final graph:

+------------------------------------------------------------------------------+

  1: volume patchy-posix

  2:     type storage/posix

  3:     option glusterd-uuid c96fcb89-965a-4c5c-902a-6a9a80441119

  4:     option directory /d/backends/brick0

  5:     option volume-id 3338a2e4-7c97-4462-854e-e0eee73dc707

  6: end-volume

  7:  

  8: volume patchy-changelog

  9:     type features/changelog

 10:     option changelog-brick /d/backends/brick0

 11:     option changelog-dir /d/backends/brick0/.glusterfs/changelogs

 12:     option changelog-barrier-timeout 120

 13:     subvolumes patchy-posix

 14: end-volume

 15:  

 16: volume patchy-access-control

 17:     type features/access-control

 18:     subvolumes patchy-changelog

 19: end-volume

 20:  

 21: volume patchy-locks

 22:     type features/locks

 23:     subvolumes patchy-access-control

 24: end-volume

 25:  

 26: volume patchy-io-threads

 27:     type performance/io-threads

 28:     subvolumes patchy-locks

 29: end-volume

 30:  

 31: volume patchy-barrier

 32:     type features/barrier

 33:     option barrier disable

 34:     option barrier-timeout 120

 35:     subvolumes patchy-io-threads

 36: end-volume

 37:  

 38: volume patchy-index

 39:     type features/index

 40:     option index-base /d/backends/brick0/.glusterfs/indices

 41:     subvolumes patchy-barrier

 42: end-volume

 43:  

 44: volume patchy-marker

 45:     type features/marker

 46:     option volume-uuid 3338a2e4-7c97-4462-854e-e0eee73dc707

 47:     option timestamp-file /var/lib/glusterd/vols/patchy/marker.tstamp

 48:     option xtime off

 49:     option gsync-force-xtime off

 50:     option quota off

 51:     subvolumes patchy-index

 52: end-volume

 53:  

 54: volume patchy-quota

 55:     type features/quota

 56:     option volume-uuid patchy

 57:     option server-quota off

 58:     option timeout 0

 59:     option deem-statfs off

 60:     subvolumes patchy-marker

 61: end-volume

 62:  

 63: volume /d/backends/brick0

 64:     type debug/io-stats

 65:     option latency-measurement off

 66:     option count-fop-hits off

 67:     subvolumes patchy-quota

 68: end-volume

 69:  

 70: volume patchy-server

 71:     type protocol/server

 72:     option transport.socket.listen-port 49152

 73:     option rpc-auth.auth-glusterfs on

 74:     option rpc-auth.auth-unix on

 75:     option rpc-auth.auth-null on

 76:     option transport-type tcp

 77:     option auth.login./d/backends/brick0.allow 2725ffee-f51f-4553-a3dc-143f69b50115

 78:     option auth.login.2725ffee-f51f-4553-a3dc-143f69b50115.password 18f7d813-349b-476e-81a5-3d348e661d60

 79:     option auth.addr./d/backends/brick0.allow *

 80:     subvolumes /d/backends/brick0

 81: end-volume

 82:  

+------------------------------------------------------------------------------+

[2014-11-25 05:11:37.098820] I [login.c:82:gf_auth] 0-auth/login: allowed user names: 2725ffee-f51f-4553-a3dc-143f69b50115

[2014-11-25 05:11:37.098881] I [server-handshake.c:585:server_setvolume] 0-patchy-server: accepted client from fractal-c92e.fractal.lan-2793-2014/11/25-05:11:33:79268-patchy-client-0-0-0 (version: 3.6.1)

[2014-11-25 05:12:49.700853] E [posix-helpers.c:939:posix_handle_pair] 0-patchy-posix: /d/backends/brick0/.glusterfs/b4/9b/b49bdf80-6af2-4750-a8ad-fdb56920657a: key:system.posix_acl_access flags: 0 length:44 error:Operation not supported

Thanks,

Kiran

On Tue, Nov 25, 2014 at 12:10 AM, Vijay Bellur <vbellur@xxxxxxxxxx> wrote:

On 11/24/2014 05:55 PM, Kiran Patil wrote:

getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0
lstat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
getxattr("testfile", "system.posix_acl_access", 0x7fff9ce10d00, 132) =
-1 ENODATA (No data available)
stat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
setxattr("testfile", "system.posix_acl_access",
"\x02\x00\x00\x00\x01\x00\x06\x00\xff\xff\xff\xff\x02\x00\x04\x00\x0e\x00\x00\x00\x04\x00\x04\x00\xff\xff\xff\xff\x10\x00\x04\x00\xff\xff\xff\xff
\x00\x04\x00\xff\xff\xff\xff", 44, 0) = -1 EREMOTEIO (Remote I/O error)

Do you happen to know from the logs which translator sends back this error? Logs from the brick that contain "testfile" and the nfs server to which the nfs client is connected would be a good place to begin with.

Thanks,
Vijay

_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-devel