Hi Soumya,
Please find attached nfs.log file.On Wed, May 4, 2016 at 11:45 AM, ABHISHEK PALIWAL <abhishpaliwal@xxxxxxxxx> wrote:
AbhishekYes, I am getting following error in /var/log/glusterfs/nfs.log fileHI Soumya,Thanks for reply.
[2016-04-25 06:27:23.721851] E [MSGID: 112109] [nfs.c:1482:init] 0-nfs: Failed to initialize protocolsPlease suggest me how can I resolve it.Regards,--On Wed, May 4, 2016 at 11:33 AM, Soumya Koduri <skoduri@xxxxxxxxxx> wrote:Hi Abhishek,
Below 'rpcinfo' output doesn't list 'nfsacl' protocol. That must be the reason client is not able set ACLs. Could you please check the log file '/var/lib/glusterfs/nfs.log' if there are any errors logged with respect protocol registration failures.
Thanks,
Soumya
On 05/04/2016 11:15 AM, ABHISHEK PALIWAL wrote:
Hi Niels,
Please reply it is really urgent.
Regards,
Abhishek
On Tue, May 3, 2016 at 11:36 AM, ABHISHEK PALIWAL
<abhishpaliwal@xxxxxxxxx <mailto:abhishpaliwal@xxxxxxxxx>> wrote:
Hi Niels,
Do you require more logs...
Regards,
Abhishek
On Mon, May 2, 2016 at 4:58 PM, ABHISHEK PALIWAL<abhishpaliwal@xxxxxxxxx <mailto:abhishpaliwal@xxxxxxxxx>> wrote:
Hi Niels,
Here is the output of rpcinfo -p $NFS_SERVER
root@128:/# rpcinfo -p $NFS_SERVER
program vers proto port service
100000 4 tcp 111 portmapper
100000 3 tcp 111 portmapper
100000 2 tcp 111 portmapper
100000 4 udp 111 portmapper
100000 3 udp 111 portmapper
100000 2 udp 111 portmapper
100005 3 tcp 38465 mountd
100005 1 tcp 38465 mountd
100003 3 tcp 38465 nfs
100227 3 tcp 38465
out of mount command
#mount -vvv -t nfs -o acl,vers=3 128.224.95.140:/gv0 /tmp/e
mount: fstab path: "/etc/fstab"
mount: mtab path: "/etc/mtab"
mount: lock path: "/etc/mtab~"
mount: temp path: "/etc/mtab.tmp"
mount: UID: 0
mount: eUID: 0
mount: spec: "128.224.95.140:/gv0"
mount: node: "/tmp/e"
mount: types: "nfs"
mount: opts: "acl,vers=3"
mount: external mount: argv[0] = "/sbin/mount.nfs"
mount: external mount: argv[1] = "128.224.95.140:/gv0"
mount: external mount: argv[2] = "/tmp/e"
mount: external mount: argv[3] = "-v"
mount: external mount: argv[4] = "-o"
mount: external mount: argv[5] = "rw,acl,vers=3"
mount.nfs: timeout set for Mon May 2 16:58:58 2016
mount.nfs: trying text-based options
'acl,vers=3,addr=128.224.95.140'
mount.nfs: prog 100003, trying vers=3, prot=6
mount.nfs: trying 128.224.95.140 prog 100003 vers 3 prot TCP
port 38465
mount.nfs: prog 100005, trying vers=3, prot=17
mount.nfs: portmap query retrying: RPC: Program not registered
mount.nfs: prog 100005, trying vers=3, prot=6
mount.nfs: trying 128.224.95.140 prog 100005 vers 3 prot TCP
port 38465
On Mon, May 2, 2016 at 4:36 PM, Niels de Vos <ndevos@xxxxxxxxxx> Gluster-devel@xxxxxxxxxxx <mailto:Gluster-devel@xxxxxxxxxxx><mailto:ndevos@xxxxxxxxxx>> wrote:
On Mon, May 02, 2016 at 04:14:01PM +0530, ABHISHEK PALIWAL
wrote:
> HI Team,
>
> I am exporting gluster volume using GlusterNFS with ACL
support but at NFS
> client while running 'setfacl' command getting "setfacl:
/tmp/e: Remote I/O
> error"
>
>
> Following is the NFS option status for Volume:
>
> nfs.enable-ino32
> no
> nfs.mem-factor
> 15
> nfs.export-dirs
> on
> nfs.export-volumes
> on
> nfs.addr-namelookup
> off
> nfs.dynamic-volumes
> off
> nfs.register-with-portmap
> on
> nfs.outstanding-rpc-limit
> 16
> nfs.port
> 38465
> nfs.rpc-auth-unix
> on
> nfs.rpc-auth-null
> on
> nfs.rpc-auth-allow
> all
> nfs.rpc-auth-reject
> none
> nfs.ports-insecure
> off
> nfs.trusted-sync
> off
> nfs.trusted-write
> off
> nfs.volume-access
> read-write
> nfs.export-dir
>
> nfs.disable
> off
> nfs.nlm
> on
> nfs.acl
> on
> nfs.mount-udp
> off
> nfs.mount-rmtab
> /var/lib/glusterd/nfs/rmtab
> nfs.rpc-statd
> /sbin/rpc.statd
> nfs.server-aux-gids
> off
> nfs.drc
> off
> nfs.drc-size
> 0x20000
> nfs.read-size (1 *
> 1048576ULL)
> nfs.write-size (1 *
> 1048576ULL)
> nfs.readdir-size (1 *
> 1048576ULL)
> nfs.exports-auth-enable
> (null)
> nfs.auth-refresh-interval-sec
> (null)
> nfs.auth-cache-ttl-sec (null)
>
> Command to mount exported gluster volume on NFS client is
>
> mount -v -t nfs -o acl,vers=3 128.224.95.140:/gv0 /tmp/e
Could you post the output of mounting with 'mount -vvv ...'?
In previous
emails I've asked for the output of 'rpcinfo -p
$NFS_SERVER', I do not
think I've seen that yet.
The port used for NFSv3 ACLs on the NFS-server should be
listed in
'netstat -tulpen' and the PID of the process should be the
one of the
Gluster/NFS service.
HTH,
Niels
> setfacl -m u:nobody:r /tmp/e
> setfacl: /tmp/e: Remote I/O error
>
> --
>
>
>
>
> Regards
> Abhishek Paliwal
> _______________________________________________
> Gluster-devel mailing list
> http://www.gluster.org/mailman/listinfo/gluster-devel
--
Regards
Abhishek Paliwal
--
Regards
Abhishek Paliwal
--
Regards
Abhishek Paliwal
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
Regards
Abhishek Paliwal
--
Regards
Abhishek Paliwal
[2016-04-25 06:27:23.569911] I [MSGID: 100030] [glusterfsd.c:2318:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.6 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/00912f6f44e8c281cafca6b46971bec1.socket) [2016-04-25 06:27:23.597806] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-04-25 06:27:23.690320] W [MSGID: 112100] [nfs.c:1078:nfs_init_state] 0-nfs: /sbin/rpc.statd not enough permissions to access. Disabling NLM [Operation not permitted] [2016-04-25 06:27:23.690388] W [MSGID: 112101] [nfs.c:1085:nfs_init_state] 0-nfs: /sbin/rpc.statd not a regular file. Disabling NLM [2016-04-25 06:27:23.691028] I [rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-04-25 06:27:23.718994] W [MSGID: 112153] [mount3.c:3929:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-04-25 06:27:23.721788] E [rpcsvc.c:1370:rpcsvc_program_register_portmap] 0-rpc-service: Could not register with portmap 100005 3 38465 [2016-04-25 06:27:23.721817] E [MSGID: 112088] [nfs.c:341:nfs_init_versions] 0-nfs: Required program MOUNT3 registration failed [2016-04-25 06:27:23.721851] E [MSGID: 112109] [nfs.c:1482:init] 0-nfs: Failed to initialize protocols [2016-04-25 06:27:23.721877] E [MSGID: 101019] [xlator.c:428:xlator_init] 0-nfs-server: Initialization of volume 'nfs-server' failed, review your volfile again [2016-04-25 06:27:23.721903] E [graph.c:322:glusterfs_graph_init] 0-nfs-server: initializing translator failed [2016-04-25 06:27:23.721921] E [graph.c:661:glusterfs_graph_activate] 0-graph: init failed [2016-04-25 06:27:23.722785] W [glusterfsd.c:1236:cleanup_and_exit] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk-0x15ce8) [0x1000fb58] -->/usr/sbin/glusterfs(glusterfs_process_volfp-0x1b1c8) [0x1000a318] -->/usr/sbin/glusterfs(cleanup_and_exit-0x1bd8c) [0x100096dc] ) 0-: received signum (0), shutting down [2016-04-25 06:28:43.079756] I [MSGID: 100030] [glusterfsd.c:2318:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.6 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/00912f6f44e8c281cafca6b46971bec1.socket) [2016-04-25 06:28:43.101003] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-04-25 06:28:43.112051] W [MSGID: 112100] [nfs.c:1078:nfs_init_state] 0-nfs: /sbin/rpc.statd not enough permissions to access. Disabling NLM [Operation not permitted] [2016-04-25 06:28:43.112116] W [MSGID: 112101] [nfs.c:1085:nfs_init_state] 0-nfs: /sbin/rpc.statd not a regular file. Disabling NLM [2016-04-25 06:28:43.112778] I [rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-04-25 06:28:43.139539] W [MSGID: 112153] [mount3.c:3929:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-04-25 06:28:43.148721] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-04-25 06:28:43.148766] I [MSGID: 112110] [nfs.c:1494:init] 0-nfs: NFS service started [2016-04-25 06:28:43.151544] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-04-25 06:28:43.152271] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth.auth-glusterfs' is not recognized [2016-04-25 06:28:43.152339] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth-allow-insecure' is not recognized [2016-04-25 06:28:43.152391] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'transport-type' is not recognized [2016-04-25 06:28:43.153750] I [MSGID: 114020] [client.c:2118:notify] 0-gv0-client-0: parent translators are ready, attempting connect on transport Final graph: +------------------------------------------------------------------------------+ 1: volume gv0-client-0 2: type protocol/client 3: option ping-timeout 42 4: option remote-host 128.224.95.140 5: option remote-subvolume /tmp/brick 6: option transport-type socket 7: option username 42205a53-c435-47ac-b141-7b440ab50551 8: option password 7effea8e-d115-4271-8050-1888682ee77e 9: option send-gids true 10: end-volume 11: 12: volume gv0-dht 13: type cluster/distribute [2016-04-25 06:28:43.155750] I [rpc-clnt.c:1847:rpc_clnt_reconfig] 0-gv0-client-0: changing port to 49152 (from 0) 14: subvolumes gv0-client-0 15: end-volume 16: 17: volume gv0-write-behind 18: type performance/write-behind 19: subvolumes gv0-dht 20: end-volume 21: 22: volume gv0 23: type debug/io-stats 24: option latency-measurement off 25: option count-fop-hits off 26: subvolumes gv0-write-behind 27: end-volume 28: 29: volume nfs-server 30: type nfs/server 31: option rpc-auth.auth-glusterfs on 32: option rpc-auth.auth-unix on 33: option rpc-auth.auth-null on 34: option rpc-auth.ports.insecure on 35: option rpc-auth-allow-insecure on 36: option transport-type socket 37: option transport.socket.listen-port 2049 38: option nfs.dynamic-volumes on 39: option nfs.nlm on 40: option nfs.drc off 41: option rpc-auth.addr.gv0.allow * 42: option nfs3.gv0.volume-id ab2592da-754a-41cb-9b04-0bc8592f1ab2 43: subvolumes gv0 44: end-volume 45: +------------------------------------------------------------------------------+ [2016-04-25 06:28:43.157424] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-gv0-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-04-25 06:28:43.165158] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-gv0-client-0: Connected to gv0-client-0, attached to remote volume '/tmp/brick'. [2016-04-25 06:28:43.165220] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-gv0-client-0: Server and Client lk-version numbers are not same, reopening the fds [2016-04-25 06:28:43.170061] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-gv0-client-0: Server lk version = 1 [2016-04-25 06:28:43.172523] I [MSGID: 109063] [dht-layout.c:702:dht_layout_normalize] 0-gv0-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-000000000001). Holes=1 overlaps=0 [2016-04-25 06:28:43.173630] I [MSGID: 109036] [dht-common.c:7869:dht_log_new_layout_for_dir_selfheal] 0-gv0-dht: Setting layout of / with [Subvol_name: gv0-client-0, Err: -1 , Start: 0 , Stop: 4294967295 , Hash: 1 ],
_______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-devel
