We upgraded from 5.10 or 5.11 (can't remember) to 6.8 a few months ago and I see a lot of these type of "Permission denied" errors in our brick logs as well.
[2020-05-24 00:52:43.681065] I [MSGID: 115060] [server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server: 35337278: SETXATTR /user/public_html/xdf_applications (96e88263-71ae-4228-997b-f4d47fcebc39) ==> set-ctime-mdata, client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control
[2020-05-24 00:52:43.681080] I [MSGID: 115060] [server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control [Permission denied]
[2020-05-24 00:52:43.968633] I [MSGID: 139001] [posix-acl.c:263:posix_acl_log_permit_denied] 0-homes-access-control: client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, gfid: db01821c-6402-4ce5-bba6-41cdedb98191, req(uid:48,gid:48,perm:2,ngrps:1), ctx(uid:957,gid:957,in-groups:0,perm:664,updated-fop:LOOKUP, acl:-) [Permission denied]
[2020-05-24 00:52:43.968671] I [MSGID: 115060] [server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server: 35337285: SETXATTR /user/public_html/.htaccess (db01821c-6402-4ce5-bba6-41cdedb98191) ==> set-ctime-mdata, client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control
[2020-05-24 00:52:43.968683] I [MSGID: 115060] [server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control [Permission denied]
[2020-05-24 00:52:43.681080] I [MSGID: 115060] [server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control [Permission denied]
[2020-05-24 00:52:43.968633] I [MSGID: 139001] [posix-acl.c:263:posix_acl_log_permit_denied] 0-homes-access-control: client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, gfid: db01821c-6402-4ce5-bba6-41cdedb98191, req(uid:48,gid:48,perm:2,ngrps:1), ctx(uid:957,gid:957,in-groups:0,perm:664,updated-fop:LOOKUP, acl:-) [Permission denied]
[2020-05-24 00:52:43.968671] I [MSGID: 115060] [server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server: 35337285: SETXATTR /user/public_html/.htaccess (db01821c-6402-4ce5-bba6-41cdedb98191) ==> set-ctime-mdata, client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control
[2020-05-24 00:52:43.968683] I [MSGID: 115060] [server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client: CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, error-xlator: homes-access-control [Permission denied]
There are thousands of these in my brick logs over the past months. Volume is distribute replicate with replica 2 on GlusterFS 6.8. Client is 6.8. Underlying filesystem on the bricks is XFS. As far as I can see there is no problem accessing any of these files from the FUSE mount, so I don't even know what permission denied means in this context.
Hope that with the troubleshooting. Cheers!
On Tue, Apr 21, 2020 at 8:00 PM Amar Tumballi <amar@xxxxxxxxx> wrote:
There seems to be a burst of issues when people upgraded to 5.x or 6.x from 3.12 (Thanks to you and Strahil, who have reported most of them).Latest update from Strahil is that if files are copied fresh on 7.5 series, there are no issues.We are in process of identifying the patch, and also provide an option to disable 'acl' for testing. Will update once we identify the issue.Regards,AmarOn Sat, Apr 11, 2020 at 11:10 AM Hu Bert <revirii@xxxxxxxxxxxxxx> wrote:Hi,
no one has seen such messages?
Regards,
Hubert
Am Mo., 6. Apr. 2020 um 06:13 Uhr schrieb Hu Bert <revirii@xxxxxxxxxxxxxx>:
>
> Hello,
>
> i just upgraded my servers and clients from 5.11 to 6.8; besides one
> connection problem to the gluster download server everything went
> fine.
>
> On the 3 gluster servers i mount the 2 volumes as well, and only there
> (and not on all the other clients) there are some messages in the log
> file of both mount logs:
>
> [2020-04-06 04:10:53.552561] W [MSGID: 114031]
> [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
> 0-persistent-client-2: remote operation failed [Permission denied]
> [2020-04-06 04:10:53.552635] W [MSGID: 114031]
> [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
> 0-persistent-client-1: remote operation failed [Permission denied]
> [2020-04-06 04:10:53.552639] W [MSGID: 114031]
> [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
> 0-persistent-client-0: remote operation failed [Permission denied]
> [2020-04-06 04:10:53.553226] E [MSGID: 148002]
> [utime.c:146:gf_utime_set_mdata_setxattr_cbk] 0-persistent-utime: dict
> set of key for set-ctime-mdata failed [Permission denied]
> The message "W [MSGID: 114031]
> [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
> 0-persistent-client-2: remote operation failed [Permission denied]"
> repeated 4 times between [2020-04-06 04:10:53.552561] and [2020-04-06
> 04:10:53.745542]
> The message "W [MSGID: 114031]
> [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
> 0-persistent-client-1: remote operation failed [Permission denied]"
> repeated 4 times between [2020-04-06 04:10:53.552635] and [2020-04-06
> 04:10:53.745610]
> The message "W [MSGID: 114031]
> [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
> 0-persistent-client-0: remote operation failed [Permission denied]"
> repeated 4 times between [2020-04-06 04:10:53.552639] and [2020-04-06
> 04:10:53.745632]
> The message "E [MSGID: 148002]
> [utime.c:146:gf_utime_set_mdata_setxattr_cbk] 0-persistent-utime: dict
> set of key for set-ctime-mdata failed [Permission denied]" repeated 4
> times between [2020-04-06 04:10:53.553226] and [2020-04-06
> 04:10:53.746080]
>
> Anything to worry about?
>
>
> Regards,
> Hubert
________
Community Meeting Calendar:
Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users
--________
Community Meeting Calendar:
Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users
--
________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-users