Yesterday another ovirt user hit the issue (or similar one) after gluster v6.6 to 6.8 upgrade. I guess Adrian can provide the logs, so we check if it is the same issue or not. Best Regards, Strahil Nikolov На 28 май 2020 г. 14:15:55 GMT+03:00, Alan Orth <alan.orth@xxxxxxxxx> написа: >We upgraded from 5.10 or 5.11 (can't remember) to 6.8 a few months ago >and >I see a lot of these type of "Permission denied" errors in our brick >logs >as well. > >[2020-05-24 00:52:43.681065] I [MSGID: 115060] >[server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server: >35337278: SETXATTR /user/public_html/xdf_applications >(96e88263-71ae-4228-997b-f4d47fcebc39) ==> set-ctime-mdata, client: >CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, >error-xlator: homes-access-control >[2020-05-24 00:52:43.681080] I [MSGID: 115060] >[server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client: >CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, >error-xlator: homes-access-control [Permission denied] >[2020-05-24 00:52:43.968633] I [MSGID: 139001] >[posix-acl.c:263:posix_acl_log_permit_denied] 0-homes-access-control: >client: >CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, >gfid: db01821c-6402-4ce5-bba6-41cdedb98191, >req(uid:48,gid:48,perm:2,ngrps:1), >ctx(uid:957,gid:957,in-groups:0,perm:664,updated-fop:LOOKUP, acl:-) >[Permission denied] >[2020-05-24 00:52:43.968671] I [MSGID: 115060] >[server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server: >35337285: SETXATTR /user/public_html/.htaccess >(db01821c-6402-4ce5-bba6-41cdedb98191) ==> set-ctime-mdata, client: >CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, >error-xlator: homes-access-control >[2020-05-24 00:52:43.968683] I [MSGID: 115060] >[server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client: >CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0, >error-xlator: homes-access-control [Permission denied] > >There are thousands of these in my brick logs over the past months. >Volume >is distribute replicate with replica 2 on GlusterFS 6.8. Client is 6.8. >Underlying filesystem on the bricks is XFS. As far as I can see there >is no >problem accessing any of these files from the FUSE mount, so I don't >even >know what permission denied means in this context. > >Hope that with the troubleshooting. Cheers! > >On Tue, Apr 21, 2020 at 8:00 PM Amar Tumballi <amar@xxxxxxxxx> wrote: > >> There seems to be a burst of issues when people upgraded to 5.x or >6.x >> from 3.12 (Thanks to you and Strahil, who have reported most of >them). >> >> Latest update from Strahil is that if files are copied fresh on 7.5 >> series, there are no issues. >> >> We are in process of identifying the patch, and also provide an >option to >> disable 'acl' for testing. Will update once we identify the issue. >> >> Regards, >> Amar >> >> >> >> On Sat, Apr 11, 2020 at 11:10 AM Hu Bert <revirii@xxxxxxxxxxxxxx> >wrote: >> >>> Hi, >>> >>> no one has seen such messages? >>> >>> Regards, >>> Hubert >>> >>> Am Mo., 6. Apr. 2020 um 06:13 Uhr schrieb Hu Bert ><revirii@xxxxxxxxxxxxxx >>> >: >>> > >>> > Hello, >>> > >>> > i just upgraded my servers and clients from 5.11 to 6.8; besides >one >>> > connection problem to the gluster download server everything went >>> > fine. >>> > >>> > On the 3 gluster servers i mount the 2 volumes as well, and only >there >>> > (and not on all the other clients) there are some messages in the >log >>> > file of both mount logs: >>> > >>> > [2020-04-06 04:10:53.552561] W [MSGID: 114031] >>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk] >>> > 0-persistent-client-2: remote operation failed [Permission denied] >>> > [2020-04-06 04:10:53.552635] W [MSGID: 114031] >>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk] >>> > 0-persistent-client-1: remote operation failed [Permission denied] >>> > [2020-04-06 04:10:53.552639] W [MSGID: 114031] >>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk] >>> > 0-persistent-client-0: remote operation failed [Permission denied] >>> > [2020-04-06 04:10:53.553226] E [MSGID: 148002] >>> > [utime.c:146:gf_utime_set_mdata_setxattr_cbk] 0-persistent-utime: >dict >>> > set of key for set-ctime-mdata failed [Permission denied] >>> > The message "W [MSGID: 114031] >>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk] >>> > 0-persistent-client-2: remote operation failed [Permission >denied]" >>> > repeated 4 times between [2020-04-06 04:10:53.552561] and >[2020-04-06 >>> > 04:10:53.745542] >>> > The message "W [MSGID: 114031] >>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk] >>> > 0-persistent-client-1: remote operation failed [Permission >denied]" >>> > repeated 4 times between [2020-04-06 04:10:53.552635] and >[2020-04-06 >>> > 04:10:53.745610] >>> > The message "W [MSGID: 114031] >>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk] >>> > 0-persistent-client-0: remote operation failed [Permission >denied]" >>> > repeated 4 times between [2020-04-06 04:10:53.552639] and >[2020-04-06 >>> > 04:10:53.745632] >>> > The message "E [MSGID: 148002] >>> > [utime.c:146:gf_utime_set_mdata_setxattr_cbk] 0-persistent-utime: >dict >>> > set of key for set-ctime-mdata failed [Permission denied]" >repeated 4 >>> > times between [2020-04-06 04:10:53.553226] and [2020-04-06 >>> > 04:10:53.746080] >>> > >>> > Anything to worry about? >>> > >>> > >>> > Regards, >>> > Hubert >>> ________ >>> >>> >>> >>> Community Meeting Calendar: >>> >>> Schedule - >>> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC >>> Bridge: https://bluejeans.com/441850968 >>> >>> Gluster-users mailing list >>> Gluster-users@xxxxxxxxxxx >>> https://lists.gluster.org/mailman/listinfo/gluster-users >>> >> >> >> -- >> -- >> https://kadalu.io >> Container Storage made easy! >> >> ________ >> >> >> >> Community Meeting Calendar: >> >> Schedule - >> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC >> Bridge: https://bluejeans.com/441850968 >> >> Gluster-users mailing list >> Gluster-users@xxxxxxxxxxx >> https://lists.gluster.org/mailman/listinfo/gluster-users >> ________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-users
