I remember this bug. It is solved in Ceph 15. If I remember correctly my workaround was to change the permissions on the files and restart the ceph nodes. On Fri, May 6, 2022 at 2:23 PM Ha, Son Hai <sonhaiha@xxxxxxxx> wrote: > Hi, > > I have a Ceph cluster version 14.2.22. > This cluster is installed manually and was configured to use ceph user. > Below is my config: > > [client.rgw.DEXXXXXX513] > host = DEXXXXXX513 > keyring = /var/lib/ceph/radosgw/ceph-rgw.DEXXXXXX513/keyring > log file = /var/log/ceph/ceph-rgw-DEXXXXXX513.log > rgw frontends = civetweb port=10.xxx.xxx.85:8443s num_threads=100 > ssl_certificate=/etc/ceph/ssl/cert.pem > > [client.rgw.DEXXXXXX514] > host = DEXXXXXX514 > keyring = /var/lib/ceph/radosgw/ceph-rgw.DEXXXXXX514/keyring > log file = /var/log/ceph/ceph-rgw-DEXXXXXX514.log > rgw frontends = civetweb port=10.xxx.xxx.201:8443s num_threads=100 > ssl_certificate=/etc/ceph/ssl/cert.pem > > [client.rgw.DEXXXXXX515] > host = DEXXXXXX515 > keyring = /var/lib/ceph/radosgw/ceph-rgw.DEXXXXXX515/keyring > log file = /var/log/ceph/ceph-rgw-DEXXXXXX515.log > rgw frontends = civetweb port=10.xxx.xxx.84:8443s num_threads=100 > ssl_certificate=/etc/ceph/ssl/cert.pem > > [global] > cluster network = 10.xxx.xxx.0/24 > public network = 10.xxx.xxx.0/24 > fsid = 4d3a09c7-d8d2-4927-91cd-xxxxxxxxxxxx > mon host = 10.xxx.xxx.84,10.xxx.xxx.201,10.xxx.xxx.85 > mon initial members = DEXXXXXX515,DEXXXXXX514,DEXXXXXX513 > > [mds.DEXXXXXX513] > host = DEXXXXXX513 > > [mds.DEXXXXXX514] > host = DEXXXXXX514 > > [mds.DEXXXXXX515] > host = DEXXXXXX515 > > However, we got a problem, every time we start the service, the permission > of log file will be set to root with read-only. > I wonder where I should look into to check the permission issue? > I have another cluster with the same setting but it works quite well > without log permission problem. > Even if I change permission for the files, logs still does not print out. > I checked all the unit service files of Ceph service in my "systemd", and > they are configured to use user "ceph" correctly. I also did not find any > suspicious script/program that changes the log permission. > My cluster is running OK, it only does not printout logs and recovery > quite slow recently when OSD out and in. > > [sonhaihaad@deXXXXXX515 ~]$ sudo ls -lsah /var/log/ceph/ > total 996K > 4.0K drwxrwsr-x. 2 ceph ceph 4.0K May 5 03:21 . > 4.0K drwxr-xr-x. 25 root root 4.0K May 5 03:21 .. > 948K -rwxrwxr-x. 1 ceph ceph 941K May 6 01:00 ceph.audit.log > 0 -r--------. 1 root root 0 Apr 15 03:35 ceph.log > 0 -r--------. 1 root root 0 Apr 27 03:35 ceph-mds.DEXXXXXX515.log > 0 -r--------. 1 root root 0 Apr 27 03:35 ceph-mgr.DEXXXXXX515.log > 0 -r--------. 1 root root 0 Apr 15 03:35 ceph-mon.DEXXXXXX515.log > 0 -r--------. 1 root root 0 Apr 16 03:08 ceph-osd.0.log > 0 -r--------. 1 root root 0 May 5 03:21 ceph-rgw-DEXXXXXX515.log > 24K -rwxrwxr-x. 1 ceph ceph 20K May 4 11:13 ceph-volume.log > 16K -rwxrwxr-x. 1 ceph ceph 14K May 4 11:13 ceph-volume-systemd.log > > Thank you for your help, > Sincerely, > Son Hai Ha > > > -- > KPMG IT Service GmbH > Sitz/Registergericht: Berlin/Amtsgericht Charlottenburg, HRB 87521 B > Geschäftsführer: Hans-Christian Schwieger, Helmar Symmank > Aufsichtsratsvorsitzender: WP StB Klaus Becker > > Allgemeine Informationen zur Datenverarbeitung im Rahmen unserer > allgemeinen Geschäftstätigkeit sowie im Mandatsverhältnis gemäß EU > Datenschutz-Grundverordnung sind hier < > https://home.kpmg.com/content/dam/kpmg/de/pdf/Themen/2018/datenschutzinformationen-fuer-betroffene-kpmg-it-service-gmbh.pdf> > abrufbar. > > Die Information in dieser E-Mail ist vertraulich und kann dem > Berufsgeheimnis unterliegen. Sie ist ausschließlich für den Adressaten > bestimmt. Jeglicher Zugriff auf diese E-Mail durch andere Personen als den > Adressaten ist untersagt. Sollten Sie nicht der für diese E-Mail bestimmte > Adressat sein, ist Ihnen jede Veröffentlichung, Vervielfältigung oder > Weitergabe wie auch das Ergreifen oder Unterlassen von Maßnahmen im > Vertrauen auf erlangte Information untersagt. In dieser E-Mail enthaltene > Meinungen oder Empfehlungen unterliegen den Bedingungen des jeweiligen > Mandatsverhältnisses mit dem Adressaten. > > The information in this e-mail is confidential and may be legally > privileged. It is intended solely for the addressee. Access to this e-mail > by anyone else is unauthorized. If you are not the intended recipient, any > disclosure, copying, distribution or any action taken or omitted to be > taken in reliance on it, is prohibited and may be unlawful. Any opinions or > advice contained in this e-mail are subject to the terms and conditions > expressed in the governing KPMG client engagement letter. > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |