Solution was found by colleague and it was: ms_mon_client_mode = crc ... because of https://github.com/ceph/ceph/pull/42587/commits/7e22d2a31d277ab3eecff47b0864b206a32e2332 Rok On Thu, Sep 8, 2022 at 6:04 PM Rok Jaklič <rjaklic@xxxxxxxxx> wrote: > What credentials should RGWs have? > > I have intentionally > > auth cluster required = none > auth service required = none > auth client required = none > > and in 16.2.7 it worked. > > Kind regards, > Rok > > On Thu, Sep 8, 2022, 14:29 J. Eric Ivancich <ivancich@xxxxxxxxxx> wrote: > >> What jumps out to me is: >> >> a. The -13 error code represents permission denied >> b. You’ve commented out the keyring configuration in ceph.conf >> >> So do your RGWs have appropriate credentials? >> >> Eric >> (he/him) >> >> > On Sep 7, 2022, at 3:04 AM, Rok Jaklič <rjaklic@xxxxxxxxx> wrote: >> > >> > Hi, >> > >> > after upgrading to ceph version 16.2.10 from 16.2.7 rados gw is not >> > working. We start rados gw with: >> > radosgw -c /etc/ceph/ceph.conf --setuser ceph --setgroup ceph -n >> > client.radosgw.ctplmon3 >> > >> > ceph.conf looks like: >> > [root@ctplmon3 ~]# cat /etc/ceph/ceph.conf >> > [global] >> > fsid = 0a6e5422-ac75-4093-af20-528ee00cc847 >> > mon initial members = ctplmon1,ctplmon3 >> > mon host = X_IP, Y_IP >> > auth cluster required = none >> > auth service required = none >> > auth client required = none >> > osd journal size = 1024 >> > osd pool default size = 3 >> > osd pool default min size = 2 >> > osd pool default pg num = 128 >> > osd pool default pgp num = 128 >> > osd crush chooseleaf type = 1 >> > >> > [client.radosgw.ctplmon3] >> > # keyring = /etc/ceph/keyring.radosgw.gateway >> > host = ctplmon3 >> > log file = /var/log/ceph/client.radosgw.ctplmon3.log >> > rgw_dns_name = Y_HOSTNAME >> > rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock >> > rgw print continue = false >> > >> > And in logs we get: >> > 2022-09-07T08:55:28.824+0200 7f03fe033700 0 --2- Y_IP:0/662532535 >> >> > v2:Y_IP:3300/0 conn(0x5648b93bb000 0x5648b940a800 unknown :-1 >> > s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request >> > get_initial_auth_request returned -13 >> > 2022-09-07T08:55:28.826+0200 7f03fe033700 0 --2- Y_IP:0/662532535 >> >> > [v2:Y_IP:3300/0,v1:Y_IP:6789/0] conn(0x5648ba0b4000 0x5648b940ad00 >> unknown >> > :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request >> > get_initial_auth_request returned -13 >> > 2022-09-07T08:55:28.826+0200 7f03fd832700 0 --2- Y_IP:0/662532535 >> >> > [v2:X_IP:3300/0,v1:X_IP:6789/0] conn(0x5648ba0b4400 0x5648b940b200 >> unknown >> > :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request >> > get_initial_auth_request returned -13 >> > 2022-09-07T08:55:28.826+0200 7f03fe834700 0 --2- Y_IP:0/662532535 >> >> > [v2:Z_IP:3300/0,v1:Z_IP:6789/0] conn(0x5648ba0b4800 0x5648b940b700 >> unknown >> > :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request >> > get_initial_auth_request returned -13 >> > >> > We have a firewall open and tcpdump shows traffic when rados tries to >> > connect. >> > >> > Any ideas why rados cannot start? >> > >> > Kind regards, >> > Rok >> > _______________________________________________ >> > ceph-users mailing list -- ceph-users@xxxxxxx >> > To unsubscribe send an email to ceph-users-leave@xxxxxxx >> > >> >> _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx