Bug Reported: https://tracker.ceph.com/issues/56660 Best Robert Reihs On Tue, Jul 19, 2022 at 11:44 AM Redouane Kachach Elhichou < rkachach@xxxxxxxxxx> wrote: > Great, thanks for sharing your solution. > > It would be great if you can open a tracker describing the issue so it > could be fixed later in cephadm code. > > Best, > Redo. > > On Tue, Jul 19, 2022 at 9:28 AM Robert Reihs <robert.reihs@xxxxxxxxx> > wrote: > >> Hi, >> I think I found the problem. We are using ipv6 only, and the config >> cephadm >> is creating only adds the ipv4 configuration. >> /etc/sysctl.d/90-ceph-FSID-keepalived.conf >> # created by cephadm >> >> # IP forwarding and non-local bind >> net.ipv4.ip_forward = 1 >> net.ipv4.ip_nonlocal_bind = 1 >> >> I added: >> net.ipv6.conf.bond1.forwarding = 1 >> net.ipv6.conf.bond1.accept_source_route = 1 >> net.ipv6.conf.bond1.accept_redirects = 1 >> net.ipv6.ip_nonlocal_bind = 1 >> >> and reloading the file: sysctl -f >> /etc/sysctl.d/90-ceph-FSID-keepalived.conf >> Restarting the service, everything starts up. The file gets overwritten >> again, so the added config dose not persists. >> >> Best >> Robert Reihs >> >> On Mon, Jul 18, 2022 at 3:33 PM Robert Reihs <robert.reihs@xxxxxxxxx> >> wrote: >> >> > Hi everyone, >> > I have a problem with the haproxy settings for the rgw service. I >> > specified the service in the service specification: >> > --- >> > service_type: rgw >> > service_id: rgw >> > placement: >> > count: 3 >> > label: "rgw" >> > --- >> > service_type: ingress >> > service_id: rgw.rgw >> > placement: >> > count: 3 >> > label: "ingress" >> > spec: >> > backend_service: rgw.rgw >> > virtual_ip: ffff:ffff:ffff:404::dd:ff:10/64 >> > virtual_interface_networks: ffff:ffff:ffff:404/64 >> > frontend_port: 8998 >> > monitor_port: 8999 >> > >> > The keepalived services are all started, the haproxy, only one is >> started, >> > the other two are in error state: >> > systemd[1]: Starting Ceph haproxy.rgw.rgw.fsn1-ceph-01.ulnhyo for >> > 40ddf3a6-36f1-42d2-9bf7-2fd50045e5dc... >> > podman[3616202]: 2022-07-18 13:03:25.738014313 +0000 UTC m=+0.052607969 >> > container create >> > 25f90c4e26ebf6fc44efe12eae2c6b9d54811bfde744a78f756469e32c3f461f (image= >> > docker.io/library/haproxy:2.3, name=ceph-40ddf3> >> > podman[3616202]: 2022-07-18 13:03:25.787788203 +0000 UTC m=+0.102381880 >> > container init >> > 25f90c4e26ebf6fc44efe12eae2c6b9d54811bfde744a78f756469e32c3f461f (image= >> > docker.io/library/haproxy:2.3, name=ceph-40ddf3a6> >> > podman[3616202]: 2022-07-18 13:03:25.790577637 +0000 UTC m=+0.105171323 >> > container start >> > 25f90c4e26ebf6fc44efe12eae2c6b9d54811bfde744a78f756469e32c3f461f (image= >> > docker.io/library/haproxy:2.3, name=ceph-40ddf3a> >> > bash[3616202]: >> > 25f90c4e26ebf6fc44efe12eae2c6b9d54811bfde744a78f756469e32c3f461f >> > conmon[3616235]: [NOTICE] 198/130325 (2) : haproxy version is >> > 2.3.20-2c8082e >> > conmon[3616235]: [NOTICE] 198/130325 (2) : path to executable is >> > /usr/local/sbin/haproxy >> > conmon[3616235]: [ALERT] 198/130325 (2) : Starting frontend stats: >> cannot >> > bind socket (Cannot assign requested address) >> > [ffff:ffff:ffff:404::dd:ff:10:8999] >> > conmon[3616235]: [ALERT] 198/130325 (2) : Starting frontend frontend: >> > cannot bind socket (Cannot assign requested address) >> > [ffff:ffff:ffff:404::dd:ff:10:8998] >> > conmon[3616235]: [ALERT] 198/130325 (2) : [haproxy.main()] Some >> protocols >> > failed to start their listeners! Exiting. >> > >> > I can access the IP in the browser and get the XML S3 response. >> > ceph version 17.2.1 (ec95624474b1871a821a912b8c3af68f8f8e7aa1) quincy >> > (stable) installed with cephadm. >> > >> > Any idea where the problem could be? >> > Thanks >> > Robert Reihs >> > >> >> >> -- >> Robert Reihs >> Jakobsweg 22 >> 8046 Stattegg >> AUSTRIA >> >> mobile: +43 (664) 51 035 90 >> robert.reihs@xxxxxxxxx >> _______________________________________________ >> ceph-users mailing list -- ceph-users@xxxxxxx >> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> >> -- Robert Reihs Jakobsweg 22 8046 Stattegg AUSTRIA mobile: +43 (664) 51 035 90 robert.reihs@xxxxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |