While I generally don't recommend getting down and dirty with the containers in Ceph, if you're going to build your own, well, that's different. When I have a container and the expected port isn't listening, the first thing I do is see if it's really listening and internal-only or truly not listening. To do this, you can dial in to the container, like so (this is one of my OSD's) docker exec -it ceph-272fcd86-0831-11ee-a7df-9c5c8e84cf8f-osd-7 /bin/bash The netstat command is not available in the stock Ceph containers, but the "ss" command is, so use that to see if there is in fact a process listening on that port. If so, then your Dockerfile is probably not set to publish that port. Are you using the stock Dockerfile to build from? If not, then the process that listens apparently didn't come all the way up. Take a quick peek around the local /var/log directory just to see if there's anything logged internally (probably not). Maybe do a "dmesg" just for laughs. Since this is (so I read it), the Prometheus container, look at the /var/lib/ceph/<fsid>/prometheus.<hostname> directory, which contains the Prometheus config file (under "./etc) and see if there are irregularities there. Tim On Tue, 2024-09-03 at 13:59 +0100, Matthew Vernon wrote: > On 03/09/2024 13:33, Eugen Block wrote: > > Oh that's interesting :-D I have no explanation for that, except > > maybe > > some flaw in your custom images? Or in the service specs? Not sure, > > to > > be honest... > > So obviously it _could_ be something in our images, but we're using > Ceph's published .debs (18.2.2) and not doing anything clever: > > https://gerrit.wikimedia.org/r/plugins/gitiles/operations/docker-images/production-images/+/refs/heads/master/images/ceph/Dockerfile.template > > I've not done anything to specifically ask for the discovery endpoint > to > be installed - as far as I can tell from the docs it should just get > started when you enable the prometheus endpoint (which does seem to > be > working)... > > Regards, > > Matthew > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |