All; We found the problem, we had the v2 ports incorrect in the monmap. Thank you, Dominic L. Hilsbos, MBA Director - Information Technology Perform Air International Inc. DHilsbos@xxxxxxxxxxxxxx www.PerformAir.com -----Original Message----- From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of DHilsbos@xxxxxxxxxxxxxx Sent: Wednesday, August 14, 2019 10:13 AM To: ceph-users@xxxxxxxxxxxxxx Subject: New Cluster Failing to Start All; We're working to deploy our first production Ceph cluster, and we've run into a snag. The MONs start, but the "cluster" doesn't appear to come up. Ceph -s never returns. These are the last lines in the event log of one of the mons: 2019-08-13 16:20:03.706 7f668108f180 0 starting mon.s700034 rank 0 at public addrs [v2:10.0.80.10:3330/0,v1:10.0.80.10:6789/0] at bind addrs [v2:10.0.80.10:3330/0,v1:10.0.80.10:6789/0] mon_data /var/lib/ceph/mon/ceph-s700034 fsid effc5134-e0cc-4628-a079-d67b60071f90 2019-08-13 16:20:03.709 7f668108f180 1 mon.s700034@-1(???) e0 preinit fsid effc5134-e0cc-4628-a079-d67b60071f90 2019-08-13 16:20:03.709 7f668108f180 1 mon.s700034@-1(???) e0 initial_members s700034,s700035,s700036, filtering seed monmap 2019-08-13 16:20:03.713 7f668108f180 0 mon.s700034@-1(probing) e0 my rank is now 0 (was -1) Aside from the address and hostname, the others logs end with the same statements. I'm not seeing the log entries that I would expect as each MON joins the cluster, nor am I seeing the "cluster" log files being generated (i.e. I'm used to seeing ceph.log, and ceph-audit.log on one of the MONs). Each machine can ping the others. Firewall rules are in place for ports 330 & 6789. Any idea what I'm missing? Thank you, Dominic L. Hilsbos, MBA Director - Information Technology Perform Air International Inc. DHilsbos@xxxxxxxxxxxxxx www.PerformAir.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com