Sorry, all. It turns out the problems were entirely on our side (bad ceph.conf files on the new servers). On Tue, Nov 6, 2012 at 11:09 AM, Mandell Degerness <mandell@xxxxxxxxxxxxxxx> wrote: > I'm seeing some weird errors when I add multiple monitors and I'm > hoping the list can shed some light to let me know if I need to > completely change the way I'm doing it or if I'm seeing a bug. > > What happens is this: I start with a happy cluster with 3 monitors > (mon.0, mon.1, and mon.2) I expand my cluster and want to add mon.3 > and mon.4. Because of the way I start up nodes, I end up adding mon.4 > before I add mon.3, which seems to result in some errors as can be > seen in the attached log. It gets worse when I add the next two > monitors (mon.6 followed by mon.5). > > I suspect the issue is in starting the monitors out of order with just > enough time between to cause problems. In any event, please examine > the log and let me know if it is a bug that can easily be fixed or if > it is a "feature" I need to work around. > > ceph --version reports: > > ceph version 0.48.2argonaut (commit:3e02b2fad88c2a95d9c0c86878f10d1beb780bfe) > > The first "mon add" command can be found starting at 19:59:50 in the > mon log. Subsequent monitor additions happened at 20:02:01, 20:08:35, > and finally 20:13:42. > > Regards, > Mandell Degerness -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html