[moved to ceph-devel] On Tue, 9 Oct 2012, Sam Lang wrote: > Could we add some other chaos monkeys to the network/storage infrastructure > besides ms_inject_socket_failures? In particular, I would like to add > ms_inject_delay_msg and ms_inject_reorder_msgs? I think those could > potentially help flush out some bugs (such as: > https://github.com/ceph/ceph/commit/fa66eaa162542ac01752ada91a46051dde060831). > > Right now I'm particularly interested in network delays, but we should > probably add storage delays as well. > > Maybe something like this already exists and I'm just not finding it? Injecting message delays is a great idea, and pretty straightforward... let's do it! Maybe a combination of 'ms inject delay max' and 'ms inject delay probability' (default 0)? Reordering messages isn't allowed to happen; if we do see out of order delivery, it is a bug in the messenger code, and not something higher layeers should need to worry about. sage -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html