hi, all: Now, ceph should received all ack message from remote and then reply ack to client, What about directly reply to client if primary has been received some of them. Below is the request trace among osd. Primary wait for second sub_op_commit_rec msg for a long time. Does it make sense? [ { "time": "2015-04-10 10:40:15.373835", "event": "waiting_for_osdmap"}, { "time": "2015-04-10 10:40:15.375143", "event": "reached_pg"}, { "time": "2015-04-10 10:40:15.375210", "event": "started"}, { "time": "2015-04-10 10:40:15.375234", "event": "started"}, { "time": "2015-04-10 10:40:15.375432", "event": "waiting for subops from [34,20]"}, { "time": "2015-04-10 10:40:15.375846", "event": "commit_queued_for_journal_write"}, { "time": "2015-04-10 10:40:15.381176", "event": "write_thread_in_journal_buffer"}, { "time": "2015-04-10 10:40:15.384739", "event": "journaled_completion_queued"}, { "time": "2015-04-10 10:40:15.384838", "event": "op_commit"}, { "time": "2015-04-10 10:40:15.387949", "event": "op_applied"}, { "time": "2015-04-10 10:40:15.389616", "event": "sub_op_commit_rec"}, { "time": "2015-04-10 10:40:20.946123", "event": "sub_op_commit_rec"}, { "time": "2015-04-10 10:40:20.946142", "event": "commit_sent"}, { "time": "2015-04-10 10:40:20.946157", "event": "done"}]]}, -- Regards, xinze -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html