-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Thanks for your help on IRC Samuel. I think I found where I made a mistake. I'll do some more testing. So far with max_backfills=1 on spindles, the impact of setting an OSD out and in on a saturated cluster seems to be minimal. On my I/O graphs it is hard to tell where the OSD was out and in recovering. If I/O becomes blocked, it seems that they don't linger around long. All of the clients report getting about the same amount of work done with little variance so no one client is getting indefinitely blocked (or blocked for really long times) causing the results between clients to be skewed like before. So far this queue seems to be very positive. I'd hate to put a lot of working getting this ready to merge if there is little interest in it (a lot of things to do at work and some other things I'd like to track down in the Ceph code as well). What are some of the next steps for something like this, meaning a pretty significant change to core code? Thank you to all who took time to help point me in the right direction. - ---------------- Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Wed, Nov 4, 2015 at 12:49 PM, Samuel Just wrote: > I didn't look into it closely, but that almost certainly means that > your queue is reordering primary->replica replicated write messages. > -Sam > -----BEGIN PGP SIGNATURE----- Version: Mailvelope v1.2.3 Comment: https://www.mailvelope.com wsFcBAEBCAAQBQJWOsY1CRDmVDuy+mK58QAA9LIQALIUgbS4BuDS704HPOpA XwvGxspelMCaBkLHLgiHU4T/Jc8JaXhgdRMwMiKeLI246Z7hRngSGlIDYc4+ nP4kWZIkwbJeTa/Z6bM6C3itFtJmQpkPvdjI+GiME5ZdYvFgCZQyDD71rqja H14m0+JsEaIHQF0JZz6OyNxbyRWsM+M68nOvpAx8/fOGHBC/0VwPbLrOUP9O 3J3NvbhN9xlYJeivXSAyzxmHQDD8mO1c1AUTrHgnTViD2k3fmcH0mOHIJ+jn ARZbeLN3hlXG0i9PHpnHzBVNSxsfb5VPxX970R3gvRWIt40QV/QL7q2SajWP ofxgEpkaO48ANQSYDlqSNcM+w46TtgcJljtX0vbrHIW3Skyaz4UZQ/dzX4lX a5Zzk01oFwXfMd10KgVbJf78qVYHy2r5aq46iFnrFLU43iy+Qve7Kex4XZFi vPFFVea89Of838NqTxW21+3oJthrz1g7RKHghZAbXaj3WKchuEU+uVG4XTo1 0PU4a5ZYVTH6zYHpwJo2/89OzdkBe9S6s00+4JmfVWWEhb6+QwUjBQp1TJbB TnMzSKfzgRyi/wHThv2XcZN12tttZMM2L4Ea3mHG+cxOTTZ1opv8/H2mprm8 7UuO4vk5K0c4IwPVmt9m5DTVhyn4hZ/QJmc+NARD3zc1u3qWFLkH2WaRMpBb mRWA =kgAl -----END PGP SIGNATURE----- -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html