On Fri, 31 May 2013, Jim Schutt wrote: > Hi Sage, > > On 05/29/2013 03:07 PM, Sage Weil wrote: > > Hi all- > > > > I have a couple of branches (wip-5176 and wip-5176-cuttlefish) that try to > > make the leveldb compaction on the monitor less expensive by doing it in > > an async thread and compaction only the trimmed range. If anyone who is > > experience high monitor io on cuttlefish would like to test it out, > > feedback on whether/how much it improves things would be much appreciated! > > I've been flogging wip-5176-cuttlefish merged into recent cuttlefish > branch (commit 02ef6e918e), and the result has been very stable for > me. I've been testing OSD reweights, and so have been getting lots > of pgmap updates, and lots of data movement. > > I'm no longer seeing stalls, and I see much less data movement > on the monitor hosts. I haven't seen any monitors drop out > and rejoin, which had been a regular occurrence for me. > I stopped a mon and reinitialized it, and it resync'ed in > just a few minutes, which is also a big improvement. > > This is all with 128K PGs - next week I'll try much higher > PG counts. > > Thanks a bunch for these fixes - they are working great > for me! This is great news! I pushed a few more patches to wip-5176-cuttlefish that should make it even better (smarter about ranges to compact, and perfcounters so we can tell what leveldb compactions are taking place). Do you mind trying it out as well? In the meantime, I'm going to pull it into the cuttlefish branch and test over the weekend. If that looks good we'll cut a point release with all of these fixes. Thank you to everyone who has helped with the debugging and testing on these issues! sage > > Thanks -- Jim > > > > > Thanks- > > sage > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > > > > > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
