On Fri, 2011-03-04 at 12:48 -0700, Sage Weil wrote: > > Hi, > > > > I'm continuing my testing of the master branch > > (commit 1ed2d8c587) against 96 osds. > > > > I'm having trouble getting a new filesystem to > > start up. FWIW this size filesystem starts up > > in a minute or two at most under the stable branch. > > The main thing that's changed since then is the default number of PGs has > gone up. Can you try changing the osd_pg_bits to 6 in common/config.cc, > rebuild, and re-mkcephfs, and see if that gives you behavior similar to > stable? (mkcephfs isn't currently letting you adjust that yet.) OK, I tried osd_pg_bits = 6 as you suggested. The startup behavior is much like stable, except my "ceph -w" seems to have some trouble connecting - it often needs to try multiple times before it is successful. Unfortunately, the behavior under my 64-client write test is also much like stable - I'm still getting osds wrongly marked down. I didn't dig into it enough yet to see if this is due to the same type of mysterious delays as I was finding on stable. -- Jim > > I suspect this is just a problem with the size of the various pg map<>s on > the monitor (they're O(log n) for most operations). > > Thanks! > sage > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html