Hi Sage, On 02/26/2013 12:36 PM, Sage Weil wrote: > On Tue, 26 Feb 2013, Jim Schutt wrote: >>> I think the right solution is to make an option that will setsockopt on >>> SO_RECVBUF to some value (say, 256KB). I pushed a branch that does this, >>> wip-tcp. Do you mind checking to see if this addresses the issue (without >>> manually adjusting things in /proc)? >> >> I'll be happy to test it out... > > That would be great! It's branch wip-tcp, and the setting is 'ms tcp > rcvbuf'. I've verified that I can reproduce the slowdown with the default value of 1 for /proc/sys/net/ipv4/tcp_moderate_rcvbuf, and 'ms tcp rcvbuf' at 0. I've also verified that I could not reproduce any slowdown when I configure 'ms tcp rcvbuf' to 256 KiB on OSDs. So, that's great news - sorry for the delay in testing. Also, FWIW, I ended up testing with commits cb15e6e0f4 and c346282940 cherry-picked on top of next as of a day or so ago (commit f58601d681), as for some reason wip-tcp wouldn't work for me - ceph-mon was non-responsive in some way I didn't dig into. -- Jim > > Thanks! > sage > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html