Re: OSD scalability & thread stacksize

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Fri, 2 Jul 2010, Paul wrote:
> Yes, this seems to be what is happening. Taking a look, our kernels
> had ulimit -v set to equal total physical memory. After setting ulimit
> -v to unlimited, 32748 threads can be created regardless of what stack
> size is allocated to each thread, at which point pthread_create
> returns ENOMEM rather than EAGAIN. I'd still prefer to manage the
> allocated size though, since kernel settings might not be totally
> within our control.

That explains it.  I pushed out your patches (with a few small changes), 
and set the default stack size for the msgr threads to 1MB.  If you run 
with something smaller reliably (I suspect 32 KB is a safe bet) let us 
know.

I also cherry-picked a few other bug fixes for that tree, btw.  Let me me 
know if I missed anything important.

sage
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux