Re: Problems with ragosgw

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Mohamed,

> On Jan 22, 2020, at 10:05 AM, mohamed zayan <mohamed.zayan19@xxxxxxxxx <mailto:mohamed.zayan19@xxxxxxxxx>> wrote:
> 
> Currently I have a cluster of 2 nodes on two raspberrypi 3 devices.
> pi1 is admin/mon/mgr/osd
> 
> pi2 is osd
> 
> I am currently trying to run radosgw on pi2. I have failed multiple times
> 
> /var/lib/ceph/radosgw# /usr/bin/radosgw -f --cluster ceph --name
> client.rgw.pi2 --setuser ceph --setgroup ceph
> Thread::try_create(): pthread_create failed with error
> 11/tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc <http://thread.cc/>:
> In function 'void Thread::create(const char *, size_t)' thread
> 71114000 time 2020-01-22 14:58:13.793803
> /tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc <http://thread.cc/>:
> 152: FAILED assert(ret == 0)

I’m not too familiar with the Raspberry Pi platform or Raspbian. But there are some clues in the output you provided, specifically this text — “ Thread::try_create(): pthread_create failed with error 11”.

I assume these low valued error codes are consistent between Fedora and Raspbian, and so the code 11 means:

	#define EAGAIN          11      /* Try again */

I found the following:

	https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain <https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain>

So that seems to leave 3 possibilities:

1. RGW is asking for more resources that your platform is able to provide.
   a. There are limits as to the number of threads.
   b. There may be a memory limit, since each thread needs to maintain its own stack.
2. There is a bug in RGW where completed threads are not thread_join’d by their parents.
   a. This seems unlikely as this appears to happen during start-up before threads are likely done with their work.
3. Florian Weimer identifies a kernel bug.

I suspect it’s #1, so you might want to try reducing the number of threads rgw uses by lowering the value of rgw_thread_pool_size in your configuration.

Eric

--
J. Eric Ivancich
he / him / his
Red Hat Storage
Ann Arbor, Michigan, USA
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux