Hi Mohamed, > On Jan 22, 2020, at 10:05 AM, mohamed zayan <mohamed.zayan19@xxxxxxxxx <mailto:mohamed.zayan19@xxxxxxxxx>> wrote: > > Currently I have a cluster of 2 nodes on two raspberrypi 3 devices. > pi1 is admin/mon/mgr/osd > > pi2 is osd > > I am currently trying to run radosgw on pi2. I have failed multiple times > > /var/lib/ceph/radosgw# /usr/bin/radosgw -f --cluster ceph --name > client.rgw.pi2 --setuser ceph --setgroup ceph > Thread::try_create(): pthread_create failed with error > 11/tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc <http://thread.cc/>: > In function 'void Thread::create(const char *, size_t)' thread > 71114000 time 2020-01-22 14:58:13.793803 > /tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc <http://thread.cc/>: > 152: FAILED assert(ret == 0) I’m not too familiar with the Raspberry Pi platform or Raspbian. But there are some clues in the output you provided, specifically this text — “ Thread::try_create(): pthread_create failed with error 11”. I assume these low valued error codes are consistent between Fedora and Raspbian, and so the code 11 means: #define EAGAIN 11 /* Try again */ I found the following: https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain <https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain> So that seems to leave 3 possibilities: 1. RGW is asking for more resources that your platform is able to provide. a. There are limits as to the number of threads. b. There may be a memory limit, since each thread needs to maintain its own stack. 2. There is a bug in RGW where completed threads are not thread_join’d by their parents. a. This seems unlikely as this appears to happen during start-up before threads are likely done with their work. 3. Florian Weimer identifies a kernel bug. I suspect it’s #1, so you might want to try reducing the number of threads rgw uses by lowering the value of rgw_thread_pool_size in your configuration. Eric -- J. Eric Ivancich he / him / his Red Hat Storage Ann Arbor, Michigan, USA _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx