I upgraded to 0.80.1 to see if that helped. It didn't change anything, but I'm now seeing more useful errors: 2014-05-13 16:27:32.954007 7f5183cfc700 0 RGWGC::process() failed to acquire lock on gc.10 2014-05-13 16:27:48.098428 7f5183cfc700 0 RGWGC::process() failed to acquire lock on gc.14 2014-05-13 16:27:49.792050 7f51828fa700 0 ERROR: can't read user header: ret=-2 2014-05-13 16:27:49.792055 7f51828fa700 0 ERROR: sync_user() failed, user=centosmirror2 ret=-2 Any ideas? On 5/13/2014 11:52 AM, Brian Rak wrote: > I hit a "bug" where radosgw crashed with > > -101> 2014-05-13 15:26:07.188494 7fde82886820 0 ERROR: FCGX_Accept_r > returned -24 > .... > 0> 2014-05-13 15:26:07.193772 7fde82886820 -1 rgw/rgw_main.cc: In > function 'virtual void RGWProcess::RGWWQ::_clear()' thread > 7fde82886820 time 2014-05-13 15:26:07.192212 > rgw/rgw_main.cc: 181: FAILED assert(process->m_req_queue.empty()) > > ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60) > 1: (ThreadPool::WorkQueue<RGWRequest>::_process(RGWRequest*)+0) > [0x4ae9a0] > 2: (ThreadPool::stop(bool)+0x1f5) [0x7fde8193ee05] > 3: (RGWProcess::run()+0x358) [0x4ab808] > 4: (main()+0x866) [0x4ac796] > 5: (__libc_start_main()+0xfd) [0x7fde7fe02d1d] > 6: radosgw() [0x45d239] > > > It seems it ran out of fds, so I increased the limit and restarted > it. However, now the user I was using can no longer access anything. > Every action the user attempts is rejected with a 403 error. > > How do I enable logging of authentication issues? I don't see > anything obvious in the config reference, and running radosgw with > --debug doesn't produce output that makes sense. > > Even after creating an entirely new user, that user lacks permission > to do anything (create bucket fails, list buckets fails). > > I'm still on ceph version 0.72.2 > (a913ded2ff138aefb8cb84d347d72164099cfd60), is this a known issue? > _______________________________________________ > ceph-users mailing list > ceph-users at lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |