> -----Original Message----- > From: Yehuda Sadeh [mailto:yehuda@xxxxxxxxxxx] > Sent: Dienstag, 3. September 2013 19:08 > To: Fuchs, Andreas (SwissTXT) > Cc: ceph-users@xxxxxxxxxxxxxx > Subject: Re: radosgw warnings in apache error.log > > On Tue, Sep 3, 2013 at 9:13 AM, Fuchs, Andreas (SwissTXT) > <Andreas.Fuchs@xxxxxxxxxxx> wrote: > > We are testing radosgw with cyberduck, so far we see the following > > issues > > > > 1. In apache error log for each file put we see: > > > > [Tue Sep 03 17:35:24 2013] [warn] FastCGI: 193.218.104.138 PUT > > https://193.218.100.131/test/tesfile04.iso auth AWS *** [Tue Sep 03 > > 17:35:24 2013] [warn] FastCGI: JJJ gotCont=1 > > > > - This is with the ceph version of apache/fastcgi. > > - This happens on each file, 1 time at the beginning of the transfer and at > least at large files, several times at the end. > > - The standard apache/fastcgi combo does not show this issue. > > About what do we get warned here? > > > > That's a debug output that I thought was long gone. We need to remove it. > I took the install from here: http://gitbuilder.ceph.com/apache2-deb-precise-x86_64-basic/ You want me to fill a bug request? > > > > 2. Large file transfer of 4GB iso image with cyberduck Uploads of a > > 4GB .iso file fail at the end of each upload, the file is then shown > > with 0B in directory listing > > > > At the end of the upload I get the following in rados log > > 2013-09-03 18:00:49.427092 7faf87fff700 2 > > RGWDataChangesLog::ChangesRenewThread: start > > 2013-09-03 18:01:11.427201 7faf87fff700 2 > > RGWDataChangesLog::ChangesRenewThread: start > > 2013-09-03 18:01:33.427310 7faf87fff700 2 > > RGWDataChangesLog::ChangesRenewThread: start > > 2013-09-03 18:01:36.557121 7faf46ff5700 10 x>> x-amz-acl:public-read Stuff deleted > > prepare_atomic_for_write_impl: state is not atomic. > > state=0x7faf54172a88 > > 2013-09-03 18:01:42.221839 7faf46ff5700 0 WARNING: set_req_state_err > > err_no=27 resorting to 500 > > error 27 means EFBIG. I do see a few newish error paths in the osd that may > return this. Can you try setting the following on your osd: > > osd max attr size = 655360 How can i set this in a ceph-deploy environment? I have 36 OSD's an no osd config in ceph.conf > > > > 3. performance > > While I get great performance from the radosgw to the stoage nodes, > > the performance from cyberduck to the radosgw is poor (10 times > > slower) > > > > On a rados filesystem mounted on the radosgw I get: arround 100MB/s > write troughput (here I know it's the 1Gb sync network between the nodes > who is the limiting factor). > > With a cyberduck test I only get 10MB/s and I cannot identify the > bottleneck, network between testclient and radosgw is 1Gb and verified. > > Can you verify that you have enough pgs per pool? Also, turning off the > debug log might help some: > > debug rgw = 0 > > There are a few other logs that might affect, but I think that at this point > everything is already turned off by default. We added already: rgw enable ops log = false to the radosgw config, but this had no effect, still allot of logging in /var/log/ceph/radosgw.log with "debug rgw=0" it's quite now thanks Andi _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com