Re: radosgw warnings in apache error.log

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




> -----Original Message-----
> From: Yehuda Sadeh [mailto:yehuda@xxxxxxxxxxx]
> Sent: Dienstag, 3. September 2013 19:08
> To: Fuchs, Andreas (SwissTXT)
> Cc: ceph-users@xxxxxxxxxxxxxx
> Subject: Re:  radosgw warnings in apache error.log
> 
> On Tue, Sep 3, 2013 at 9:13 AM, Fuchs, Andreas (SwissTXT)
> <Andreas.Fuchs@xxxxxxxxxxx> wrote:
> > We are testing radosgw with cyberduck, so far we see the following
> > issues
> >
> > 1. In apache error log for each file put we see:
> >
> > [Tue Sep 03 17:35:24 2013] [warn] FastCGI: 193.218.104.138 PUT
> > https://193.218.100.131/test/tesfile04.iso auth AWS *** [Tue Sep 03
> > 17:35:24 2013] [warn] FastCGI: JJJ gotCont=1
> >
> > - This is with the ceph version of apache/fastcgi.
> > - This happens on each file, 1 time at the beginning of the transfer and at
> least at large files, several times at the end.
> > - The standard apache/fastcgi combo does not show this issue.
> > About what do we get warned here?
> >
> 
> That's a debug output that I thought was long gone. We need to remove it.
> 

I took the install from here: http://gitbuilder.ceph.com/apache2-deb-precise-x86_64-basic/
You want me to fill a bug request?

> >
> > 2. Large file transfer of 4GB iso image with cyberduck Uploads of a
> > 4GB .iso file fail at the end of each upload, the file is then shown
> > with 0B in directory listing
> >
> > At the end of the upload I get the following in rados log
> > 2013-09-03 18:00:49.427092 7faf87fff700  2
> > RGWDataChangesLog::ChangesRenewThread: start
> > 2013-09-03 18:01:11.427201 7faf87fff700  2
> > RGWDataChangesLog::ChangesRenewThread: start
> > 2013-09-03 18:01:33.427310 7faf87fff700  2
> > RGWDataChangesLog::ChangesRenewThread: start
> > 2013-09-03 18:01:36.557121 7faf46ff5700 10 x>> x-amz-acl:public-read
Stuff deleted
> > prepare_atomic_for_write_impl: state is not atomic.
> > state=0x7faf54172a88
> > 2013-09-03 18:01:42.221839 7faf46ff5700  0 WARNING: set_req_state_err
> > err_no=27 resorting to 500
> 
> error 27 means EFBIG. I do see a few newish error paths in the osd that may
> return this. Can you try setting the following on your osd:
> 
> osd max attr size = 655360

How can i set this in a ceph-deploy environment? I have 36 OSD's an no osd config in ceph.conf

> >
> > 3. performance
> > While I get great performance from the radosgw to the stoage nodes,
> > the performance from cyberduck to the radosgw is poor (10 times
> > slower)
> >
> > On a rados filesystem mounted on the radosgw I get: arround 100MB/s
> write troughput (here I know it's the 1Gb sync network between the nodes
> who is the limiting factor).
> > With a cyberduck test I only get 10MB/s and I cannot identify the
> bottleneck, network between testclient and radosgw is 1Gb and verified.
> 
> Can you verify that you have enough pgs per pool? Also, turning off the
> debug log might help some:
> 
> debug rgw = 0
> 
> There are a few other logs that might affect, but I think that at this point
> everything is already turned off by default.

We added already:
rgw enable ops log = false
to the radosgw config, but this had no effect, still allot of logging in /var/log/ceph/radosgw.log
with "debug rgw=0" it's quite now

thanks
Andi
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux