From: "Daniel Hoffman" <daniel.hoffman@xxxxxxxxxxxx>
To: "ceph-users" <ceph-users@xxxxxxxx>
Sent: Sunday, May 10, 2015 10:54:21 PM
Subject: civetweb lockupsWe see around the 40-60MB/s into the array. Is this just too much for civetweb to handle? Should we look at virtual machines on the hardware/mode nodes?We run 2 gateways on 6core machines, there is no load, cpu or memory wise, the machines seem fine. They are load balanced behind HA proxy. We run 12 data nodes at the moment with ~170 disks.We have run the gateway in full debug mode and there is nothing there that seems to be an issue.Hi All.We have a wierd issue where civetweb just locks up, it just fails to respond to HTTP and a restart resolves the problem. This happens anywhere from every 60 seconds to every 4 hours with no reason behind it.
[client.radosgw.ceph-obj02]
host = ceph-obj02
keyring = /etc/ceph/keyring.radosgw.ceph-obj02
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw data = ""> rgw thread pool size = 1024
rgw print continue = False
debug rgw = 0
debug ms = 0
rgw enable ops log = False
log to stderr = False
rgw enable usage log = FalseAdvice appreciated.
Not sure what would be the issue. I'd look at the number of threads, maybe try reducing it, see if it makes any difference? Also, try to see how many open fds are there when it hangs.
Yehuda
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com