On Mon, 1 Oct 2012, Oliver Francke wrote: > Hi *, > > with reference to the below mentioned > > "objecter: misc fixes for op reordering" > > > I assumed it could have something to do with slow requests not being solved > for too long. I just not saw it anymore in 0.51 in our testing-evironment. > But today we took one of our nodes into maintenance, and I see many of: > > --- 8-<--- > > 2012-10-01 11:58:46.766999 osd.10 [WRN] 38 slow requests, 1 included below; > oldest blocked for > 1189.312605 secs > 2012-10-01 11:58:46.767013 osd.10 [WRN] slow request 240.183032 seconds old, > received at 2012-10-01 11:54:46.583860: osd_op(client.110046.0:2143984 > rb.0.1adf5.6733efe2.00000000061a [write 208384~4096] 6.f511e801) v4 currently > delayed > 2 > > --- 8-< --- > > which is bad, as I assume, that some of the VM's are now stalled. Anybody else > experienced such things? You see this on v0.51? For v0.52 we merged in a large series of messenger fixes and cleanups that could very easily explain this. Can you try v0.52? The same series has not been merged into the argonaut stable series; I'm unsure yet whether that's a good idea (it's a lot of refactoring mixed in with the fixes). Perhaps after it has proven itself in v0.52 for longer, and/or if we get reports of msgr problems in argonaut deployments. sage > > Thnx n regards, > > Oliver. > > On 09/20/2012 06:52 PM, Sage Weil wrote: > > Hi everyone, > > > > Another update to the stable "argonaut" series has been released. This > > fixes a few important bugs in rbd and radosgw and includes a series of > > changes to upstart and deployment related scripts that will allow the > > upcoming 'ceph-deploy' tool to work with the argonaut release. > > > > Upgrading: > > > > * The default search path for keyring files now includes > > /etc/ceph/ceph.$name.keyring. If such files are present on your > > cluster, be aware that by default they may now be used. > > * There are several changes to the upstart init files. These have not > > been previously documented or recommended. Any existing users should > > review the changes before upgrading. > > * The ceph-disk-prepare and ceph-disk-active scripts have been updated > > significantly. These have not been previously documented or > > recommended. Any existing users should review the changes before > > upgrading. > > > > Notable changes include: > > > > * mkcephfs: fix keyring generation for mds, osd when default paths are > > used > > * radosgw: fix bug causing occasional corruption of per-bucket stats > > * radosgw: workaround to avoid previously corrupted stats from going > > negative > > * radosgw: fix bug in usage stats reporting on busy buckets > > * radosgw: fix Content-Range: header for objects bigger than 2 GB. > > * rbd: avoid leaving watch acting when command line tool errors out > > (avoids 30s delay on subsequent operations) > > * rbd: friendlier use of pool/image options for import (old calling > > convention still works) > > * librbd: fix rare snapshot creation race (could lose a snap when > > creation is concurrent) > > * librbd: fix discard handling when spanning holes > > * librbd: fix memory leak on discard when caching is enabled > > * objecter: misc fixes for op reordering > > * objecter: fix for rare startup-time deadlock waiting for osdmap > > * ceph: fix usage > > * mon: reduce log noise about check_sub > > * ceph-disk-activate: misc fixes, improvements > > * ceph-disk-prepare: partition and format osd disks automatically > > * upstart: start everyone on a reboot > > * upstart: always update the osd crush location on start if specified in > > the config > > * config: add /etc/ceph/ceph.$name.keyring to default keyring search path > > * ceph.spec: don't package crush headers > > > > You can get this release from the usual locations: > > > > * Git at git://github.com/ceph/ceph.git > > * Tarball at http://ceph.newdream.net/download/ceph-0.48.2.tar.gz > > * For Debian/Ubuntu packages, see > > http://ceph.newdream.net/docs/master/install/debian > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > -- > > Oliver Francke > > filoo GmbH > Moltkestra?e 25a > 33330 G?tersloh > HRB4355 AG G?tersloh > > Gesch?ftsf?hrer: S.Grewing | J.Rehp?hler | C.Kunz > > Folgen Sie uns auf Twitter: http://twitter.com/filoogmbh > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
