Well, Am 01.10.2012 um 18:07 schrieb Sage Weil <sage@xxxxxxxxxxx>: > On Mon, 1 Oct 2012, Oliver Francke wrote: >> Hi *, >> >> with reference to the below mentioned >> >> "objecter: misc fixes for op reordering" >> >> >> I assumed it could have something to do with slow requests not being solved >> for too long. I just not saw it anymore in 0.51 in our testing-evironment. >> But today we took one of our nodes into maintenance, and I see many of: >> >> --- 8-<--- >> >> 2012-10-01 11:58:46.766999 osd.10 [WRN] 38 slow requests, 1 included below; >> oldest blocked for > 1189.312605 secs >> 2012-10-01 11:58:46.767013 osd.10 [WRN] slow request 240.183032 seconds old, >> received at 2012-10-01 11:54:46.583860: osd_op(client.110046.0:2143984 >> rb.0.1adf5.6733efe2.00000000061a [write 208384~4096] 6.f511e801) v4 currently >> delayed >> 2 >> >> --- 8-< --- >> >> which is bad, as I assume, that some of the VM's are now stalled. Anybody else >> experienced such things? > > You see this on v0.51? For v0.52 we merged in a large series of messenger > fixes and cleanups that could very easily explain this. Can you try > v0.52? > just checking… up to now no "slow req." is lasting for longer than 30… seconds. > The same series has not been merged into the argonaut stable series; I'm > unsure yet whether that's a good idea (it's a lot of refactoring mixed in > with the fixes). Perhaps after it has proven itself in v0.52 for longer, > and/or if we get reports of msgr problems in argonaut deployments. I think most people are just happy campers these days… Not so destructive as myself ;) > > sage > Oliver. >> >> Thnx n regards, >> >> Oliver. >> >> On 09/20/2012 06:52 PM, Sage Weil wrote: >>> Hi everyone, >>> >>> Another update to the stable "argonaut" series has been released. This >>> fixes a few important bugs in rbd and radosgw and includes a series of >>> changes to upstart and deployment related scripts that will allow the >>> upcoming 'ceph-deploy' tool to work with the argonaut release. >>> >>> Upgrading: >>> >>> * The default search path for keyring files now includes >>> /etc/ceph/ceph.$name.keyring. If such files are present on your >>> cluster, be aware that by default they may now be used. >>> * There are several changes to the upstart init files. These have not >>> been previously documented or recommended. Any existing users should >>> review the changes before upgrading. >>> * The ceph-disk-prepare and ceph-disk-active scripts have been updated >>> significantly. These have not been previously documented or >>> recommended. Any existing users should review the changes before >>> upgrading. >>> >>> Notable changes include: >>> >>> * mkcephfs: fix keyring generation for mds, osd when default paths are >>> used >>> * radosgw: fix bug causing occasional corruption of per-bucket stats >>> * radosgw: workaround to avoid previously corrupted stats from going >>> negative >>> * radosgw: fix bug in usage stats reporting on busy buckets >>> * radosgw: fix Content-Range: header for objects bigger than 2 GB. >>> * rbd: avoid leaving watch acting when command line tool errors out >>> (avoids 30s delay on subsequent operations) >>> * rbd: friendlier use of pool/image options for import (old calling >>> convention still works) >>> * librbd: fix rare snapshot creation race (could lose a snap when >>> creation is concurrent) >>> * librbd: fix discard handling when spanning holes >>> * librbd: fix memory leak on discard when caching is enabled >>> * objecter: misc fixes for op reordering >>> * objecter: fix for rare startup-time deadlock waiting for osdmap >>> * ceph: fix usage >>> * mon: reduce log noise about check_sub >>> * ceph-disk-activate: misc fixes, improvements >>> * ceph-disk-prepare: partition and format osd disks automatically >>> * upstart: start everyone on a reboot >>> * upstart: always update the osd crush location on start if specified in >>> the config >>> * config: add /etc/ceph/ceph.$name.keyring to default keyring search path >>> * ceph.spec: don't package crush headers >>> >>> You can get this release from the usual locations: >>> >>> * Git at git://github.com/ceph/ceph.git >>> * Tarball at http://ceph.newdream.net/download/ceph-0.48.2.tar.gz >>> * For Debian/Ubuntu packages, see >>> http://ceph.newdream.net/docs/master/install/debian >>> -- >>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >>> the body of a message to majordomo@xxxxxxxxxxxxxxx >>> More majordomo info at http://vger.kernel.org/majordomo-info.html >> >> >> -- >> >> Oliver Francke >> >> filoo GmbH >> Moltkestra?e 25a >> 33330 G?tersloh >> HRB4355 AG G?tersloh >> >> Gesch?ftsf?hrer: S.Grewing | J.Rehp?hler | C.Kunz >> >> Folgen Sie uns auf Twitter: http://twitter.com/filoogmbh >> >> > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
