On Mon, 18 Aug 2014 16:59:26 -0400 Jeff Layton <jeff.layton@xxxxxxxxxxxxxxx> wrote: > On Mon, 18 Aug 2014 16:04:56 -0400 > "J. Bruce Fields" <bfields@xxxxxxxxxxxx> wrote: > > > Thanks for working on this, it's currently a major annoyance! > > > > Thanks for looking at it. I think I might go with a different scheme > for managing the v4.x grace lifting which won't involve new procfiles, > but I need to code it up and test it out. Stay tuned for v2, but I'd > appreciate any feedback that you have on this set. > Hmm, now that I've looked, I'm not sure the other scheme is really feasible. What I wanted to do was to have nfsdcltrack return a distinct error code that would indicate that all hosts have finished reclaiming. That would avoid the need for the v4_end_grace file. The problem there is that the range of return codes that you get back via the UMH interface is pretty limited. Given the fact that I wasn't terribly careful about sanitizing the exit status in earlier versions of nfsdcltrack (mea culpa), we might should just stick with something along the lines of what I've proposed here. I'll plan to go with this unless there anyone has a better idea... > > On Fri, Aug 15, 2014 at 10:45:08AM -0400, Jeff Layton wrote: > > > This patchset adds some support to sm-notify and nfsdcltrack for lifting > > > the grace periods early. Allowing this actually work depends on the > > > companion kernel patchset, but the approach I've taken here should deal > > > properly with userland/kernel mismatch. > > > > > > There are two main pieces: > > > > > > sm-notify: in the event that sm-notify isn't sending any NOTIFY > > > requests, we don't expect to see any reclaims from clients. In that > > > case, we should be able to safely lift the lockd grace period early. > > > The first patch in the series implements this (though we'll probably > > > need a bit of selinux work to get that working in Fedora under enforcing > > > mode). > > > > > > nfsdcltrack: if there are no v4.0 clients and all v4.1+ clients have > > > issued a RECLAIM_COMPLETE, then we can go ahead and end the nfsd grace > > > period. The remainder of the patchset adds the support for this. This > > > requires revving the DB schema for it, and making use of the environment > > > variables that are passed to the upcall by the kernel. > > > > And we get to skip the grace period on first start, and on any restart > > during which no clients hold state, which seem like big improvements on > > their own. > > > > Agreed. > > > Mostly a pointless digression, but I've been wondering if there are any > > further improvements that are worth it. I'm feeling skeptical: > > > > As long as nobody uses deny modes we could deal with them with a big > > dumb hammer (e.g. synchronously record something if anyone requests one, > > insist on a full grace period if they do). > > > > But we're still stuck blocking all new opens as long as there are > > delegations outstanding. (Well, maybe only new read opens, until we get > > write delegations.) > > > > I think you mean "write opens" there, but yes. > > > Would it work to record a count of delegations on shutdown, to speed up > > the restart-after-clean-shutdown case? And if it worked, would it be > > worth the effort? (Alternatively on shutdown we could stop giving out > > delegations, recall everything, and wait till we had no delegations till > > shutting down completely. Wonder how painful that would be.) > > > > So anyway maybe our best bet is just to hope people upgrade to 4.1 soon. > > > > Those all seem a bit tricky to get right. Slowing down reboots will > suck. From the client standpoint that seems somewhat equivalent to a > grace period delay. The client is stuck either way. > > Counting and recording delegations is an interesting idea, but you'd > have to take care not to record anything until the grace period has > ended. > > That said, I personally don't have a lot of interest in speeding up > v4.0 reclaim. I'm not opposed to any of the above schemes, but I think > we'd be better off just pushing people toward v4.1 if they want the > grace period to be shorter. > > Given the annoyance of the 90s grace period, that might act as a carrot > for encouraging people to switch. > > On that same note, we probably need to discuss switching the default in > mount.nfs to v4.1 sometime soon. Maybe a topic for discussion at the > fall BaT? > -- Jeff Layton <jlayton@xxxxxxxxxxxxxxx> -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
