(cc'ing Lai) Hello, On Tue, Jul 29, 2014 at 02:23:03PM +0200, Peter Zijlstra wrote: > > It's because we don't distinguish work items which are per-cpu for > > optimization and per-cpu for correctness and can't automatically flush > > / cancel / block per-cpu work items when a cpu goes down. I like the > > idea of distingushing them but it's gonna take a lot of auditing. > > Just force flush on unplug and fix those that complain. No auditing > needed for that. I'm not sure that's a viable way forward. It's not like we can readily trigger the problematic cases which can lead to long pauses during cpu down. Besides, we need the distinction at the API level, which is the whole point of this. The best way probably is converting all the correctness ones (these are the minorities) over to queue_work_on() so that the per-cpu requirement is explicit. > > Any work item usage which requires per-cpu for correctness should > > implement cpu down hook to flush in-flight work items and block > > further issuance. This hasn't changed from the beginning and was > > necessary even before cmwq. > > I think before cmwq we'd run into the broken affinity warning in the > scheduler. That and work items silently not executed if queued on a downed cpu. IIRC, we also had quite a few broken ones which were per-cpu but w/o cpu down handling which just happened to work most of the time because queueing itself was per-cpu in most cases and we didn't do cpu on/offlining as often back then. During cmwq conversion, I just allowed them as I didn't want to add cpu down hooks for all of the many per-cpu workqueue usages. The lack of the distinction between the two sets has always been there. I agree this can be improved, but at least for now, please add cpu down hooks. We need them right now and they'll be helpful when later separating out the correctness ones. Thanks. -- tejun -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@xxxxxxxxx. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"dont@xxxxxxxxx"> email@xxxxxxxxx </a>