On 09/07/2017 08:25 PM, Ming Lei wrote: > On Thu, Sep 07, 2017 at 01:47:44PM -0600, Jens Axboe wrote: >> On 09/07/2017 01:38 PM, Linus Torvalds wrote: >>> On Thu, Sep 7, 2017 at 12:27 PM, Jens Axboe <axboe@xxxxxxxxx> wrote: >>>> >>>> Which was committed yesterday? It was not from my tree. I try to keep >>>> an eye out for potential conflicts or issues. >>> >>> It was from Andrew, so I'm assuming it was in linux-next. Not as a git >>> tree, but as the usual akpm branch. >>> >>> I'm not sure why I didn't see any reports from linux-next about it, >>> though - and I looked. >>> >>> There was no actual visible merge problem, because the conflict was >>> not a data conflict but a semantic one. >>> >>> But the issue showed up for a trivial allmodconfig build, so it >>> *should* have been caught automatically. >>> >>> But it's not even the conflict that annoys me. >>> >>> It's the *reason* for the conflict - the block layer churn that you >>> said was done. We've had too much of it. >>> >>>>> We need *stability* by now, after these crazy changes. Make sure >>>>> that happens. >> >> I might have missed a build notice from linux-next, since I know for a >> fact that all my stuff is in -next, updated daily, and Andrew's tree >> definitely is too. >> >>>> I am pushing back, but I can't embargo any sort of API change. This one has >>>> good reasoning behind it, which is actually nicely explained in the commit >>>> itself. It's not pointless churn, which I would define as change just for >>>> the sake of change itself. Or pointless cleanups. >>> >>> You can definitely put your foot down on any more random changes to >>> the bio infrastructure. Including for good reasons. >> >> And I am, but this one wasn't random. As I said, some of the previous >> releases have had more frivolous changes that should have been pushed >> back harder on. And particularly nvme, where fixes that go in after the >> merge window have been doing pointless cleanups while fixing issues, >> causing unnecessary pain for the next release. I am definitely pushing >> back hard on those, just last week after more of that showed up. >> >> You'll see exactly one of those when I send in the next merge request, >> which sucks, and which was the reason the yelling in that area recently. >> >>> We have had some serious issues in the block layer - and I'm not >>> talking about the merge conflicts. I'm talking about just the >>> collateral damage, with things like SCSI having to revert using blk-mq >>> by default etc. >> >> I'm a bit puzzled as to why the suspend/resume thing has existed for so >> long, honestly. But some of these issues don't show themselves until you >> flip the switch. A lot of the production setups have been using scsi-mq >> for YEARS without issues, but obviously they don't hit this. Given how >> big of a switch this is, it's hard to avoid minor fallout. We're dealing >> with it. > > Hi Jens, > > If you mean the I/O hang during suspend/resume reported by Oleksandr, > that shouldn't be blk-mq only. The root cause is in SCSI's quiesce > design(even in blk-mq's quiesce, but no such issue because no new > request is allocated in the context which queue is quiesced.) > > The issue is a bit long-term, since Cathy can reproduce this kind of > I/O hang on 2.6.32 based kernel. > > I am working on fixing that[1], but looks the preempt quiesce still > need to be nested, so will post out V4 with supporting nested preempt> quiesce. OK good to know, that makes me feel a little better. > The real SCSI_MQ regression is the report of 'SCSI-MQ performance > regression'[2], and the commit of 'scsi: default to scsi-mq' was > reverted after this report. Patch for this regression has been > posted for several round, and the V4 [3] should be ready for merge, looks > it is ignored because of the merge timing? It's not ignored, but it's also quite tricky and needs a lot of testing. With iterations getting this close to the merge window, I didn't feel comfortable pulling it in this later in the cycle. I did run it through my usual testing and haven't seen any issues. My main concern was around the hw queue serialization, this is something that is notoriously tricky to get right for all cases without introducing live locks or stalls. -- Jens Axboe
