Re: [PATCH] Stop Background mounts hang from hanging

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Sorry... a long "lunch"... It is Friday! ;-) 


On 03/07/2014 11:10 AM, Trond Myklebust wrote:
> 
> On Mar 7, 2014, at 10:47, Steve Dickson <SteveD@xxxxxxxxxx> wrote:
> 
>>
>>
>> On 03/07/2014 10:36 AM, Trond Myklebust wrote:
>>>
>>> On Mar 7, 2014, at 10:02, Steve Dickson <steved@xxxxxxxxxx> wrote:
>>>
>>>> Background mounts hang forever due to the kernel not returning 
>>>> the time out error. The proposed fix is twofold, one in the kernel 
>>>> and one in the mounting code.
>>>>
>>>> The kernel patch stop the server trunking code from endlessly 
>>>> looping in the kernel on -ETIMEDOUT errors. Instead, the code 
>>>> will now return the error, allowing the mount to go into 
>>>> the background.
>>>>
>>>> Unfortunately, it takes over 5 mins for this timeout to 
>>>> happen, due the default retry strategy, which is unacceptable 
>>>> for background mounts. 
>>>>
>>>> So the patch I will be proposing for the mount code will be 
>>>> to append the "retrans=1,timeo=100" mount options to the parent
>>>> mount of the background mount (when they don't exist). This
>>>> causes the parent mount to timeout in ~25sec. 
>>>
>>> We already have a ‘retry=‘ option for mount.nfs. According to the manpage, that should be used to specify the timeout value. Why not reuse that?
>> Because it didn't work... retrans and timeo had most effect on the initial times set
>> in  nfs_init_timeout_values()
>>
>>>
>>> Also, it really would be better if that timeout were under control of the mount utility itself. 
>> Using those options, it is under the control of mount, unless I'm misunderstanding you...
>>
>>> How about if we allow the use of alarm() to interrupt that particular RPC call?
>> Why just use the mechanisms that already exist? Why invent a new one? Was my reasoning...
> 
> alarm() is hardly a ‘new’ mechanism. It is the standard way of doing 
> this thing in user space, and should, in fact, already work with existing kernels, 
> since they allow fatal signals to interrupt all killable NFS and RPC sleeps.
I meant a new mechanism to the mount command... not that alarm() is a new mechanism.

> 
> The point is that relying on ‘retrans’ and ‘timeo’ in this context is likely to be frustrating. 
> ‘retrans’ and ‘timeo’ act on a per RPC call, and there are many RPC calls involved in a single 
> NFSv4/v4.1 mount call. 
Right and that's what I was thinking we needed... 

Reading the nfs(5) man page it says "a timeout or failure causes the 
mount(8) command to fork a child..." The key word being "a". So we what 
the mount to go into background on the first timeout, which what happens 
when you set ‘retrans’ and ‘timeo’.

Plus it appears v3 works that way... On the first timeout the mount command forks...

> Furthermore, the server may reply with something like DELAY or equivalent, 
> which doesn’t trigger a timeout, but keeps the kernel retrying the same RPC 
> call over and over again.
> Then there is the possibility that the hang may occur somewhere other than in the 
> one place you chose (for instance in the path walk). What then?
I was say that's a kernel bug... a timeout is a very legitimate error to return. 
 
> 
> We can’t and we won’t add a load of stuff to the kernel to catch all the possible 
> sources of delay for a mount operation.
A "delay" is different than an timeout. A timeout is an error and a delay is not... 
Looping in the kernel *forever* due to a timeout error that is easily 
manged by the userspace, is a kernel bug... IMHO... 

The client should not make the assumption the userspace does not
want to know about timeout errors. On the contrary, it *needs* to
know about these errors so they can do something about it...

> That’s why if we can do it in userspace, then we should.
This is exactly what I want to do... Have the userspace manage 
timeouts... But it has to get them, to manage them.

Using the alarm() system call bases the decision of when 
to fork on a arbitrary number of seconds. Using ‘retrans’ 
and ‘timeo’ bases that decision on an *actual* timeout

Why interrupt a perfectly good RPC just because due
to an arbitrary number of seconds? Let the RPC 
timeout and simply report that fact....

steved.
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [Linux Filesystem Development]     [Linux USB Development]     [Linux Media Development]     [Video for Linux]     [Linux NILFS]     [Linux Audio Users]     [Yosemite Info]     [Linux SCSI]

  Powered by Linux