Re: [PATCH v6 00/10] NFSD support for asynchronous COPY

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Fri, Dec 8, 2017 at 3:30 PM, Olga Kornievskaia <aglo@xxxxxxxxx> wrote:
> On Mon, Dec 4, 2017 at 4:32 PM, J. Bruce Fields <bfields@xxxxxxxxxx> wrote:
>> On Thu, Nov 30, 2017 at 06:03:08PM -0500, Olga Kornievskaia wrote:
>>> On Thu, Nov 30, 2017 at 3:18 PM, J. Bruce Fields <bfields@xxxxxxxxxxxx> wrote:
>>> > On Tue, Nov 28, 2017 at 03:28:46PM -0500, Olga Kornievskaia wrote:
>>> >> On Mon, Nov 13, 2017 at 7:48 PM, J. Bruce Fields <bfields@xxxxxxxxxx> wrote:
>>> >> > On Fri, Nov 10, 2017 at 10:01:02AM -0500, Olga Kornievskaia wrote:
>>> >> >> On Fri, Nov 3, 2017 at 3:57 PM, Olga Kornievskaia <aglo@xxxxxxxxx> wrote:
>>> >> >> > Bruce, any comments on this version?
>>> >> >>
>>> >> >> Bruce, do you have any comments on this version?
>>> >> >
>>> >> > I don't yet, apologies.  It is on my list to look at.
>>> >> >
>>> >>
>>> >> Any ideas as to when that would be?
>>> >
>>> > Sorry for the silence.  I'll try to get it reviewed in time for 4.16.
>>>
>>> I hope I won't forget too much in 3months for this ;)
>>>
>>> > But I'm worrying about async behavior.  Just the usual complaint:
>>> >
>>> >         - A large copy could take anywhere from milliseconds to hours.
>>>
>>> With the sync copy your worry was with tying up the nfsd thread. Here
>>> each copy gets its own thread and doesn't interfere with other
>>> operations. So why worry?
>>
>> I'm mainly just worried about the lack of feedback to the user.  "cp"
>> doesn't traditionally give any, but other programs that copy data do,
>> and they'll have to decide what to do instead.
>>
>>> >         - The only way the protocol gives to measure progress is
>>> >           OFFLOAD_STATUS, but I'm pessimistic that we'll get a
>>> >           corresponding copy_progress syscall interface that
>>> >           applications will get patched to use.
>>>
>>> Doing a cp, never had a status info so what's different now.
>>> Interested folks can do as before ls -l dst_file to monitor progress.
>>
>> Maybe it'll be no big deal.  I'm not completely opposed to trying and
>> finding out, partly because it shouldn't be that hard to back out later
>> if necessary.
>>
>>> > So, currently the server's trying to avoid the problem by returning
>>> > short COPY results and hoping applications will handle that gracefully
>>> > (and that readahead and write behind will save performance).
>>>
>>> We have demonstrated that doing async copy performs significantly
>>> better (given large enough file size which was different between intra
>>> and inter copy but something like 16MB). Really there is no point in
>>> introducing an asynchronous copy unless you are doing all of it.
>>
>> Sorry, I can't find that right now, do you have a URL or a message id?
>
> I re-sent it to you.
>
>>> > But I guess that won't work in the server-to-server case.  Or would it?
>>> > I *think* you can just send one NOTIFY
>>>
>>> NOTIFY is only for "inter" server-to-server copy and we are currently
>>> reviewing "asynchronous intra" copy?
>>>
>>> > and then reuse the same stateid
>>> > in multiple COPYs, so maybe it's not any worse than in the single-server
>>> > case.
>>>
>>> No you can not reuse the same stateid in multiple COPY's (spec doesn't
>>> allow it). It has to uniquely identity the copy. Otherwise, when
>>> client receives a reply from the async COPY it doesn't know which out
>>> of those multiple copies to match it to.
>>
>> Why couldn't a client reuse the stateid after a synchronous COPY?
>
> This line of questions is confusing. Why are you asking about
> synchronous COPY? We don't have an implementation of a synchronous
> "inter" COPY. It's only async. NOTIFY is present only in an inter
> COPY. NOTIFY generates a unique copy stateid to be used by a COPY. I
> guess I always assumed it meant one time use even for a synchronous
> copy. You definitely can't reuse the copy stateid for the async copy.
> Given that COPY is specified in general states that a unique stateid
> must be used then I think we can't separate synchronous from
> asynchronous case to re-use in one and not in the other.

Hi Bruce,

Any update on the patch series review?
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux Filesystem Development]     [Linux USB Development]     [Linux Media Development]     [Video for Linux]     [Linux NILFS]     [Linux Audio Users]     [Yosemite Info]     [Linux SCSI]

  Powered by Linux