Re: Comments on draft-ietf-lemonade-reconnect-client-06

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Eric,
Thank you for your comments.

(Today is about the worst time for me to reply to your comments, as I am going on holidays tomorrow.)

Eric Rescorla wrote:

$Id: draft-ietf-lemonade-reconnect-client-06-rev.txt,v 1.1 2007/10/04 22:25:53 ekr Exp $


OVERALL
This document describes an extension to IMAP to provide faster
synchronization between client and server. As far as I can
tell, the optimizations are:

- Removing one round trip needed to discover which messages
 have been expunged.
Yes, if compared to the case when the client/server also implement the CONDSTORE extension (RFC 4551).
(Actually it removed 2 round trips per mailbox synchronization.)

When compared to RFC 3501, this extension can potentially provides huge bandwidth saving. If a client wants to synchronize flag changes in a mailbox, the client needs to fetch flags for *all* mailboxes. For a 30,000 message mailbox that I currently have is quite painful over a slow link.

- A more compact representation of the list of expunged
 messages
Correct.

I have some skepticism about the importance of these optimizations.
See above.

The document does not come with any performance measurements,
and 1 RTT really isn't that much. In particular, I wonder if
VANISHED really saves that much bandwidth over EXPUNGED if
compression is in use. I don't know what standard is being
used to decide whether optimizations of this type are worthwhile.
I will let Dave comment on this.

Just a couple of extra comments:
1). As I mentioned above, this extension saves 2 round trips per mailbox synchronization. A user might have multiple mailboxes. 2). This is mostly useful for mobile clients which can experience frequent connection loss.

I found this document fairly hard to read. I understand that it's
a delta to IMAP and requires quite a bit of knowledge of IMAP
to understand, but I think it could have been written to be
more clear about how it changes IMAP's behavior in each case.
In particular, the examples would be improved by always
having New and Old and having some sort of indicator of exactly
which PDUs have changed and why.
Right.

DETAILED COMMENTS
S 2.
This would be improved by some overall diagram of the new and
old behavior and some measurement, even an ad hoc one, of
the performance improvement.
Ok. An older version of this document had some numbers, but people complained about "irrelevant text". See section 2.1 of <http://tools.ietf.org/id/draft-ietf-lemonade-reconnect-07.txt> (Note that the protocol has changed substantially since, but the basic observation is still correct.)

S 3.1.

  Conceptually, the client provides a small sample of sequence numbers
  for which it knows the corresponding UIDs.  The server then compares
  each sequence number and UID pair the client provides with the
  current state of the mailbox.  If a pair matches, then the client
  knows of any expunges up to, and including, the message, and thus
  will not include that range in the VANISHED response, even if the
  "mod-sequence-value" provided by the client is too old for the server
  to have data of when those messages were expunged.

This is probably my ignorance of IMAP, but how can this happen? Why
doesn't the client have a mod-sequence-value corresponds to these
UIDs?
I will let Dave explain this.

     S: * VANISHED (EARLIER) 1:2,4:5,7:8,10:11,13:14 [...]
        29998:29999,30001:30002,30004:30005,30007:30008

This [...] hides the data you're optimizing away, right? This
would help if it were called out more clearly.
Yes. I will add a sentence on this.

S 3.3, 3.4, 3.5.
These would all benefit from a statement of how they differ from
3501, rather than just stating new rules.
(Actually, 3.5 updates UID EXPUNGE which was defined in RFC 4315.)

Right. I believe some people wanted to see sections replacing the old definitions, as opposed to just pointing out the difference from RFC 3501.

The following text in section 2 summarizes the difference:

  This document puts additional requirements on a server implementing
  the [CONDSTORE] extension.  Each mailbox that supports persistent
  storage of mod-sequences, i.e., for which the server has sent a
  HIGHESTMODSEQ untagged OK response code on a successful SELECT/
  EXAMINE, MUST increment the per-mailbox mod-sequence when one or more
  messages are expunged due to EXPUNGE, UID EXPUNGE or CLOSE; the
  server MUST associate the incremented mod-sequence with the UIDs of
  the expunged messages.

I can try to add a sentence to each one of 3.3, 3.4 and 3.5 to clarify that.

  If the server is capable of storing modification sequences for the
  selected mailbox, it MUST increment the per-mailbox mod-sequence if
  at least one message was permanently removed due to the execution of
  the EXPUNGE command.  For each permanently removed message the server
  MUST remember the incremented mod-sequence and corresponding UID.  If
  at least one message got expunged, the server MUST send the updated
  per-mailbox modification sequence using the HIGHESTMODSEQ response
  code (defined in [CONDSTORE]) in the tagged OK response.

So, this is repeated in all three sections. That seems less than
optimal.

Rather than refing 3501, it would probably be good to point out
why the message #s are as they are in these examples, due to
auto-decrement.
I've added a clarifying sentence to sections 3.3 and 3.5. I don't think section 3.4 needs to change.

S 3.6.
  The VANISHED response has two forms.  The first form contains the
  EARLIER tag, which signifies that the response was caused by a UID
  FETCH (VANISHED) or a SELECT/EXAMINE (QRESYNC) command.  This
  response is sent if the UID set parameter to the UID FETCH (VANISHED)
  command includes UIDs of messages that are no longer in the mailbox.
  When the client sees a VANISHED EARLIER response it MUST NOT
  decrement message sequence numbers for each successive message in the
  mailbox.

  The second form doesn't contain the EARLIER tag and is described
  below.  Once a client has used "(VANISHED)" with a UID FETCH or
  "(QRESYNC)" with SELECT/EXAMINE command, the server SHOULD use the
  VANISHED response without the EARLIER tag instead of the EXPUNGE
  response.  The server SHOULD continue using VANISHED in lieu of
  EXPUNGE for the duration of the connection.  In particular this
  affects the EXPUNGE [RFC3501] and UID EXPUNGE [UIDPLUS] commands, as
  well as messages expunged in other connections.  Such VANISHED
  response MUST NOT contain the EARLIER tag.

This is pretty unclear to the non-IMAP expert. Could you explain
in english what this is trying to accomplish in the document,
not just specify the protocol mechanics.
Basically the VANISHED response is used for 2 purposes: to report UIDs of messages expunged earlier and to report UIDs of messages expunged now. The difference between the two is that in the former case the client doesn't need to decrement the number of messages in the mailbox, while in the latter case it must. The former can be distinguished from the latter by presence of the "(EARLIER)" label.

In the example, swap before and after. Also, it would be good
to show an example of (EARLIER).
Ok.

S 4.1.
  Strictly speaking, a server implementation that doesn't remember
  modsequences associated with expunged messages can be considered
  compliant with this specification.  Such implementations return all
  expunged messages specified in the UID set of the UID FETCH
  (VANISHED) command every time, without paying attention to the
  specified CHANGEDSINCE modsequence.  Such implementations are
  discouraged, as they can end up returning VANISHED responses bigger
  than the result of a UID SEARCH command for the same UID set.

Isn't this inconsistent with:

  If the server is capable of storing modification sequences for the
  selected mailbox, it MUST increment the per-mailbox mod-sequence if
  at least one message was permanently removed due to the execution of
  the EXPUNGE command.  For each permanently removed message the server
  MUST remember the incremented mod-sequence and corresponding UID.  If
  at least one message got expunged, the server MUST send the updated
  per-mailbox modification sequence using the HIGHESTMODSEQ response
  code (defined in [CONDSTORE]) in the tagged OK response.

If not, why not?
No, there is no inconsistency:

"a server implementation that doesn't remember modsequences" == "a server is incapable of storing modsequences". The second paragraph you quoted is conditional on server's ability to store modsequences. This behaviour is optional for servers.

S 5.
  The client MUST also take note of any MODSEQ FETCH data items
  received from the server.  Whenever the client receives a tagged
  response to a command, it calculates the highest value among all
  MODSEQ FETCH data items received since the last tagged response.  If
  this value is bigger than the client's copy of the HIGHESTMODSEQ
  value, then the client MUST use this value as its new HIGHESTMODSEQ
  value.

So, I probably misunderstand something, but my read of 4551 made
it seem like you could do a MODSEQ FETCH that would not return
all the metadata for every message.

Yes, if the client issues a FETCH MODSEQ for a subset of messages. However the previous paragraph in the same section requires the client to perform a full synchronization.

In that case, wouldn't this
procedure risk you having a modseq that is higher than some
messages you haven't examined yet? What am I missing.
The intent of this paragraph is to talk about unsolicited FETCH MODSEQ returned by the server *after* a full synchronization is complete (the previous paragraph in the same section). So the situation you describe can't happen, because the server is required to send all unsolicited FETCH MODSEQ responses. The beginning of this paragraph is ambiguous, so I suggest that it should be clarified by changing the first quoted sentence to read:

After completing full synchronization, the client MUST also take note of any MODSEQ FETCH data items received from the server.

I don't see any new security issues in this document.
Regards,
Alexey


_______________________________________________

Ietf@xxxxxxxx
https://www1.ietf.org/mailman/listinfo/ietf

[Index of Archives]     [IETF Annoucements]     [IETF]     [IP Storage]     [Yosemite News]     [Linux SCTP]     [Linux Newbies]     [Fedora Users]