On Wed, Nov 11, 2020 at 02:23:28PM -0800, Vinicius Costa Gomes wrote: > Miroslav Lichvar <mlichvar@xxxxxxxxxx> writes: > > On Tue, Nov 10, 2020 at 11:06:07AM -0800, Vinicius Costa Gomes wrote: > >> The NIC I have supports PTM cycles from every ~1ms to ~512ms, and from > >> my tests it wants to be kept running "in background" always, i.e. set > >> the cycles to run, and only report the data when necessary. Trying to > >> only enable the cycles "on demand" was unreliable. > > > > I see. It does makes sense if the clocks need to be are synchronized. > > For the case of this ioctl, I think it would be better if it we could > > just collect the measurements and leave the clocks free running. > > Not sure if I understand. This is what this series does, it only adds > support for starting the PTM cycles and reporting the measurements. Ok, great. I meant that the apparent requirement to keep the measurements running periodically in background made sense if the clocks were synchronized by the hardware. Now I realize that wouldn't work for phc2sys unless there was a separate clock and something tracking the offset between the two clocks. Considering how the existing applications work, ideally the measurements would be performed on demand from the ioctl to minimize the delay. If that's not possible, maybe it would be better to provide the measurements on a descriptor at their own rate, which could be polled by the applications, similarly to how the PTP_EXTTS_REQUEST ioctl works? > > I suspect a bigger issue, for both the PRECISE and EXTENDED variants, > > is that it would return old data. I'm not sure if the existing > > applications are ready to deal with that. With high clock update > > rates, a delay of 50 milliseconds could cause an instability. You can > > try phc2sys -R 50 and see if it stays stable. > > After a couple of hours of testing, with the current 50ms delay, > 'phc2sys -R 50' is stable, but I got the impression that it takes longer > (~10s) to get to ~10ns offset. That sounds like it could break in some specific conditions. Please try slightly different -R values and when it's running, try inserting a step with date -s '+0.1 sec' and see how reliable is the recovery. You can also test it with a different servo: phc2sys -E linreg. > There might be a problem, the PTM dialogs start from the device, the > protocol is more or less this: > > 1. NIC sends "Request" message, takes T1 timestamp; > 2. Host receives "Request" message, takes T2 timestamp; > 3. Host sends "Response" message, takes T3 timestamp; > 4. NIC receives "Response" message, takes T4 timestamp; > > So, T2 and T3 are "host" timestamps and T1 and T4 are NIC timestamps. Is that the case even when there is a PTM-enabled switch between the CPU and NIC? My understanding of the spec is that the switches are supposed to have their own clocks and have separate PTM dialogs on their upstream and downstream ports. In terms of PTP, are the switches boundary or transparent clocks? > That means that the timestamps I have "as is" are a bit different than > the expectations of the EXTENDED ioctl(). > > Of course I could use T3 (as the "pre" timestamp), T4 as the device > timestamp, and calculate the delay[1], apply it to T3 and get something > T3' as the "post" timestamp (T3' = T3 + delay). But I feel that this > "massaging" would defeat the purpose of using the EXTENDED variant. > > Does it make sense? Am I worrying too much? > > [1] > delay = ((T4 - T1) - (T3 - T2)) / 2 Yes, I think that would work, except the delay would need to be doubled in the T3' calculation. The important thing is that the offset and delay calculated from the timestamps don't change. It might be better to shift the timestamps back to avoid the "post" timestamp coming from future, which applications could drop as invalid. To not shift the middlepoints in the conversion, this should work: T1' = (T2 + T3) / 2 - delay T2' = (T1 + T4) / 2 T3' = (T2 + T3) / 2 + delay -- Miroslav Lichvar