On Wednesday 2020-06-03 19:16, Harald Welte wrote: > >On Wed, Jun 03, 2020 at 01:37:12PM +0200, Pablo Neira Ayuso wrote: >> So netfilter.org will also be shutting down FTP services by >> June 12th 2020. > >I always find that somewhat sad, as with HTTP there is no real convenient >way to get directory listings in a standardized / parseable format. There was convention, but no standard. Which is just like what the default directory index modules of the httpd implementations are. >I think the important part would be some way to conveniently obtain a >full clone, e.g. by rsync. This way both public and private mirrors >can exist in an efficient way, without having to resort to 'wget -r' >or related hacks, which then only use file size as an indication if a >file might have changed, ... For completeness though, there is the "Last-Modified" HTTP header (similar to what rsync bases its heuristic on). rsync is of course always preferable..