"Scheffenegger, Richard" <Richard.Scheffenegger@xxxxxxxxxx> writes: > Unless I’m mistaken, the procedure to create a zip archive reads like a recursive collection of all relevant objects, and then writing them out sequentially, in a single thread. > > Is this assessment correct? > > I was wondering if a highly concurrent fetching phase could be optionally added… The details matter here, I think. Enumerating and slurping down the contents to be archived out of the repository/object store to the core can indeed be made parallel, but the end result product being a zip archive or a tarball, which is fairly a serialized output format, there is only so much you can hold in core, and it is not clear what your plan is to do this without filling all the memory.
