Re: [PATCH] doc-rst:sphinx-extensions: add metadata parallel-safe

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Am 01.09.2016 um 18:22 schrieb Markus Heiser <markus.heiser@xxxxxxxxxxx>:

> 
> Am 01.09.2016 um 16:29 schrieb Jani Nikula <jani.nikula@xxxxxxxxxxxxxxx>:
> 
>> On Thu, 01 Sep 2016, Jonathan Corbet <corbet@xxxxxxx> wrote:
>>> On Wed, 24 Aug 2016 15:35:24 +0200
>>> Markus Heiser <markus.heiser@xxxxxxxxxxx> wrote:
>>> 
>>>> With metadata "parallel_read_safe = True" a extension is marked as
>>>> save for "parallel reading of source". This is needed if you want
>>>> build in parallel with N processes. E.g.:
>>>> 
>>>> make SPHINXOPTS=-j4 htmldocs
>>> 
>>> A definite improvement; applied to the docs tree, thanks.
>> 
>> The Sphinx docs say -jN "should be considered experimental" [1]. Any
>> idea *how* experimental that is, really? Could we add some -j by
>> default?
> 
> My experience is, that parallel build is only strong on "reading
> input" and weak on "writing output". I can't see any rich performance
> increase on more than -j2 ... 
> 
> Mauro posted [2] his experience with -j8 compared to serial. He
> also compares -j8 to -j16:
> 
>> PS: on my server with 16 dual-thread Xeon CPU, the gain with a
>> bigger value for -j was not impressive. Got about the same time as
>> with -j8 or -j32 there.
> 
> I guess he will get nearly the same results with -j2 ;)
> 
> If we want to add a -j default, I suggest -j2. 
> 
> [2] https://www.mail-archive.com/linux-doc%40vger.kernel.org/msg05552.html
> 
> -- Markus --
> 

Sorry, forget to mentioning, that there has been some improvements
to parallel build in Sphinx 1.3 compared to 1.2. But in 1.3.2 they
have also fixed a bug which lets parallel builds hang :-o

https://github.com/sphinx-doc/sphinx/blob/master/CHANGES#L665

This in mind and if we really support down to sphinx 1.2 ... we
should not use any -j default.

IMHO we should get rid of this sphinx 1.2. downward compatibility,
it makes so may problems (e.g. see [3]) ... but we have discussed
this already and I don't want to restart this thread ;-) 

[3] https://www.mail-archive.com/linux-doc%40vger.kernel.org/msg05695.html

-- Markus --



> 
>> BR,
>> Jani.
>> 
>> 
>> [1] http://www.sphinx-doc.org/en/stable/invocation.html#invocation-of-sphinx-build
>> 
>> -- 
>> Jani Nikula, Intel Open Source Technology Center
> 
> --
> To unsubscribe from this list: send the line "unsubscribe linux-doc" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

--
To unsubscribe from this list: send the line "unsubscribe linux-media" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux Input]     [Video for Linux]     [Gstreamer Embedded]     [Mplayer Users]     [Linux USB Devel]     [Linux Audio Users]     [Linux Kernel]     [Linux SCSI]     [Yosemite Backpacking]
  Powered by Linux