Parallel build of PDF figures and .fcv snippets by "make -jN" worked
when a single PDF target was given to "make", such as
"make neatfreak; make -j4 eb".
On the other hand, "make -j3 2c 1c eb" ended up in various errors
during parallel runs of pdflatex.
It turns out that the cause of the error is the \include{} commands
in appendix/appendix.tex and perfbook-lt.tex.
\include{} switches to its own .aux file, in this case,
appendix/questions.aux, appendix/toyrcu.aux, and so on.
As their names are common to different PDF targets, those .aux files
can be overwritten/corrupted by parallel runs of pdflatex.
\include{} implies \cleardoublepage both in front of and next to it.
In perfbook, included LaTeX sources have \chapter{} commands and
the implied page breaks are redundant.
By replacing \include{} with \input{}, parallel runs of pdflatex can
be enabled.
There is a couple of minor issues in Makefile WRT parallel runs of
runfirstlatex.sh.
When some of perfbook-xxx.tex files already existed, runfirstlatex.sh
for other main perfbook-yyy.tex could be invoked prematurely before
that .tex file got ready.
Fix it by adding stricter dependencies of perfbook-xxx.aux on
perfbook-xxx.tex.
Also sort out dependencies around here.
autodate.tex now depends only on files in Git repo.
Instead, perfbook_flat.tex acts as a barrier between the file
conversion phase and the pdflatex phase.
Signed-off-by: Akira Yokosawa <akiyks@xxxxxxxxx>
---
Hi Paul,
This is v2 of the RFT patch.
Dependencies of perfbook*.aux, autodate.tex, and perfbook_flat.tex
are straightened up since v1.
As for your concern of regression in PDFs generated, I think we
can compare SyncTeX databases of single and parallel builds.
I did the following steps.
1. Sequential build:
$ make neatfreak; make LATEX_OPT=-synctex=1 2c 1c eb
$ cp perfbook.synctex.gz /tmp/perfbook.sequ.synctex.gz
$ cp perfbook-1c.synctex.gz /tmp/perfbook-1c.sequ.synctex.gz
$ cp perfbook-eb.synctex.gz /tmp/perfbook-eb.sequ.synctex.gz
*WARNING*: "make neatfreak" below will remove *.synctex.gz,
so copy them somewhere out of your working directory!
2. Parallel build:
$ make neatfreak; make -j6 LATEX_OPT=-synctex=1 2c 1c eb
$ cp perfbook.synctex.gz /tmp/perfbook.para.synctex.gz
$ cp perfbook-1c.synctex.gz /tmp/perfbook-1c.para.synctex.gz
$ cp perfbook-eb.synctex.gz /tmp/perfbook-eb.para.synctex.gz
3 Compare SyncTeX databases
$ cd /tmp
$ cmp perfbook.sequ.synctex.gz perfbook.para.synctex.gz
$ cmp perfbook-1c.sequ.synctex.gz perfbook-1c.para.synctex.gz
$ cmp perfbook-eb.sequ.synctex.gz perfbook-eb.para.synctex.gz
In my test, there was no difference.
I think this is getting ready to be applied and pushed.
Thanks, Akira
--
Makefile | 12 +++++++-----
appendix/appendix.tex | 8 ++++----
perfbook-lt.tex | 4 ++--
3 files changed, 13 insertions(+), 11 deletions(-)
diff --git a/Makefile b/Makefile
index 6ee849fd..ee1880ff 100644
--- a/Makefile
+++ b/Makefile
@@ -222,18 +222,20 @@ $(PDFTARGETS): %.pdf: %.tex %.bbl
$(PDFTARGETS:.pdf=.bbl): %.bbl: %.aux $(BIBSOURCES)
bibtex $(basename $@)
-$(PDFTARGETS:.pdf=.aux): $(LATEXGENERATED) $(LATEXSOURCES) $(LST_SOURCES)
+$(PDFTARGETS:.pdf=.aux): %.aux: %.tex $(LATEXGENERATED)
ifeq ($(NEWTXTEXT),)
$(error Font package 'newtx' not found. See #9 in FAQ-BUILD.txt)
endif
sh utilities/runfirstlatex.sh $(basename $@)
-autodate.tex: perfbook-lt.tex $(LATEXSOURCES) $(BIBSOURCES) \
- $(PDFTARGETS_OF_EPS) $(PDFTARGETS_OF_SVG) $(FCVSNIPPETS) $(FCVSNIPPETS_VIA_LTMS) \
- $(GITREFSTAGS) utilities/autodate.sh
+autodate.tex: $(LATEXSOURCES) $(BIBSOURCES) $(SOURCES_OF_SNIPPET) \
+ $(LST_SOURCES) $(FIGSOURCES) $(DOTSOURCES) $(EPSORIGIN) \
+ $(SVGSOURCES) $(GITREFSTAGS) \
+ utilities/autodate.sh
sh utilities/autodate.sh
-perfbook_flat.tex: autodate.tex
+perfbook_flat.tex: autodate.tex $(PDFTARGETS_OF_EPS) $(PDFTARGETS_OF_SVG) \
+ $(FCVSNIPPETS) $(FCVSNIPPETS_VIA_LTMS)
ifndef LATEXPAND
$(error --> $@: latexpand not found. Please install it)
endif
diff --git a/appendix/appendix.tex b/appendix/appendix.tex
index f2640157..edcfe7ef 100644
--- a/appendix/appendix.tex
+++ b/appendix/appendix.tex
@@ -2,9 +2,9 @@
% mainfile: ../perfbook.tex
% SPDX-License-Identifier: CC-BY-SA-3.0
-\include{appendix/questions/questions}
-\include{appendix/toyrcu/toyrcu}
-\include{appendix/whymb/whymemorybarriers}
-\include{appendix/styleguide/styleguide}
+\input{appendix/questions/questions}
+\input{appendix/toyrcu/toyrcu}
+\input{appendix/whymb/whymemorybarriers}
+\input{appendix/styleguide/styleguide}
\renewcommand{\bottomtitlespace}{.08\textheight}
\QuickQuizAnswers
diff --git a/perfbook-lt.tex b/perfbook-lt.tex
index 085ce55d..d70dde66 100644
--- a/perfbook-lt.tex
+++ b/perfbook-lt.tex
@@ -667,12 +667,12 @@
% Credits
\setcounter{secnumdepth}{-1} % surpress section numbering in backmatter
-\include{ack}
+\input{ack}
% Index if enabled
\IfIndexOn{
\IfIndexHier{
-\include{indexsee}
+\input{indexsee}
}{}
\phantomsection
\IfEbookSize{
base-commit: f24ccfbd345eab8a70d6c08e71c84f18df46a3a1
--
2.17.1
