On Mon, 4 Oct 2021 at 22:30, Quentin Monnet <quentin@xxxxxxxxxxxxx> wrote: > > On Mon, 4 Oct 2021 at 20:11, Andrii Nakryiko <andrii.nakryiko@xxxxxxxxx> wrote: > > > > On Sat, Oct 2, 2021 at 3:12 PM Quentin Monnet <quentin@xxxxxxxxxxxxx> wrote: > > > > > > On Sat, 2 Oct 2021 at 21:27, Quentin Monnet <quentin@xxxxxxxxxxxxx> wrote: > > > > > > > > On Sat, 2 Oct 2021 at 00:20, Andrii Nakryiko <andrii.nakryiko@xxxxxxxxx> wrote: > > > > > > > > > > On Fri, Oct 1, 2021 at 4:09 AM Quentin Monnet <quentin@xxxxxxxxxxxxx> wrote: > > > > > > > > > > > > API headers from libbpf should not be accessed directly from the > > > > > > library's source directory. Instead, they should be exported with "make > > > > > > install_headers". Let's make sure that bpf/preload/iterators/Makefile > > > > > > installs the headers properly when building. > > > > > > > > > > > > > > > > -$(BPFOBJ): $(wildcard $(LIBBPF_SRC)/*.[ch] $(LIBBPF_SRC)/Makefile) | $(OUTPUT) > > > > > > +$(BPFOBJ): $(wildcard $(LIBBPF_SRC)/*.[ch] $(LIBBPF_SRC)/Makefile) \ > > > > > > + | $(LIBBPF_OUTPUT) $(LIBBPF_INCLUDE) > > > > > > > > > > Would it make sense for libbpf's Makefile to create include and output > > > > > directories on its own? We wouldn't need to have these order-only > > > > > dependencies everywhere, right? > > > > > > > > Good point, I'll have a look at it. > > > > Quentin > > > > > > So libbpf already creates the include (and parent $(DESTDIR)) > > > directory, so I can get rid of the related dependencies. But I don't > > > see an easy solution for the output directory for the object files. > > > The issue is that libbpf's Makefile includes > > > tools/scripts/Makefile.include, which checks $(OUTPUT) and errors out > > > > Did you check what benefits the use of tools/scripts/Makefile.include > > brings? Last time I had to deal with some non-trivial Makefile > > problem, this extra dance with tools/scripts/Makefile.include and some > > related complexities didn't seem very justified. So unless there are > > some very big benefits to having tool's Makefile.include included, I'd > > rather simplify libbpf's in-kernel Makefile and make it more > > straightforward. We have a completely independent separate Makefile > > for libbpf in Github, and I think it's more straightforward. Doesn't > > have to be done in this change, of course, but I was curious to hear > > your thoughts given you seem to have spent tons of time on this > > already. > > No, I haven't checked in details so far. I remember that several > elements defined in the Makefile.include are used in libbpf's > Makefile, and I stopped at that, because I thought that a refactoring > of the latter would be beyond the current set. But yes, I can have a > look at it and see if it's worth changing in a follow-up. Looking more at tools/scripts/Makefile.include: It's 160-line long and does not include any other Makefile, so there's nothing in it that we couldn't re-implement in libbpf's Makefile if necessary. This being said, it has a number of items that, I think, are good to keep there and share with the other tools. For example: - The $(EXTRA_WARNINGS) definitions - QUIET_GEN, QUIET_LINK, QUIET_CLEAN, which are not mandatory to have but integrate nicely with the way other tools (or kernel components) are built - Some overwrites for the toolchain, if $(LLVM) or $(CROSS_COMPILE) are set Thinking more about this, if we want to create the $(OUTPUT) directory in libbpf itself, we could maybe just enclose the check on its pre-existence in tools/scripts/Makefile.include with a dedicated variable ("ifneq ($(_skip_output_check),) ...") and set the latter in Makefile.include. This way we wouldn't have to change the current Makefile infra too much, and can keep the include. Quentin