On Tue, Apr 12 2022, Junio C Hamano wrote:
> * ab/ci-github-workflow-markup (2022-03-27) 7 commits
> - ci: call `finalize_test_case_output` a little later
> - ci: use `--github-workflow-markup` in the GitHub workflow
> - ci: optionally mark up output in the GitHub workflow
> - test(junit): avoid line feeds in XML attributes
> - tests: refactor --write-junit-xml code
> - ci: make it easier to find failed tests' logs in the GitHub workflow
> - Merge branch 'ab/ci-setup-simplify' into ab/ci-github-workflow-markup
> (this branch uses ab/ci-setup-simplify.)
>
> Build a moral equivalent of js/ci-github-workflow-markup on top of
> ab/ci-setup-simplify.
>
> How does this compare feature-wise with js/ci-github-workflow-markup?
> source: <RFC-cover-v3-0.6-00000000000-20220325T183946Z-avarab@xxxxxxxxx>
...[covered below]...
> * ab/ci-setup-simplify (2022-03-27) 25 commits
> - CI: don't use "set -x" in "ci/lib.sh" output
> - CI: set PYTHON_PATH setting for osx-{clang,gcc} into "$jobname" case
> - CI: set CC in MAKEFLAGS directly, don't add it to the environment
> - CI: add more variables to MAKEFLAGS, except under vs-build
> - CI: narrow down variable definitions in --build and --test
> - CI: only invoke ci/lib.sh as "steps" in main.yml
> - CI: pre-select test slice in Windows & VS tests
> - ci/run-test-slice.sh: replace shelling out with "echo"
> - CI: move "env" definitions into ci/lib.sh
> - CI: combine ci/install{,-docker}-dependencies.sh
> - CI: split up and reduce "ci/test-documentation.sh"
> - CI: invoke "make artifacts-tar" directly in windows-build
> - CI: check ignored unignored build artifacts in "win[+VS] build" too
> - CI: remove "run-build-and-tests.sh", run "make [test]" directly
> - CI: export variables via a wrapper
> - CI: consistently use "export" in ci/lib.sh
> - CI: move p4 and git-lfs variables to ci/install-dependencies.sh
> - CI: have "static-analysis" run "check-builtins", not "documentation"
> - CI: have "static-analysis" run a "make ci-static-analysis" target
> - CI: don't have "git grep" invoke a pager in tree content check
> - CI: remove unused Azure ci/* code
> - CI: remove dead "tree skipping" code
> - CI: remove more dead Travis CI support
> - CI: make "$jobname" explicit, remove fallback
> - CI: run "set -ex" early in ci/lib.sh
> (this branch is used by ab/ci-github-workflow-markup.)
>
> Drive more actions done in CI via the Makefile instead of shell
> commands sprinkled in .github/workflows/main.yml
>
> Unless "doing more in Makefile" is fundamentally undesirable, I am
> inclined to take this, together with ab/ci-github-workflow-markup
> to replace js/ci-github-workflow-markup
> cf. <xmqq4k361a57.fsf@gitster.g>
> source: <cover-v2-00.25-00000000000-20220325T182534Z-avarab@xxxxxxxxx>
With the RC period hopefully the timing of the re-rolls I submitted is
more helpful than not (since you were considering things for "next").
I think this should be ready, the main critique of this series on its
merits I think has been[1], I was a bit on the fence about adding
something on top of it, but hopefully the re-roll at [2] helps address
that, i.e. by explicitly adding the support for running things "CI-like"
locally, which was the logical conclusion of this series (in addition to
improving the GitHub CI UX itself).
> * js/ci-github-workflow-markup (2022-03-01) 9 commits
> . ci: call `finalize_test_case_output` a little later
> . ci: use `--github-workflow-markup` in the GitHub workflow
> . ci: optionally mark up output in the GitHub workflow
> . test(junit): avoid line feeds in XML attributes
> . tests: refactor --write-junit-xml code
> . ci/run-build-and-tests: add some structure to the GitHub workflow output
> . ci: make it easier to find failed tests' logs in the GitHub workflow
> . ci/run-build-and-tests: take a more high-level view
> . ci: fix code style
>
> Update the GitHub workflow support to make it quicker to get to the
> failing test.
>
> Waiting for discussion to settle.
> cf. <220309.86tuc6lwpj.gmgdl@xxxxxxxxxxxxxxxxxxx>
> cf. <220302.86mti87cj2.gmgdl@xxxxxxxxxxxxxxxxxxx>
> cf. <30dbc8fb-a1db-05bc-3dcb-070e11cf4715@xxxxxxxxx>
> source: <pull.1117.v2.git.1646130289.gitgitgadget@xxxxxxxxx>
Feature-wise v.s. ab/ci-github-workflow-markup one thing I noticed after
submitting the initial re-roll is that my re-roll has the end of the
"prove" output immediately preceding the expandable toggles in
js/ci-github-workflow-markup, but in js/ci-github-workflow-markup the
"prove" output is hidden its its own "toggle".
It's an artifact of how the two combined, the
js/ci-github-workflow-markup way could be re-introduced, but I find the
combination quite helpful actually. I.e. we now see the general summary
of what tests failed, and then the set test-by-test failures below.
As for the overall status some of the UX/slowness issues remain
unaddressed, which are issues in the original
js/ci-github-workflow-markup carried forward in this one.
Victoria Dye had some suggestions for addressing the slowness in [3]
that I think should be followed-up on. It was also noted that part of
the output was duplicated in the series (didn't dig up that reference,
sorry).
1. https://lore.kernel.org/git/320b3dde-a84e-0074-bed8-57061293b2b0@xxxxxxxxxx/
2. https://lore.kernel.org/git/cover-v3-00.29-00000000000-20220413T194847Z-avarab@xxxxxxxxx/
3. https://lore.kernel.org/git/6b83bb83-32b9-20c9-fa02-c1c3170351c3@xxxxxxxxxx/
