Linus Torvalds <torvalds@xxxxxxxxxxxxxxxxxxxx> writes: > [torvalds@i5 linux]$ git fetch > git://github.com/rustyrussell/linux.git > rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 > fatal: Couldn't find remote ref rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 > > oops. Ok, so his tag naming is *really* akward. Whatever. It is not "Whatever". $ git fetch git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git v3.0 fatal: Couldn't find remote ref v3.0 I do not think we ever DWIMmed fetch refspecs to prefix refs/tags/, so it is not the naming but fetching tags without saying "git fetch tag v3.0" (which IIRC was your invention long time ago). If we changed this "git fetch $there v3.0" to fetch tag, it would help the final step in your illustration, and I do not think it would be a huge regression---the only case it becomes fuzzy is when they have v3.0 branch at the same time, but the owner of such a repository is already playing with fire. > [torvalds@i5 linux]$ git fetch > git://github.com/rustyrussell/linux.git > refs/tags/rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 > From git://github.com/rustyrussell/linux > * tag > rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 -> FETCH_HEAD > > Ahh, success! > > Oops. Nope. It turns out that git will *peel* the tag when you fetch > it, so FETCH_HEAD actually doesn't contain the tag object at all, but > the commit object that the tag pointed to. MAJOR FAIL. > > Quite frankly, I think that's a git bug, but it's a git bug because > "git fetch" was designed to get the commit to merge. Fair enough. And because FETCH_HEAD started as (and probably still is) an internal implementation detail of communication between fetch and merge inside pull. So I do not have any issue in changing it to store tags unpeeled there. > [torvalds@i5 linux]$ git fetch > git://github.com/rustyrussell/linux.git > refs/tags/rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50:refs/tags/rusty > From git://github.com/rustyrussell/linux > * [new tag] > rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 -> rusty > * [new tag] > rusty@xxxxxxxxxxxxxxx-v3.1-2-gb1e4d20 -> > rusty@xxxxxxxxxxxxxxx-v3.1-2-gb1e4d20 > * [new tag] > rusty@xxxxxxxxxxxxxxx-v3.1-4896-g0acf000 -> > rusty@xxxxxxxxxxxxxxx-v3.1-4896-g0acf000 > * [new tag] > rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 -> > rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 > > WTF? This is not WTF but "fetching a history to store the tip of it in your refs/ namespace causes tags pointing into the history line followed automatically", and it exactly is what you want to happen if rusty asked you to fetch his for-linus branch (which the tag may point at) instead. > We got three other > tags too that we didn't even ask for! We could change the rule to read "fetching a history to store the tip of it in your refs/heads namespace causes autofollow". I am not sure if that is what we really want, though. > Again - not a fundamental design mistake in the data structures, and > it actually made sense from a "signed tags are important release > points" standpoint, but it makes it *really* inconvenient to use > signed tags for signature verification. We could update three things: - DWIM $name in "git fetch $there $name" to refs/tags/$name when it makes sense; - FETCH_HEAD stores unpeeled object names; and - "git pull" learns --verify option. Then $ git pull --verify rusty rusty@xxxxxxxxxxxxxxx-v3.1-8068-g5087a50 could integrate the history leading to that tag to your current branch while running verify-tag on it. For this, disabling the tag-auto-following is not necessary, as you are not storing the retrieved tag anywhere. That is a longwinded way to say I agree what you said below. > So signed tags are not mis-designed from a conceptual standpoint - > they just work really really awkwardly right now for what the kernel > would like to do with them. > > With a few UI fixes, I think the signed tag thing would "just work". > > That said, I do think that the "signature in the pull request" should > also "just work", and I'm not entirely sure which one is better. I do not think it is necessarily either/or choice. Either way does not solve anything other than validating the last hop between the last lieutenant to the integrator without having a way to give the verification material to third parties. Your earlier "pull request signature could be copied into the message of the merge that integrates the pulled history" solves 90% of the "third party validation" issue. With the signed tags approach, you could push out these signed tags you get from lieutenants, but there are quite a few things that need to happen for it to be usable: - You or your lieutenants do not want to keep these tags in your working repository, to be listed in "git tag -l". They are ephemeral to you and your lieutenant, even though they have to be permanent for third party auditors. - Normal users of your project do not want to see them in "git tag -l" either. - Responses to "git fetch" and "git ls-remote" produced by "git upload-pack" do need to (optionally) include them to allow third party auditors to ask for them. I wonder if an approach like the following, in addition to the three things I listed above, may give us a workable solution: * "git fetch linus v3.0" called by "git pull --verify linus v3.0" fetches the v3.0 unpeeled into FETCH_HEAD, GPG verifies it, creates refs/audit/$u, before running "git merge". $u is derived from v3.0 (given tag), the identity of the GPG signer, and perhaps timestamp to make it both identifiable and unique under refs/audit/ hierarchy. * You "git push origin". This causes refs/audit/* refs that point at commits in the transferred history to auto-follow, just like the current "git fetch $there $src:$dst" causes refs/tags/* auto-follow. The refs/audit/* hierarchy in your public repository will be populated by lieutenant signatures. * (Optional) You may have signed "git tag -s 'Linux v3.2' v3.2 master" before you push origin out, or you may have not. Currently, you do have to "git push origin v3.2" separately if you did. The above auto-follow could be extended to push refs/tags/* hierarchy to eliminate this step as well. Note that because of the way "upload-pack" protocol is structured, the first response from "upload-pack" after it gets connection is the advertisement of refs, and there is no way for "fetch-pack" to ask for customized refs advertisement to it. So for this to work without incurring undue overhead for normal users, we would need to exclude refs/audit/* from the normal ref advertisement (i.e. "ls-remote" does not see it) so that "git fetch" by casual users will not have to wait for megabytes of ref advertisements before issuing its first "want" request. Probably we can change "upload-pack" to advertise only refs/heads/*, refs/tags/*, and HEAD by default, and a protocol extension could be added to ask for other hierarchies for specialized needs like third party auditors. BUT. This does not allow third party auditors to audit how sub-subsystem histories came into your lieutenants' history unless you also fetch from your lieutenants in "auditor" mode to retrieve their refs/audit/* refs to be propagated to your public repository, which all of us involved in this thread know you wouldn't bother if it is an additional manual step (and I personally do not think I would bother if I were you). So the audit trail will end at one level unless we have even more complex arrangements. The auditors know the history up to some point in the past came from you (your last signed tag at release time, which some people may feel a bit too sparse for auditing purposes when a security incident like that one happens in between releases), and they know subhistories of what you merged came from your direct lieutenants (the refs/audit/* tags the above change allowed you to forward automatically when you published), but they have to take the word of your direct lieutenants at face value. I do not know if that is acceptable for $DAYJOB types, though. -- To unsubscribe from this list: send the line "unsubscribe linux-ide" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
