big files in git was: Re: Features from GitSurvey 2010

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, 1 Feb 2011, Jakub Narebski wrote:

On Sun, 30 Jan 2011, Jonathan Nieder wrote:
Hi Dmitry,

Dmitry S. Kravtsov wrote:

I want to dedicate my coursework at University to implementation of
some useful git feature. So I'm interesting in some kind of list of
development status of these features
[...]
Or I'll be glad to know what features are now 'free' and what are
currently in active development.

Interesting question.  The short answer is that they are all "free".
Generally people seem to be happy to learn of an alternative approach
to what they have been working on.

[For the following pointers, the easiest way to follow up is probably
to search the mailing list archives.]

better support for big files (large media)

For a conservative approach, you might want to get in touch with Sam
Hocevar, Nicolas Pitre, and Miklos Vajna.  The idea is to stream big
files directly to pack and not waste time trying to compress them.

There is also, supposedly stalled, git-bigfiles project.

why is the clean/smudge approach that came through the list a week or two ago not acceptable?

While people talked about how it would be nice to store the large files on $remote_destination, just create a .git/bigfiles and store them in there.

with the ability to pass the filename to the clean/smudge scripts, you can even avoid the copy (replacing it with a mv) and have a working, if bare-bones system.

Then people can create/submit enhanced versions of these scripts that store the large files elsewhere if they want, but we would be past the "git can't handle large files" into "git handles large files less efficiently", which is a much better place to be.

If nobody else has time to take those e-mails and create a set of clean/smudge scripts, I'll do so later this week (unless there is some reason why they wouldn't be acceptable)

I guess the only question is how to tell what files need to be handled this way, but can't we have something in .gitattributes about the file size? (and if that's a problem for checking files out, have the stored file be a sparse file, that way it's large, but doesn't take much space on sane filesystems)

David Lang
--
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [Linux Kernel Development]     [Gcc Help]     [IETF Annouce]     [DCCP]     [Netdev]     [Networking]     [Security]     [V4L]     [Bugtraq]     [Yosemite]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Linux SCSI]     [Fedora Users]