Re: [PATCH] RFC: git lazy clone proof-of-concept

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

On Tue, 12 Feb 2008, Johannes Schindelin wrote:

> On Sun, 10 Feb 2008, Johannes Schindelin wrote:
> 
> > $ /usr/bin/time git repack -a -d -f --window=150 --depth=150
> > Counting objects: 2477715, done.
> > Compressing objects:  19% (481551/2411764)
> > Compressing objects:  19% (482333/2411764)
> > fatal: Out of memory, malloc failed411764)
> > Command exited with non-zero status 1
> > 7118.37user 54.15system 2:01:44elapsed 98%CPU (0avgtext+0avgdata 
> > 0maxresident)k
> > 0inputs+0outputs (29834major+17122977minor)pagefaults 0swaps
> 
> I made the window much smaller (512 megabyte), and it still runs, after 27 
> hours:
> 
> Compressing objects:  20% (484132/2411764)
> 
> However, it seems that it only worked on about 4000 objects in the last 
> 20(!) hours.  So, the first 19% were relatively quick.  The next percent 
> not at all.

Finally!

I updated to newest git+patches (git version 1.5.4.1.1353.g0d5dd), reset 
windowMemory to 512m and restarted the process:

$ /usr/bin/time git repack -a -d -f --window=250 --depth=250
Counting objects: 2477715, done.
Compressing objects: 100% (2411764/2411764), done.
Writing objects: 100% (2477715/2477715), done.
Total 2477715 (delta 1876242), reused 0 (delta 0)
21733.55user 175.32system 6:10:37elapsed 98%CPU (0avgtext+0avgdata 
0maxresident)k
0inputs+0outputs (81921major+63880453minor)pagefaults 0swaps

A little over 6 hours, with one core (of the four available).  Not bad, I 
say.

The result is:

$ ls -la objects/pack/pack-e4dc6da0a10888ec4345490575efc587b7523b45.pack
-rwxrwxrwx 1 root root 1638490531 2008-02-14 17:51 
objects/pack/pack-e4dc6da0a10888ec4345490575efc587b7523b45.pack

1.6G looks much better than 2.4G, wouldn't you say?  Jan, if you want it, 
please give me a place to upload it to.

Ciao,
Dscho

-
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[Index of Archives]     [Linux Kernel Development]     [Gcc Help]     [IETF Annouce]     [DCCP]     [Netdev]     [Networking]     [Security]     [V4L]     [Bugtraq]     [Yosemite]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Linux SCSI]     [Fedora Users]

  Powered by Linux