Re: Strange (varying) limit on number files in directory ?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 2011-05-13, at 5:36 AM, Mateusz Korniak <mateusz-lists@xxxxxxxxxxxxxx> wrote:
> I am hitting strange number of files inside directory limitation.
> I am able to create only around 120k files.
> Number varies [1] as seems I am able to add files with some filenames but with 
> other creation fails [2].
> 
> Files have structure <small_ind><sha/md5sum> [3].
> All on linux box [4],[5], having plenty of frees space [6].
> Filesystem fscked  - everything ok.
> 
> 
> [3]:
> 494_0cf1500e1ecbeecb3282b1e68b2df53b77d06665  
> 494_40654eec2dd15e4065e49faa2ea226dd25191457  
> 
> [5]:
> tune2fs -l /dev/md7
> tune2fs 1.41.11 (14-Mar-2010)
> 
> Block count:              117190656
> 
> Block size:               1024

Limit is because you must have formatted the filesystem with 1023-byte blocksize. There is a 2-level limit on htree directories, and with the long filenames you are using you only get about 16 entries in each leaf block. With 1024-byte blocks there can be at most (1024-16)/8*(1024-8)/8*3/4= 192k entries with perfect hashing.

In order to exceed this limit you unfortunately need to format your fs with a larger blocksize (or fix htree to allow more than depth 2).

Andreas
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [Reiser Filesystem Development]     [Ceph FS]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Linux FS]     [Yosemite National Park]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Device Mapper]     [Linux Media]

  Powered by Linux