Hrm, yeah, that patch actually went in prior to 3.9 (it's older than I remember!). What's the output of "ls -l" from the root of the Ceph hierarchy, and what's the output of "ceph osd dump"? -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Sat, Feb 22, 2014 at 12:09 AM, Markus Goldberg <goldberg@xxxxxxxxxxxxxxxxx> wrote: > Hi Gregory, > i'm running kernel 3.13, which is much newer than the orig kernel of Ubuntu > 13.04: > > > root@bd-a:/mnt/myceph/Backup/bs3/tapes# uname -a > Linux bd-a 3.13.0-031300-generic #201401192235 SMP Mon Jan 20 03:36:48 > UTC > > Markus > Am 21.02.2014 20:59, schrieb Gregory Farnum: > >> I haven't done the math, but it's probably a result of how the df >> command interprets the output of the statfs syscall. We changed the >> fr_size and block_size units we report to make it work more >> consistently across different systems "recently"; I don't know if that >> change was before or after the kernel in 13.04. >> -Greg >> Software Engineer #42 @ http://inktank.com | http://ceph.com >> >> >> On Fri, Feb 21, 2014 at 10:55 AM, Markus Goldberg >> <goldberg@xxxxxxxxxxxxxxxxx> wrote: >>> >>> Hi, >>> no, it's sure that the backup-files are so big. The output of the >>> du-command >>> is correct. >>> The files were rsynced from an other system, which is not cephfs. >>> >>> Markus >>> Am 21.02.2014 13:34, schrieb Yan, Zheng: >>> >>>> I think the result reported by df is correct. It's likely you have >>>> lots of sparse files in cephfs. >>>> For sparse files, cephfs increase the "used" space by the full file >>>> size. >>>> See >>>> http://ceph.com/docs/next/dev/differences-from-posix/ >>>> >>>> Yan, Zheng >>>> >>>> On Fri, Feb 21, 2014 at 6:13 PM, Markus Goldberg >>>> <goldberg@xxxxxxxxxxxxxxxxx> wrote: >>>>> >>>>> Hi, >>>>> this is ceph 0.77, Ubuntu 13.04 (ceph-server and ceph client) >>>>> >>>>> df-command gives goofy results: >>>>> >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# df -h . >>>>> Dateisystem GröÃe Benutzt Verf. Verw% Eingehängt auf >>>>> xxx.xxx.xxx.xxx:6789:/ 60T 6,6G 60T 1% /mnt/myceph >>>>> ^^^^ ^^^^ ^^ these are wrong >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# du -h -s . >>>>> 21T . >>>>> ^^^^ this seems to be correct >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# uname -a >>>>> Linux bd-a 3.13.0-031300-generic #201401192235 SMP Mon Jan 20 03:36:48 >>>>> UTC >>>>> 2014 x86_64 x86_64 x86_64 GNU/Linux >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# ls -la >>>>> insgesamt 22117769963 >>>>> drwxr-xr-x 1 root root 22648596429481 Feb 21 10:46 . >>>>> drwx------ 1 root root 24834888278999 Feb 4 15:02 .. >>>>> drwxr-x--x 1 root 4294967294 0 Feb 7 20:15 >>>>> bacula-restores >>>>> -rw-r----- 1 root 4294967294 76454826838 Dez 31 07:10 Catalog-0001 >>>>> -rw-r----- 1 root 4294967294 65248415569 Jan 7 07:08 Catalog-0002 >>>>> -rw-r----- 1 root 4294967294 42039633864 Jan 14 07:08 Catalog-0003 >>>>> -rw-r----- 1 root 4294967294 27403135157 Jan 21 10:41 Catalog-0004 >>>>> -rw-r----- 1 root 4294967294 9995908616 Jan 23 07:06 Catalog-0005 >>>>> -rw-r----- 1 root 4294967294 20263232478 Feb 7 07:04 Catalog-0006 >>>>> -rw-r----- 1 root 4294967294 14901514585 Feb 19 07:03 Catalog-0007 >>>>> -rw-r----- 1 root 4294967294 40192504928 Dez 6 07:11 Catalog-0008 >>>>> -rw-r----- 1 root 4294967294 70244536755 Dez 17 07:12 Catalog-0009 >>>>> -rw-r----- 1 root 4294967294 85482187783 Dez 24 07:11 Catalog-0010 >>>>> -rw-r----- 1 root 4294967294 31891872124 Feb 22 2013 Scratch >>>>> -rw-r----- 1 root 4294967294 36370677079 Feb 13 22:40 >>>>> Unix-Server-Daily-0001 >>>>> -rw-r----- 1 root 4294967294 714034085 Mai 6 2012 >>>>> Unix-Server-Daily-0002 >>>>> -rw-r----- 1 root 4294967294 145436042521 Jan 28 07:19 >>>>> Unix-Server-Daily-0003 >>>>> -rw-r----- 1 root 4294967294 149923349851 Jan 30 07:40 >>>>> Unix-Server-Daily-0004 >>>>> -rw-r----- 1 root 4294967294 198304422831 Feb 7 06:34 >>>>> Unix-Server-Daily-0005 >>>>> -rw-r----- 1 root 4294967294 19444196791 Feb 19 22:06 >>>>> Unix-Server-Daily-0092 >>>>> -rw-r----- 1 root 4294967294 467995422182 Jan 4 17:10 >>>>> Unix-Server-Weekly-0001 >>>>> -rw-r----- 1 root 4294967294 3137369152887 Jan 12 17:09 >>>>> Unix-Server-Weekly-0002 >>>>> -rw-r----- 1 root 4294967294 2400846517281 Jan 19 03:58 >>>>> Unix-Server-Weekly-0003 >>>>> -rw-r----- 1 root 4294967294 285489630070 Jan 29 19:17 >>>>> Unix-Server-Weekly-0004 >>>>> -rw-r----- 1 root 4294967294 616 Feb 20 22:00 >>>>> Unix-Server-Weekly-0005 >>>>> -rw-r----- 1 root 4294967294 1702885896192 Feb 3 10:57 >>>>> Unix-Server-Weekly-0006 >>>>> -rw-r----- 1 root 4294967294 1618012594574 Feb 8 15:51 >>>>> Unix-Server-Weekly-0007 >>>>> -rw-r----- 1 root 4294967294 2361448742912 Dez 29 00:08 >>>>> Unix-Server-Weekly-0008 >>>>> -rw-r----- 1 root 4294967294 96000244646 Dez 29 06:09 >>>>> Unix-Server-Weekly-0009 >>>>> -rw-r----- 1 root 4294967294 1198647656448 Jan 4 11:25 >>>>> Unix-Server-Weekly-0010 >>>>> -rw-r----- 1 root 4294967294 22232077996 Dez 4 2009 Unix-Sys-0001 >>>>> -rw-r----- 1 root 4294967294 10576799936 Mär 14 2013 >>>>> Unix-Test-Weekly-0001 >>>>> -rw-r----- 1 root 4294967294 6035622 Okt 23 2009 >>>>> Unix-Test-Weekly-0002 >>>>> -rw-r----- 1 root 4294967294 564820105159 Okt 22 08:30 >>>>> Unix-Test-Weekly-0003 >>>>> -rw-r----- 1 root 4294967294 211 Okt 22 17:42 >>>>> Unix-Test-Weekly-0004 >>>>> -rw-r----- 1 root 4294967294 2116314613179 Nov 1 17:05 >>>>> Unix-Test-Weekly-0005 >>>>> -rw-r----- 1 root 4294967294 3703173898 Aug 9 2012 >>>>> Windows-Host-Daily-0001 >>>>> -rw-r----- 1 root 4294967294 2190540237 Aug 17 2012 >>>>> Windows-Host-Daily-0002 >>>>> -rw-r----- 1 root 4294967294 16432919721 Jul 20 2012 >>>>> Windows-Host-Daily-0003 >>>>> -rw-r----- 1 root 4294967294 4311225811 Jul 27 2012 >>>>> Windows-Host-Daily-0004 >>>>> -rw-r----- 1 root 4294967294 516310 Mär 24 2010 >>>>> Windows-Host-Daily-0005 >>>>> -rw-r----- 1 root 4294967294 4568702933 Aug 3 2012 >>>>> Windows-Host-Daily-0006 >>>>> -rw-r----- 1 root 4294967294 603436637749 Jul 25 2012 >>>>> Windows-Host-Weekly-0001 >>>>> -rw-r----- 1 root 4294967294 1167166344 Aug 6 2012 >>>>> Windows-Host-Weekly-0002 >>>>> -rw-r----- 1 root 4294967294 216 Aug 13 2012 >>>>> Windows-Host-Weekly-0003 >>>>> -rw-r----- 1 root 4294967294 590067676526 Jun 26 2012 >>>>> Windows-Host-Weekly-0004 >>>>> -rw-r----- 1 root 4294967294 108949289831 Jul 10 2012 >>>>> Windows-Host-Weekly-0005 >>>>> -rw-r----- 1 root 4294967294 0 Mär 23 2010 >>>>> Windows-Host-Weekly-0044 >>>>> -rw-r----- 1 root 4294967294 6364808850 Feb 25 2013 >>>>> Windows-Server-Daily-0001 >>>>> -rw-r----- 1 root 4294967294 31860352659 Jan 25 2013 >>>>> Windows-Server-Daily-0002 >>>>> -rw-r----- 1 root 4294967294 31862353031 Feb 1 2013 >>>>> Windows-Server-Daily-0003 >>>>> -rw-r----- 1 root 4294967294 31867469032 Feb 8 2013 >>>>> Windows-Server-Daily-0004 >>>>> -rw-r----- 1 root 4294967294 97386881267 Feb 15 2013 >>>>> Windows-Server-Daily-0005 >>>>> -rw-r----- 1 root 4294967294 221 Jun 9 2010 >>>>> Windows-Server-Weekly-0001 >>>>> -rw-r----- 1 root 4294967294 969923439848 Feb 3 2013 >>>>> Windows-Server-Weekly-0002 >>>>> -rw-r----- 1 root 4294967294 803039973291 Feb 10 2013 >>>>> Windows-Server-Weekly-0003 >>>>> -rw-r----- 1 root 4294967294 974033659746 Jan 27 2013 >>>>> Windows-Server-Weekly-0004 >>>>> -rw-r----- 1 root 4294967294 678319354693 Feb 17 2013 >>>>> Windows-Server-Weekly-0005 >>>>> -rw-r----- 1 root 4294967294 668556441049 Feb 24 2013 >>>>> Windows-Server-Weekly-0006 >>>>> -rw-r----- 1 root 4294967294 213 Apr 7 2010 >>>>> Windows-Test-Weekly- >>>>> -rw-r----- 1 root 4294967294 1357686193 Nov 17 2010 >>>>> Windows-Test-Weekly-0001 >>>>> -rw-r----- 1 root 4294967294 1810891151 Mär 8 2012 >>>>> Windows-Test-Weekly-0002 >>>>> -rw-r----- 1 root 4294967294 418130223 Jun 4 2010 >>>>> Windows-Test-Weekly-0003 >>>>> -rw-r----- 1 root 4294967294 11156001 Jun 8 2010 >>>>> Windows-Test-Weekly-0004 >>>>> -rw-r----- 1 root 4294967294 671 Nov 11 2010 >>>>> Windows-Test-Weekly-0005 >>>>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>>>> >>>>> I have not counted all filesizes, but 21T seems to be correct >>>>> >>>>> -- >>>>> MfG, >>>>> Markus Goldberg >>>>> >>>>> >>>>> >>>>> -------------------------------------------------------------------------- >>>>> Markus Goldberg Universität Hildesheim >>>>> Rechenzentrum >>>>> Tel +49 5121 88392822 Marienburger Platz 22, D-31141 Hildesheim, >>>>> Germany >>>>> Fax +49 5121 88392823 email goldberg@xxxxxxxxxxxxxxxxx >>>>> >>>>> >>>>> -------------------------------------------------------------------------- >>>>> >>>>> >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> ceph-users@xxxxxxxxxxxxxx >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> >>> >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@xxxxxxxxxxxxxx >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |