I haven't done the math, but it's probably a result of how the df command interprets the output of the statfs syscall. We changed the fr_size and block_size units we report to make it work more consistently across different systems "recently"; I don't know if that change was before or after the kernel in 13.04. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Fri, Feb 21, 2014 at 10:55 AM, Markus Goldberg <goldberg@xxxxxxxxxxxxxxxxx> wrote: > Hi, > no, it's sure that the backup-files are so big. The output of the du-command > is correct. > The files were rsynced from an other system, which is not cephfs. > > Markus > Am 21.02.2014 13:34, schrieb Yan, Zheng: > >> I think the result reported by df is correct. It's likely you have >> lots of sparse files in cephfs. >> For sparse files, cephfs increase the "used" space by the full file size. >> See >> http://ceph.com/docs/next/dev/differences-from-posix/ >> >> Yan, Zheng >> >> On Fri, Feb 21, 2014 at 6:13 PM, Markus Goldberg >> <goldberg@xxxxxxxxxxxxxxxxx> wrote: >>> >>> Hi, >>> this is ceph 0.77, Ubuntu 13.04 (ceph-server and ceph client) >>> >>> df-command gives goofy results: >>> >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# df -h . >>> Dateisystem GröÃe Benutzt Verf. Verw% Eingehängt auf >>> xxx.xxx.xxx.xxx:6789:/ 60T 6,6G 60T 1% /mnt/myceph >>> ^^^^ ^^^^ ^^ these are wrong >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# du -h -s . >>> 21T . >>> ^^^^ this seems to be correct >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# uname -a >>> Linux bd-a 3.13.0-031300-generic #201401192235 SMP Mon Jan 20 03:36:48 >>> UTC >>> 2014 x86_64 x86_64 x86_64 GNU/Linux >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# ls -la >>> insgesamt 22117769963 >>> drwxr-xr-x 1 root root 22648596429481 Feb 21 10:46 . >>> drwx------ 1 root root 24834888278999 Feb 4 15:02 .. >>> drwxr-x--x 1 root 4294967294 0 Feb 7 20:15 bacula-restores >>> -rw-r----- 1 root 4294967294 76454826838 Dez 31 07:10 Catalog-0001 >>> -rw-r----- 1 root 4294967294 65248415569 Jan 7 07:08 Catalog-0002 >>> -rw-r----- 1 root 4294967294 42039633864 Jan 14 07:08 Catalog-0003 >>> -rw-r----- 1 root 4294967294 27403135157 Jan 21 10:41 Catalog-0004 >>> -rw-r----- 1 root 4294967294 9995908616 Jan 23 07:06 Catalog-0005 >>> -rw-r----- 1 root 4294967294 20263232478 Feb 7 07:04 Catalog-0006 >>> -rw-r----- 1 root 4294967294 14901514585 Feb 19 07:03 Catalog-0007 >>> -rw-r----- 1 root 4294967294 40192504928 Dez 6 07:11 Catalog-0008 >>> -rw-r----- 1 root 4294967294 70244536755 Dez 17 07:12 Catalog-0009 >>> -rw-r----- 1 root 4294967294 85482187783 Dez 24 07:11 Catalog-0010 >>> -rw-r----- 1 root 4294967294 31891872124 Feb 22 2013 Scratch >>> -rw-r----- 1 root 4294967294 36370677079 Feb 13 22:40 >>> Unix-Server-Daily-0001 >>> -rw-r----- 1 root 4294967294 714034085 Mai 6 2012 >>> Unix-Server-Daily-0002 >>> -rw-r----- 1 root 4294967294 145436042521 Jan 28 07:19 >>> Unix-Server-Daily-0003 >>> -rw-r----- 1 root 4294967294 149923349851 Jan 30 07:40 >>> Unix-Server-Daily-0004 >>> -rw-r----- 1 root 4294967294 198304422831 Feb 7 06:34 >>> Unix-Server-Daily-0005 >>> -rw-r----- 1 root 4294967294 19444196791 Feb 19 22:06 >>> Unix-Server-Daily-0092 >>> -rw-r----- 1 root 4294967294 467995422182 Jan 4 17:10 >>> Unix-Server-Weekly-0001 >>> -rw-r----- 1 root 4294967294 3137369152887 Jan 12 17:09 >>> Unix-Server-Weekly-0002 >>> -rw-r----- 1 root 4294967294 2400846517281 Jan 19 03:58 >>> Unix-Server-Weekly-0003 >>> -rw-r----- 1 root 4294967294 285489630070 Jan 29 19:17 >>> Unix-Server-Weekly-0004 >>> -rw-r----- 1 root 4294967294 616 Feb 20 22:00 >>> Unix-Server-Weekly-0005 >>> -rw-r----- 1 root 4294967294 1702885896192 Feb 3 10:57 >>> Unix-Server-Weekly-0006 >>> -rw-r----- 1 root 4294967294 1618012594574 Feb 8 15:51 >>> Unix-Server-Weekly-0007 >>> -rw-r----- 1 root 4294967294 2361448742912 Dez 29 00:08 >>> Unix-Server-Weekly-0008 >>> -rw-r----- 1 root 4294967294 96000244646 Dez 29 06:09 >>> Unix-Server-Weekly-0009 >>> -rw-r----- 1 root 4294967294 1198647656448 Jan 4 11:25 >>> Unix-Server-Weekly-0010 >>> -rw-r----- 1 root 4294967294 22232077996 Dez 4 2009 Unix-Sys-0001 >>> -rw-r----- 1 root 4294967294 10576799936 Mär 14 2013 >>> Unix-Test-Weekly-0001 >>> -rw-r----- 1 root 4294967294 6035622 Okt 23 2009 >>> Unix-Test-Weekly-0002 >>> -rw-r----- 1 root 4294967294 564820105159 Okt 22 08:30 >>> Unix-Test-Weekly-0003 >>> -rw-r----- 1 root 4294967294 211 Okt 22 17:42 >>> Unix-Test-Weekly-0004 >>> -rw-r----- 1 root 4294967294 2116314613179 Nov 1 17:05 >>> Unix-Test-Weekly-0005 >>> -rw-r----- 1 root 4294967294 3703173898 Aug 9 2012 >>> Windows-Host-Daily-0001 >>> -rw-r----- 1 root 4294967294 2190540237 Aug 17 2012 >>> Windows-Host-Daily-0002 >>> -rw-r----- 1 root 4294967294 16432919721 Jul 20 2012 >>> Windows-Host-Daily-0003 >>> -rw-r----- 1 root 4294967294 4311225811 Jul 27 2012 >>> Windows-Host-Daily-0004 >>> -rw-r----- 1 root 4294967294 516310 Mär 24 2010 >>> Windows-Host-Daily-0005 >>> -rw-r----- 1 root 4294967294 4568702933 Aug 3 2012 >>> Windows-Host-Daily-0006 >>> -rw-r----- 1 root 4294967294 603436637749 Jul 25 2012 >>> Windows-Host-Weekly-0001 >>> -rw-r----- 1 root 4294967294 1167166344 Aug 6 2012 >>> Windows-Host-Weekly-0002 >>> -rw-r----- 1 root 4294967294 216 Aug 13 2012 >>> Windows-Host-Weekly-0003 >>> -rw-r----- 1 root 4294967294 590067676526 Jun 26 2012 >>> Windows-Host-Weekly-0004 >>> -rw-r----- 1 root 4294967294 108949289831 Jul 10 2012 >>> Windows-Host-Weekly-0005 >>> -rw-r----- 1 root 4294967294 0 Mär 23 2010 >>> Windows-Host-Weekly-0044 >>> -rw-r----- 1 root 4294967294 6364808850 Feb 25 2013 >>> Windows-Server-Daily-0001 >>> -rw-r----- 1 root 4294967294 31860352659 Jan 25 2013 >>> Windows-Server-Daily-0002 >>> -rw-r----- 1 root 4294967294 31862353031 Feb 1 2013 >>> Windows-Server-Daily-0003 >>> -rw-r----- 1 root 4294967294 31867469032 Feb 8 2013 >>> Windows-Server-Daily-0004 >>> -rw-r----- 1 root 4294967294 97386881267 Feb 15 2013 >>> Windows-Server-Daily-0005 >>> -rw-r----- 1 root 4294967294 221 Jun 9 2010 >>> Windows-Server-Weekly-0001 >>> -rw-r----- 1 root 4294967294 969923439848 Feb 3 2013 >>> Windows-Server-Weekly-0002 >>> -rw-r----- 1 root 4294967294 803039973291 Feb 10 2013 >>> Windows-Server-Weekly-0003 >>> -rw-r----- 1 root 4294967294 974033659746 Jan 27 2013 >>> Windows-Server-Weekly-0004 >>> -rw-r----- 1 root 4294967294 678319354693 Feb 17 2013 >>> Windows-Server-Weekly-0005 >>> -rw-r----- 1 root 4294967294 668556441049 Feb 24 2013 >>> Windows-Server-Weekly-0006 >>> -rw-r----- 1 root 4294967294 213 Apr 7 2010 >>> Windows-Test-Weekly- >>> -rw-r----- 1 root 4294967294 1357686193 Nov 17 2010 >>> Windows-Test-Weekly-0001 >>> -rw-r----- 1 root 4294967294 1810891151 Mär 8 2012 >>> Windows-Test-Weekly-0002 >>> -rw-r----- 1 root 4294967294 418130223 Jun 4 2010 >>> Windows-Test-Weekly-0003 >>> -rw-r----- 1 root 4294967294 11156001 Jun 8 2010 >>> Windows-Test-Weekly-0004 >>> -rw-r----- 1 root 4294967294 671 Nov 11 2010 >>> Windows-Test-Weekly-0005 >>> root@bd-a:/mnt/myceph/Backup/bs3/tapes# >>> >>> I have not counted all filesizes, but 21T seems to be correct >>> >>> -- >>> MfG, >>> Markus Goldberg >>> >>> >>> -------------------------------------------------------------------------- >>> Markus Goldberg Universität Hildesheim >>> Rechenzentrum >>> Tel +49 5121 88392822 Marienburger Platz 22, D-31141 Hildesheim, Germany >>> Fax +49 5121 88392823 email goldberg@xxxxxxxxxxxxxxxxx >>> >>> -------------------------------------------------------------------------- >>> >>> >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@xxxxxxxxxxxxxx >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |