I think the result reported by df is correct. It's likely you have lots of sparse files in cephfs. For sparse files, cephfs increase the "used" space by the full file size. See http://ceph.com/docs/next/dev/differences-from-posix/ Yan, Zheng On Fri, Feb 21, 2014 at 6:13 PM, Markus Goldberg <goldberg@xxxxxxxxxxxxxxxxx> wrote: > Hi, > this is ceph 0.77, Ubuntu 13.04 (ceph-server and ceph client) > > df-command gives goofy results: > > root@bd-a:/mnt/myceph/Backup/bs3/tapes# > root@bd-a:/mnt/myceph/Backup/bs3/tapes# df -h . > Dateisystem GröÃe Benutzt Verf. Verw% Eingehängt auf > xxx.xxx.xxx.xxx:6789:/ 60T 6,6G 60T 1% /mnt/myceph > ^^^^ ^^^^ ^^ these are wrong > root@bd-a:/mnt/myceph/Backup/bs3/tapes# > root@bd-a:/mnt/myceph/Backup/bs3/tapes# du -h -s . > 21T . > ^^^^ this seems to be correct > root@bd-a:/mnt/myceph/Backup/bs3/tapes# > root@bd-a:/mnt/myceph/Backup/bs3/tapes# uname -a > Linux bd-a 3.13.0-031300-generic #201401192235 SMP Mon Jan 20 03:36:48 UTC > 2014 x86_64 x86_64 x86_64 GNU/Linux > root@bd-a:/mnt/myceph/Backup/bs3/tapes# > root@bd-a:/mnt/myceph/Backup/bs3/tapes# ls -la > insgesamt 22117769963 > drwxr-xr-x 1 root root 22648596429481 Feb 21 10:46 . > drwx------ 1 root root 24834888278999 Feb 4 15:02 .. > drwxr-x--x 1 root 4294967294 0 Feb 7 20:15 bacula-restores > -rw-r----- 1 root 4294967294 76454826838 Dez 31 07:10 Catalog-0001 > -rw-r----- 1 root 4294967294 65248415569 Jan 7 07:08 Catalog-0002 > -rw-r----- 1 root 4294967294 42039633864 Jan 14 07:08 Catalog-0003 > -rw-r----- 1 root 4294967294 27403135157 Jan 21 10:41 Catalog-0004 > -rw-r----- 1 root 4294967294 9995908616 Jan 23 07:06 Catalog-0005 > -rw-r----- 1 root 4294967294 20263232478 Feb 7 07:04 Catalog-0006 > -rw-r----- 1 root 4294967294 14901514585 Feb 19 07:03 Catalog-0007 > -rw-r----- 1 root 4294967294 40192504928 Dez 6 07:11 Catalog-0008 > -rw-r----- 1 root 4294967294 70244536755 Dez 17 07:12 Catalog-0009 > -rw-r----- 1 root 4294967294 85482187783 Dez 24 07:11 Catalog-0010 > -rw-r----- 1 root 4294967294 31891872124 Feb 22 2013 Scratch > -rw-r----- 1 root 4294967294 36370677079 Feb 13 22:40 > Unix-Server-Daily-0001 > -rw-r----- 1 root 4294967294 714034085 Mai 6 2012 > Unix-Server-Daily-0002 > -rw-r----- 1 root 4294967294 145436042521 Jan 28 07:19 > Unix-Server-Daily-0003 > -rw-r----- 1 root 4294967294 149923349851 Jan 30 07:40 > Unix-Server-Daily-0004 > -rw-r----- 1 root 4294967294 198304422831 Feb 7 06:34 > Unix-Server-Daily-0005 > -rw-r----- 1 root 4294967294 19444196791 Feb 19 22:06 > Unix-Server-Daily-0092 > -rw-r----- 1 root 4294967294 467995422182 Jan 4 17:10 > Unix-Server-Weekly-0001 > -rw-r----- 1 root 4294967294 3137369152887 Jan 12 17:09 > Unix-Server-Weekly-0002 > -rw-r----- 1 root 4294967294 2400846517281 Jan 19 03:58 > Unix-Server-Weekly-0003 > -rw-r----- 1 root 4294967294 285489630070 Jan 29 19:17 > Unix-Server-Weekly-0004 > -rw-r----- 1 root 4294967294 616 Feb 20 22:00 > Unix-Server-Weekly-0005 > -rw-r----- 1 root 4294967294 1702885896192 Feb 3 10:57 > Unix-Server-Weekly-0006 > -rw-r----- 1 root 4294967294 1618012594574 Feb 8 15:51 > Unix-Server-Weekly-0007 > -rw-r----- 1 root 4294967294 2361448742912 Dez 29 00:08 > Unix-Server-Weekly-0008 > -rw-r----- 1 root 4294967294 96000244646 Dez 29 06:09 > Unix-Server-Weekly-0009 > -rw-r----- 1 root 4294967294 1198647656448 Jan 4 11:25 > Unix-Server-Weekly-0010 > -rw-r----- 1 root 4294967294 22232077996 Dez 4 2009 Unix-Sys-0001 > -rw-r----- 1 root 4294967294 10576799936 Mär 14 2013 > Unix-Test-Weekly-0001 > -rw-r----- 1 root 4294967294 6035622 Okt 23 2009 > Unix-Test-Weekly-0002 > -rw-r----- 1 root 4294967294 564820105159 Okt 22 08:30 > Unix-Test-Weekly-0003 > -rw-r----- 1 root 4294967294 211 Okt 22 17:42 > Unix-Test-Weekly-0004 > -rw-r----- 1 root 4294967294 2116314613179 Nov 1 17:05 > Unix-Test-Weekly-0005 > -rw-r----- 1 root 4294967294 3703173898 Aug 9 2012 > Windows-Host-Daily-0001 > -rw-r----- 1 root 4294967294 2190540237 Aug 17 2012 > Windows-Host-Daily-0002 > -rw-r----- 1 root 4294967294 16432919721 Jul 20 2012 > Windows-Host-Daily-0003 > -rw-r----- 1 root 4294967294 4311225811 Jul 27 2012 > Windows-Host-Daily-0004 > -rw-r----- 1 root 4294967294 516310 Mär 24 2010 > Windows-Host-Daily-0005 > -rw-r----- 1 root 4294967294 4568702933 Aug 3 2012 > Windows-Host-Daily-0006 > -rw-r----- 1 root 4294967294 603436637749 Jul 25 2012 > Windows-Host-Weekly-0001 > -rw-r----- 1 root 4294967294 1167166344 Aug 6 2012 > Windows-Host-Weekly-0002 > -rw-r----- 1 root 4294967294 216 Aug 13 2012 > Windows-Host-Weekly-0003 > -rw-r----- 1 root 4294967294 590067676526 Jun 26 2012 > Windows-Host-Weekly-0004 > -rw-r----- 1 root 4294967294 108949289831 Jul 10 2012 > Windows-Host-Weekly-0005 > -rw-r----- 1 root 4294967294 0 Mär 23 2010 > Windows-Host-Weekly-0044 > -rw-r----- 1 root 4294967294 6364808850 Feb 25 2013 > Windows-Server-Daily-0001 > -rw-r----- 1 root 4294967294 31860352659 Jan 25 2013 > Windows-Server-Daily-0002 > -rw-r----- 1 root 4294967294 31862353031 Feb 1 2013 > Windows-Server-Daily-0003 > -rw-r----- 1 root 4294967294 31867469032 Feb 8 2013 > Windows-Server-Daily-0004 > -rw-r----- 1 root 4294967294 97386881267 Feb 15 2013 > Windows-Server-Daily-0005 > -rw-r----- 1 root 4294967294 221 Jun 9 2010 > Windows-Server-Weekly-0001 > -rw-r----- 1 root 4294967294 969923439848 Feb 3 2013 > Windows-Server-Weekly-0002 > -rw-r----- 1 root 4294967294 803039973291 Feb 10 2013 > Windows-Server-Weekly-0003 > -rw-r----- 1 root 4294967294 974033659746 Jan 27 2013 > Windows-Server-Weekly-0004 > -rw-r----- 1 root 4294967294 678319354693 Feb 17 2013 > Windows-Server-Weekly-0005 > -rw-r----- 1 root 4294967294 668556441049 Feb 24 2013 > Windows-Server-Weekly-0006 > -rw-r----- 1 root 4294967294 213 Apr 7 2010 > Windows-Test-Weekly- > -rw-r----- 1 root 4294967294 1357686193 Nov 17 2010 > Windows-Test-Weekly-0001 > -rw-r----- 1 root 4294967294 1810891151 Mär 8 2012 > Windows-Test-Weekly-0002 > -rw-r----- 1 root 4294967294 418130223 Jun 4 2010 > Windows-Test-Weekly-0003 > -rw-r----- 1 root 4294967294 11156001 Jun 8 2010 > Windows-Test-Weekly-0004 > -rw-r----- 1 root 4294967294 671 Nov 11 2010 > Windows-Test-Weekly-0005 > root@bd-a:/mnt/myceph/Backup/bs3/tapes# > > I have not counted all filesizes, but 21T seems to be correct > > -- > MfG, > Markus Goldberg > > -------------------------------------------------------------------------- > Markus Goldberg Universität Hildesheim > Rechenzentrum > Tel +49 5121 88392822 Marienburger Platz 22, D-31141 Hildesheim, Germany > Fax +49 5121 88392823 email goldberg@xxxxxxxxxxxxxxxxx > -------------------------------------------------------------------------- > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com