Hi, Not sure if it was mentioned but also you could check the following: 1. Snapshots Snapshots can consume a significant amount of space without being immediately obvious. They preserve the state of the filesystem at various points in time. List Snapshots: Use the "*ceph fs subvolume snapshot ls*" command to list all snapshots for a given subvolume. You can also use "*ceph fs ls*" to list the filesystems and then inspect each one for snapshots. 2. Replication Overhead (as Etienne M. has mentioned) Depending on your pool's replication or erasure coding settings, the actual storage usage could be multiple times the size of the stored data. Check Pool Settings: Use "ceph osd pool get <pool_name> size" to check the replication factor. For erasure-coded pools, check with "ceph osd pool get <pool_name> erasure_code_profile" . 3. Use ceph df and ceph osd pool stats These commands give you an overview of storage utilization and I/O statistics, respectively. Disk Usage: "ceph df" can help identify how much space is being used by different pools. Pool Stats: "ceph osd pool stats" might give insights into read/write operations, which could hint at heavy snapshot usage or other anomalies. Orphaned data blocks, which are not linked to any file but still occupy space, can also be a culprit. Just my 2 cents, Bogdan Velica. On Wed, Mar 13, 2024 at 9:21 AM Etienne Menguy <etienne.menguy@xxxxxxxxxxx> wrote: > Hi, > > Check your replication/EC configuration. How do you get your different > sizes/usages? > > Étienne > ________________________________ > From: Thorne Lawler <thorne@xxxxxxxxxxx> > Sent: Wednesday, 13 March 2024 03:58 > To: ceph-users@xxxxxxx <ceph-users@xxxxxxx> > Subject: CephFS space usage > > [Some people who received this message don't often get email from > thorne@xxxxxxxxxxx. Learn why this is important at > https://aka.ms/LearnAboutSenderIdentification ] > > Hi everyone! > > My Ceph cluster (17.2.6) has a CephFS volume which is showing 41TB usage > for the data pool, but there are only 5.5TB of files in it. There are > fewer than 100 files on the filesystem in total, so where is all that > space going? > > How can I analyze my cephfs to understand what is using that space, and > if possible, how can I reclaim that space? > > Thank you. > > -- > > Regards, > > Thorne Lawler - Senior System Administrator > *DDNS* | ABN 76 088 607 265 > First registrar certified ISO 27001-2013 Data Security Standard ITGOV40172 > P +61 499 449 170 > > _DDNS > > /_*Please note:* The information contained in this email message and any > attached files may be confidential information, and may also be the > subject of legal professional privilege. _If you are not the intended > recipient any use, disclosure or copying of this email is unauthorised. > _If you received this email in error, please notify Discount Domain Name > Services Pty Ltd on 03 9815 6868 to report this matter and delete all > copies of this transmission together with any attachments. / > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |