Thanks William…. I’m going to mess with it, see how it does. I hadn’t thought about utilizing mlocate for this case, but wouldn’t be the worst thing if it can keep up. The major issue we are having with most solutions is just time. It takes so long for most utilities to run through even my modest 34 million files as of today. That’s why I was wondering if this may be another ceph super power, as having the rbytes and rifles has been for us. Those features have eliminated so many very slow processes for figuring out what directories are using more than others (until we can get quotas in place). If this file name data was already in some DB somewhere that could be queried “off line” we wouldn’t have to waste the cycles actively capturing that data etc. Appreciate the response! On Mon, Feb 14, 2022 at 11:57 PM William Edwards <wedwards@xxxxxxxxxxxxxx> wrote: > > > Op 15 feb. 2022 om 02:19 heeft Robert Gallop <robert.gallop@xxxxxxxxx> > het volgende geschreven: > > > > Had the question posed to me and couldn’t find an immediate answer. > > > > Is there anyway we can query the MDS or some other component in the ceph > > stack that would give essentially immediate access to all file names > > contained in ceph? > > > > in HDFS we have the ability to pull the fsimage from the name nodes and > > perform query like operations to find a file, lets say we wanted to see > all > > *log4j*.jar files that existed in HDFS, we could run this query and have > > 20k results in a couple seconds. > > > > Right now with ceph, we are only using cephfs, kernel client mounts, so > the > > only “normal” way to do this is to use find, or ls, or whatever normal > > tools could go looking for this jar across the various mount points. > > Can you mount / and use mlocate? > > > > > So thought I’d ask if any one had some tricks that could be used to > > basically ask the MDS or component that would know: Show me the path of > > every file ending in .jar that contains the letters/numbers log4j in its > > name… > > > > Thanks! > > _______________________________________________ > > ceph-users mailing list -- ceph-users@xxxxxxx > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |