So should i Just Run this command? cephfs-data-scan scan_links Will this ends in an Long Time Run command? Volker. ________________________________ Von: Stefan Kooman <stefan@xxxxxx> Gesendet: Mittwoch, 6. Oktober 2021 21:57 An: von Hoesslin, Volker; ceph-users@xxxxxxx Betreff: [URL wurde verändert] Re: AW: Re: MDS: corrupted header/values: decode past end of struct encoding: Malformed input Externe E-Mail! Öffnen Sie nur Links oder Anhänge von vertrauenswürdigen Absendern! On 10/6/21 15:54, von Hoesslin, Volker wrote: > > okay, i run this command: rados rm -p cephfs_metadata mds0_openfiles.0 > > start the MDS daemons and the "Malformed input" error seems to fixed. i > have 3 MDS daemons, two of them are running in "standby" modus and the > active one (pve04) is restarting in an endless loop with the attached > log output. I have read a couple of threads about duplicate inodes. And like Dan said [1] "The developer at that time suggested some manipulations to remove the omap entries for the older version of the inode from the stray dirs, and also to eventually run cephfs-data-scan scan_links." But ... in your log the object id is not printed "mds.0.cache.dir(0x100) _fetched badness: got (but i already had) [inode 0x600 [...2,head] ~mds0/stray0/ auth v10386" I would have expected the object right after ~mds0/stray0/. So I'm unsure how to find the right omap entry to delete. Gr. Stefan [1]: https://sis-schwerin.de/externer-link/?href=https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/thread/SPKM5IW2JDHLD2DKE6T6ZLLT7XUJJYEV/ > > > by the way, my complete "proxmox stack" is now out of service? the > simple output is "failed to mount /mnt/pve/cephfs". so, do you see an > another step to fix my problem? > > > volker. > > > ------------------------------------------------------------------------ > *Von:* Stefan Kooman <stefan@xxxxxx> > *Gesendet:* Montag, 4. Oktober 2021 20:39:10 > *An:* von Hoesslin, Volker; ceph-users@xxxxxxx > *Betreff:* [URL wurde verändert] Re: MDS: corrupted > header/values: decode past end of struct encoding: Malformed input > Externe E-Mail! Öffnen Sie nur Links oder Anhänge von vertrauenswürdigen > Absendern! > On 10/4/21 14:19, von Hoesslin, Volker wrote: > >> >> -7598> 2021-10-04T11:27:17.438+0200 7f529998c700 -1 mds.0.openfiles >> _load_finish: corrupted header/values: void >> Anchor::decode(ceph::buffer::v15_2_0::list::const_iterator&) decode past >> end of struct encoding: Malformed input >> >> ^^ openfiles object(s) corrupted. >> >> >> >> <<<<<< >> sounds bad! what does it mean? can we fixed it? > > If you still have any clients that have (or try to) mount CephFS, umount > them for now. > > AFAIK you cannot fix this, but you can remove it (it's corrupt anyway): > > - Stop all the MDSes. > - rados rm -p cephfs_metadata mds0_openfiles.0. This is more or less > harmless [1] > > Not sure if that is the only issue, but you will find out after you > start an MDS and try to mount it from a client. > > Gr. Stefan > > [1]: > https://sis-schwerin.de/externer-link/?href=http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-August/028981.html > <https://sis-schwerin.de/externer-link/?href=http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-August/028981.html> > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx