Re: MDS stuck in up:stopping state

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Weiwen,

Amazing, that actually worked. So simple, thanks!

________________________________
Fra: 胡 玮文 <huww98@xxxxxxxxxxx>
Sendt: 27. maj 2021 09:02
Til: Martin Rasmus Lundquist Hansen <hansen@xxxxxxxxxxxx>; ceph-users@xxxxxxx <ceph-users@xxxxxxx>
Emne: 回复: MDS stuck in up:stopping state


Hi Martin,



You may hit https://tracker.ceph.com/issues/50112<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftracker.ceph.com%2Fissues%2F50112&data=04%7C01%7Chansen%40imada.sdu.dk%7C557b70c448af40a9b9ad08d920dd5fa8%7C9a97c27db83e4694b35354bdbf18ab5b%7C0%7C0%7C637576958554129710%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ztjzyQDiHek1F6BA3mCcRHPKkGPuWheZ0Pi0NcK6Xmw%3D&reserved=0>, which we failed to find the root cause yet. I resolved this by restart rank 0. (I have only 2 active MDSs)



Weiwen Hu



发送自 Windows 10 版邮件<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgo.microsoft.com%2Ffwlink%2F%3FLinkId%3D550986&data=04%7C01%7Chansen%40imada.sdu.dk%7C557b70c448af40a9b9ad08d920dd5fa8%7C9a97c27db83e4694b35354bdbf18ab5b%7C0%7C0%7C637576958554139710%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=2VVst65FTtm0O%2FX5h%2F%2BLeg51%2F5UbLNASibwKPnRM7%2Fo%3D&reserved=0>应用



发件人: Martin Rasmus Lundquist Hansen<mailto:hansen@xxxxxxxxxxxx>
发送时间: 2021年5月27日 14:26
收件人: ceph-users@xxxxxxx<mailto:ceph-users@xxxxxxx>
主题:  MDS stuck in up:stopping state



After scaling the number of MDS daemons down, we now have a daemon stuck in the
"up:stopping" state. The documentation says it can take several minutes to stop the
daemon, but it has been stuck in this state for almost a full day. According to
the "ceph fs status" output attached below, it still holds information about 2
inodes, which we assume is the reason why it cannot stop completely.

Does anyone know what we can do to finally stop it?


cephfs - 71 clients
======
RANK   STATE        MDS         ACTIVITY     DNS    INOS
 0     active   ceph-mon-01  Reqs:    0 /s  15.7M  15.4M
 1     active   ceph-mon-02  Reqs:   48 /s  19.7M  17.1M
 2    stopping  ceph-mon-03                    0      2
      POOL         TYPE     USED  AVAIL
cephfs_metadata  metadata   652G   185T
  cephfs_data      data    1637T   539T
   STANDBY MDS
ceph-mon-03-mds-2
MDS version: ceph version 15.2.11 (e3523634d9c2227df9af89a4eac33d16738c49cb) octopus (stable)
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux