I think you have to "ceph mds fail" the last one up, then you'll be able to remove it. -Greg On Thu, Apr 23, 2015 at 7:52 AM, Kenneth Waegeman <kenneth.waegeman@xxxxxxxx> wrote: > > > On 04/22/2015 06:51 PM, Gregory Farnum wrote: >> >> If you look at the "ceph --help" output you'll find some commands for >> removing MDSes from the system. > > > Yes, this works for all but the last mds.. > > [root@mds01 ~]# ceph mds rm 35632 mds.mds03 > Error EBUSY: cannot remove active mds.mds03 rank 0 > > I stopped the daemon, checked the process was stopped, even did a shutdown > of that mds server, I keep getting this message and am unable to remove the > fs .. > > log file has this: > > 2015-04-23 16:14:05.171450 7fa9fe799700 -1 mds.0.4 *** got signal Terminated > *** > 2015-04-23 16:14:05.171490 7fa9fe799700 1 mds.0.4 suicide. wanted > down:dne, now up:active > > > >> -Greg >> On Wed, Apr 22, 2015 at 6:46 AM Kenneth Waegeman >> <kenneth.waegeman@xxxxxxxx <mailto:kenneth.waegeman@xxxxxxxx>> wrote: >> >> forgot to mention I'm running 0.94.1 >> >> On 04/22/2015 03:02 PM, Kenneth Waegeman wrote: >> > Hi, >> > >> > I tried to recreate a ceph fs ( well actually an underlying pool, >> but >> > for that I need to first remove the fs) , but this seems not that >> easy >> > to achieve. >> > >> > When I run >> > `ceph fs rm ceph_fs` >> > I get: >> > `Error EINVAL: all MDS daemons must be inactive before removing >> filesystem` >> > >> > I stopped the 3 MDSs, but this doesn't change anything, as ceph >> health >> > still "thinks" there is an mds running laggy: >> > >> > health HEALTH_WARN >> > mds cluster is degraded >> > mds mds03 is laggy >> > monmap e1: 3 mons at ... >> > election epoch 12, quorum 0,1,2 mds01,mds02,mds03 >> > mdsmap e12: 1/1/1 up {0=mds03=up:replay(laggy or crashed)} >> > >> > I checked the mds processes are gone.. >> > >> > Someone knows a solution for this? >> > >> > Thanks! >> > Kenneth >> > _______________________________________________ >> > ceph-users mailing list >> > ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx> >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx> >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com