Thanks, stopping the osd daemon seemed to do the trick. -----Original Message----- From: Robert LeBlanc [mailto:robert@xxxxxxxxxxxxx] Sent: Monday, July 27, 2015 11:48 AM To: Paul Schaleger Cc: ceph-users@xxxxxxxxxxxxxx Subject: Re: Trying to remove osd -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Did you kill the OSD process, you are still showing 28 OSD up. I'm not sure that should stop you from removing it though. You can also try ceph osd crush rm osd.21 - ---------------- Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Mon, Jul 27, 2015 at 10:35 AM, Paul Schaleger wrote: > I added an OSD to a device that I did not really want to and now I am > unable to remove it. Any suggestions as to what I am missing? > > > > Thanks in advance > > > > [rdo@n001 c140-ceph]$ ceph osd out 21 > > osd.21 is already out. > > [rdo@n001 c140-ceph]$ ceph osd down 21 > > marked down osd.21. > > [rdo@n001 c140-ceph]$ ceph osd rm 21 > > Error EBUSY: osd.21 is still up; must be down before removal. > > [rdo@n001 c140-ceph]$ ceph status > > cluster cc79ca04-8fbf-4211-94fa-35b4469deb33 > > health HEALTH_OK > > monmap e1: 3 mons at > {n001=10.17.1.10:6789/0,n002=10.17.1.11:6789/0,n003=10.17.1.12:6789/0} > > election epoch 16, quorum 0,1,2 n001,n002,n003 > > osdmap e206: 28 osds: 28 up, 27 in > > pgmap v466: 512 pgs, 1 pools, 0 bytes data, 0 objects > > 1144 MB used, 23615 GB / 23616 GB avail > > 512 active+clean > > > > [rdo@n001 c140-ceph]$ ceph --version > > ceph version 0.94.2 (5fb85614ca8f354284c713a2f9c610860720bbf3) > > > > > > Paul Schaleger | Digital River | System Architect > > p: 952-225-3727| pschaleger@xxxxxxxxxxxxxxxx | digitalriver.com > > 10380 Bren Road West, Minnetonka, MN 55343 > > > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > -----BEGIN PGP SIGNATURE----- Version: Mailvelope v0.13.1 Comment: https://www.mailvelope.com wsFcBAEBCAAQBQJVtmCeCRDmVDuy+mK58QAAS/oQAJcXErlHQXKHlH60UgNe q6s0utspGRBvV/kPf0n0+3qUyiGuGRrA4mEjglHKIEfCZFMN3abM4djFJOBx iX+t1uK5N3rHiKSM5/yD7elfvAAKwdU/JfO4pSpU9KwW59yGgPK23B/qXY6m mCsLO4846Ea5GJPHdEfjBd5LYAvwL6qpg5GbH1nergUB/ms8yPgwTntW9yWp 20W5VpcWIBmhAXMjlOqNJC8uOF11gPvQdMEmVqt9Q89O9t8VFt44bOFe2s5p 0EPl5cfHkGu8S4oRgNewEdynF3x9WtRW20dosptk+n+ztvPurnA7vXH64efp ADDZCLiwESuRvvk33pZRT1/hHVwQWSlFaJ9VqPFX7GRR9SSG01pdHTz0HexQ 1DVyvrtsXbNKnJ/6UwDY1Rt8THD6pXnLus9qcdgha3/dGU82BPVszaJ7vkNI rla90trp9OgiQnzolJbIL/irYzUHOJaCOmFcyFRAOnfa8/qEAoXAXVrKSuTt pns0CEcxD6aWWJ8OcJeGz0HDTjSq8wNhXr+gHKUfKXPgD9IuV9lmMWodYYI2 T5DKFNnXGzo5Y/kZ40cDKFRTgV3SqostPWiGUp2/JkNoiYNZlUqpkkOhhTRv DWSWD46GGYP9+UjRNS1fL6gx7WnFBPGjQ3i01ZqcPB5RwP3Qsze5l2hOMQQN g5iD =YAK/ -----END PGP SIGNATURE----- _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |