-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 hmmm, really weird. I only set the cache pool to forward and evicted the objects out of the cache pool, but now it was saying that it wasn't a cache pool at all: [root@nodez ~]# ceph osd tier cache-mode ssd forward set cache-mode for pool 'ssd' to forward [root@nodez ~]# ceph osd tier remove-overlay rbd there is now (or already was) no overlay for 'rbd' [root@nodez ~]# ceph osd tier remove rbd ssd pool 'ssd' is now (or already was) not a tier of 'rbd' [root@nodez ~]# ceph osd pool delete ssd ssd --yes-i-really-really-mean-it pool 'ssd' removed [root@nodez ~]# ceph osd pool delete rbd rbd --yes-i-really-really-mean-it pool 'rbd' removed My pools are now gone, thanks for the help. I had one RBD that wouldn't evict or something so it was messed up and I wasn't sure if I would be able to clean things up completely. -----BEGIN PGP SIGNATURE----- Version: Mailvelope v1.1.0 Comment: https://www.mailvelope.com wsFcBAEBCAAQBQJV/4KKCRDmVDuy+mK58QAAbnkQAIdgyiX+o0QUBvIsYZdl V36QQvwk1uJH5/de4AG1ESVplD9Je7nDfDQS29hoZXD7KZ2FimT0SyKByCYf bATlU6JRIW1Z2hnVzvfsn5scV0cK+aRdnis3LohjYj82VpEa0MvczmG7PNcX 2o0Kyzp0F6y25U5C0pgOgSIy6+I8aLTeYhBJ+6vIJXclzwYpkNM57G3/V4+S OlnnAlS9V3ZmZtbGR5WtGCqNy/ygHfL2su3Punw9on/M2CRhWwKSRutcVNYT 2aIMJaBVOFM4UUcmmzTErpKM4JF1btD9yP9JqrNDZYgKWsfDfdTcJjppD053 1xqM8bytr6JtbbC+2KneBy71jYRc/WcHqoLrGnGrqM744okSVOUv59V4i0zz /I6cfzbtySewINjUwFpc6OnJJHEYkse10caBWPrK34oIXQNS2K9uw+vxo/zV sy/ciuiD2d8HgaOaC04a4dhfPq4vxTsJk940qxo0HHUCwckC9XXbwefuUicz 9R2C6/GTi7RmbfyPJcAZcxFSxSHsWcr5fYO0ZQC2bS0eknw/RV7nrTttiPO7 Jd3lMyzfB3561sbrpEMwuWgnfFWK8ptqdUxcWf+aiUPLdf11Jeh0vEmjS831 n2sbuAhgHBJajerPi4PClE0mCXmCZMNdI1BXDD7E7c4Mnr3/1tWQeqwQLq4V pF/+ =q3c/ -----END PGP SIGNATURE----- ---------------- Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Sun, Sep 20, 2015 at 9:54 PM, Wang, Zhiqiang <zhiqiang.wang@xxxxxxxxx> wrote: > Sorry the commands don't format well. It should be 3 commands. > > 1. ceph osd tier cache-mode cache-pool forward > 2. ceph osd tier remove-overlay base-pool > 3. ceph osd tier remove base-pool cache-pool > >> -----Original Message----- >> From: Wang, Zhiqiang >> Sent: Monday, September 21, 2015 11:52 AM >> To: 'Robert LeBlanc' >> Cc: ceph-users@xxxxxxxxxxxxxx >> Subject: RE: Delete pool with cache tier >> >> You should remove the tier first, using the command below. And try deleting >> the pool after that. >> >> ceph osd tier cache-mode cache-pool forward ceph osd tier remove-overlay >> base-pool ceph osd tier remove base-pool cache-pool >> >> > -----Original Message----- >> > From: Robert LeBlanc [mailto:robert@xxxxxxxxxxxxx] >> > Sent: Monday, September 21, 2015 11:40 AM >> > To: Wang, Zhiqiang >> > Cc: ceph-users@xxxxxxxxxxxxxx >> > Subject: Re: Delete pool with cache tier >> > >> > -----BEGIN PGP SIGNED MESSAGE----- >> > Hash: SHA256 >> > >> > Getting a slightly different message this time: >> > >> > [root@nodez ~]# ceph osd pool delete ssd sdd >> > --yes-i-really-really-mean-it Error >> > EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in >> > pool ssd. If you are *ABSOLUTELY CERTAIN* that is what you want, pass >> > the pool name *twice*, followed by --yes-i-really-really-mean-it. >> > [root@nodez ~]# ceph osd pool delete rbd rbd >> > --yes-i-really-really-mean-it Error >> > EBUSY: pool 'rbd' has tiers ssd >> > >> > Before I was getting something along the lines of "Error EBUSY: pool >> > 'ssd' is tier for rbd" >> > - ---------------- >> > Robert LeBlanc >> > PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 >> > >> > >> > On Sun, Sep 20, 2015 at 9:36 PM, Wang, Zhiqiang wrote: >> > > I remember previously I can delete the cache pool without >> > > flushing/evicting >> > all the objects first. The way I did it is to remove the cache tier >> > first (certainly without the flushing/evicting steps), and then delete the pool. >> > > >> > >> -----Original Message----- >> > >> From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On >> > >> Behalf Of Robert LeBlanc >> > >> Sent: Saturday, September 19, 2015 2:04 AM >> > >> To: ceph-users@xxxxxxxxxxxxxx >> > >> Subject: Delete pool with cache tier >> > >> >> > >> -----BEGIN PGP SIGNED MESSAGE----- >> > >> Hash: SHA256 >> > >> >> > >> Is there a way to delete a pool with a cache tier without first >> > >> evicting the cache tier and removing it (ceph 0.94.3)? >> > >> >> > >> Something like: >> > >> >> > >> ceph osd pool delete --delete-cache-tier --yes-i-really-really-mean-it >> > >> >> > >> Evicting the cache tier has taken over 24 hours and I just want to >> > >> trash it and recreate it. It takes too long to delete all the RBDs >> > >> in the pool as well so it seems that I'm stuck. Trying to delete >> > >> the pool or the cache error with saying that it is participating in a cache >> tier. >> > >> >> > >> There are not many RBDs, but one has 10,000 clones to test a high >> > >> number of clones. >> > >> >> > >> Thanks, >> > >> - ---------------- >> > >> Robert LeBlanc >> > >> PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 >> > >> -----BEGIN PGP SIGNATURE----- >> > >> Version: Mailvelope v1.1.0 >> > >> Comment: https://www.mailvelope.com >> > >> >> > >> >> > wsFcBAEBCAAQBQJV/FISCRDmVDuy+mK58QAAsgsP/1WSFOHSkcVy6O582ECf >> > >> 9JN6/ZyvcH5HMSsB1cE0bEziDEsgoYEGdTSgB+GytABb+0BRip9SjH7kDpcs >> > >> >> > 5/1ZvAv9dgnNPbwBb9zOWp6p27fDwQ5vdmy4UnT7iyPbNFz2Cyp09g8mwEpe >> > >> >> nAu2mDorwOGtzPv4z7LUnevHigyhWIZpGJhw7hJGuKVNxRXwAbSXQqk7YzKI >> > >> xg6Ccs/eDpTiSygD+PeAfC7uizjqrw28lBaEmlgaK5OfFvrhXWSNZr6AuQap >> > >> wEv4QG+0NsUzptOMSTIlhBHS/0HZb87vscckBlaitfWzOiv73PuKQRpwVFRD >> > >> IkcIZx83I2pGQ4ir7LkjmmyQgW1cY5FcHrC6V70kaqpjgT5tuEIpwtlfJoUc >> > >> >> qpt1fKeEGF4sutLWpQCgPyY/bQC144PZyMYWjNS17GbzkoR/AwaZ8cBiK2+P >> > >> 1Htc9ntk4hwtPOWXa6kYfRASLbC+nqTBFWTq5hcDkD/5ViTKhMpW+ldInaSt >> > >> 8g8jukLWQ0ZjFET0MfYogYWEAdsER4dhk3bawfA/0dKiAyE5UPN5L9CvZ9kp >> > >> >> > JPVqmSPKhXU68xGQXE7Ugx9BpWZXiRyO8hBOzoivrcvbZOLUhklQW61Qmq0A >> > >> >> > EKWyeXy7P9cE3OONelWmgUXxVPuZT2ZAaoM+KjwJKdT1Jt7VtNVjqgS9NvwZ >> > >> alzR >> > >> =y/7e >> > >> -----END PGP SIGNATURE----- >> > >> _______________________________________________ >> > >> ceph-users mailing list >> > >> ceph-users@xxxxxxxxxxxxxx >> > >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > >> > -----BEGIN PGP SIGNATURE----- >> > Version: Mailvelope v1.1.0 >> > Comment: https://www.mailvelope.com >> > >> > >> wsFcBAEBCAAQBQJV/3wmCRDmVDuy+mK58QAAp9UQALKmtD4n/flKm8P12fo >> > J >> > tTUrlvPa5i1wSSmq7sKmjowe3r+l1fFC8I9gElfX7tLkUAgLKvWC2Xp9eZDf >> > tD1jkPaP3obdvdmRkfqQUfXdznMWS7l2VrUcoczmw3xzC6sTrqe6XsDIILuW >> > JDnsXK0PRVN6pt2GSpuBUSMl46J+U0d1tbcFNFkoxjdwxuLybxCBlnevjbik >> > tWx1UhQo9lSZAT1/9gBx6IXIukHapzFubZymKJ7W89F0NHKLL61YwDeQsovH >> > MDjjJGMEwmAyuqZHxBOD94B38WUdAFzMRhSlgoy+ILafekFmvccsn5zD+SS1 >> > FF6owWbC9AbLu1bxoblw7GyFIbWmaBQb6rG3Nt4/XzaSQNS5n7mh9nK87S/l >> > 3ACPT2QKIZ6oZEsbBJtL9NYxh573AxNhg6054SyU+spLrv9jux6vTPrLPbs2 >> > +YeTtQnIKUR+hi8zGH5jAgeFHkk81u6qCiwuyfxrF4MJkrKc1ajrudDkTO/G >> > 6i+/SCTCKfLR58/iLr7eLcUeTc0y8xqRhfr2VPfmim5TlRuIVqtUIf6/f4Uc >> > SDj5XU0SpS5+Jw03ApsQNQbBsgOo0EYz3p49unMjVaDIzh8HTmkuR2hfvf82 >> > 9LQXDUmPd1eugaHnZ7XK9CN3Z7SrBJxT2WIJ3P5+bqC3xrT5QJuGoCmTRr/U >> > Mweq >> > =2JoP >> > -----END PGP SIGNATURE----- _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com