Re: Unable to delete rbd images

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I would check the trash to see if the image has been moved there. If it is, try to restore it to check its watchers. If you're able to restore it, try blacklisting the specific client session, so something like this:

# check trash
rbd -p iscsi-images trash ls --all

# try restoring it
rbd -p iscsi-images trash ls --all
<some_ID> tegile-500tb

rbd trash restore -p iscsi-images <some_ID>

# check existing locks
rbd lock list iscsi-images/tegile-500tb

# could look like this:
tegile-500tb -p iscsi-images
There is 1 exclusive lock on this image.
Locker          ID                    Address
client.1211875  auto 139643345791728  192.168.3.12:0/2259335316

# try blacklisting the client
ceph osd blacklist add client.1211875

# check the locks again

# try deleting the image again

If the image is not in the trash, does a lock list return anything? Do you know the block_name_prefix of that image to check if there are remainders of that imge in the pool? This would look like this:

rados -p iscsi-images ls | grep <block_name_prefix>

If there are rados objects belonging to the image but no header, you could try restoring the rbd_header object but let's not jump too far ahead. Check the other things first.

Regards,
Eugen

Zitat von Mohammad Alam <samdto987@xxxxxxxxx>:

Hello All,
Greetings. We've a Ceph Cluster with the version
*ceph version 14.2.16-402-g7d47dbaf4d
(7d47dbaf4d0960a2e910628360ae36def84ed913) nautilus (stable)
=========================================

Issues: Can't able to delete rbd images

We have deleted target from the dashboard and now trying to delete rbd images from cli but not able to delete.

when we ran "rbd rm -f tegile-500tb -p iscsi-images" its returning
2023-10-16 15:22:16.719 7f90bb332700 -1 librbd::image::PreRemoveRequest: 0x7f90a80041a0 check_image_watchers: image has watchers - not removing
Removing image: 0% complete...failed.
rbd: error: image still has watchers
This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout.
============================

It is also not being deleted from dashboard.

============================
Even we tried to list the watcher but it is not returning anything like no such file or directory ,

============================

"rbd info iscsi-images/tegile-500tb"
rbd: error opening image tegile-500tb: (2) No such file or directory

============================

It is not showing on "rbd showmapped" output as well for that particular images, hence we can not unmap it.

We can not restart iscsi gateway because that is being running and we can not interrupt it.

===========================

Suggest how to fix this issue,
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux