On Mon, Nov 20, 2023 at 12:41:58PM +0530, Jayanth Reddy wrote: > Hello Users, > We're using libvirt with KVM and the orchestrator is Cloudstack. I raised > the issue already at Cloudstack at > https://github.com/apache/cloudstack/issues/8211 but appears to be at > libvirtd. Below is our environment & issue description: > > It appears that one of our Cloudstack KVM clusters having 8 hosts is having > the issue. We have HCI on these 8 hosts and there are approximately 700+ > VMs running. But strange enough, there are these logs like below on hosts. > > > Oct 25 13:38:11 hv-01 libvirtd[9464]: failed to open the RBD image > '087bb114-448a-41d2-9f5d-6865b62eed15': No such file or directory > Oct 25 20:35:22 hv-01 libvirtd[9464]: failed to open the RBD image > 'ccc1168a-5ffa-4b6d-a953-8e0ac788ebc5': No such file or directory > Oct 26 09:48:33 hv-01 libvirtd[9464]: failed to open the RBD image > 'a3fe82f8-afc9-4604-b55e-91b676514a18': No such file or directory > Oct 26 10:38:17 hv-01 libvirtd[9464]: End of file while reading data: > Input/output error > > > We've got DNS servers on which there is an`A` record resolving to all the > IPv4 Addresses of 8 monitors and there have not been any issues with the > DNS resolution. But the issue of "failed to open the RBD image > 'ccc1168a-5ffa-4b6d-a953-8e0ac788ebc5': No such file or directory" gets > more weird because the VM that is making use of that RBD image lets say > "087bb114-448a-41d2-9f5d-6865b62eed15" is running on altogether different > host like "hv-06". On further inspection of that specific Virtual Machine, > it has been running on that host "hv-06" for more than 4 months or so > (looked at "Last updated" field). Fortunately, the Virtual Machine has no > issues and has been running since then. This is an indication that you have a storage pool defined with the RBD backend. Libvirt tries to enumerate all the images in the pool, and has to open the RBD image to query its size. I won't be trying to read/write the payload of the image. With regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :| _______________________________________________ Users mailing list -- users@xxxxxxxxxxxxxxxxx To unsubscribe send an email to users-leave@xxxxxxxxxxxxxxxxx
