Hi, It's a hacky idea but create a script that checks if the Ceph RBD pool is fully "active+clean" to ensure it's ready before starting Proxmox VMs. Something like this... 1. Bash Script: - Write a script that checks if the Ceph RBD pool is in the "active+clean" state using ceph pg stat or ceph -s. - The script should run until the pool is ready before exiting. A loop or something... 2. Systemd Service for Ceph Readiness: - Create a systemd service unit file (something like: ceph-ready.service) that runs the script at startup. - Ensure the service waits until the Ceph cluster is ready before proceeding. 3. Systemd Service for Proxmox VMs: - Modify an existing Proxmox service or create a new one to depend on the ceph-ready.service. - Use After=ceph-ready.service in the unit file to ensure Proxmox VMs start only after Ceph is ready. 4. Enable and Start the Services: - Enable both systemd services to start at boot with systemctl enable. - Reboot to ensure that Proxmox waits for Ceph before starting VMs. Just an idea... Thank you, Bogdan Velica croit.io On Thu, Aug 29, 2024 at 1:53 PM Alfredo Rezinovsky <alfrenovsky@xxxxxxxxx> wrote: > I have a proxmox cluster using an external CEPH cluster. > > Sometimes due to blackouts the servers need to restart. If proxmox starts > before CEPH is ready the VMs fail to boot. > > I want to add a dependency in proxmox to wait for ceph to be ready. > > I can work with a HEALTH_WARN as long the RBD pool is usable. > > ceph status exit status doesn´t helps > > Should I grep for "pgs not active" in ceph status or for "inactive" pgs in > ceph health or is there something more direct to know if everything is > alright? > > > > -- > Alfrenovsky > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |