I added a retention schedule (I didn’t have one before), and it seems like that did the job, at least for now.
Could that be the reason why scheduled snapshots stopped, or is there another reason? What is peculiar to me is that the “last” date on the hourly snapshot is earlier that the last snapshot taken.
Thanks,
George
> On Oct 13, 2021, at 10:47 PM, Kyriazis, George <george.kyriazis@xxxxxxxxx> wrote:
>
> Hello ceph-users,
>
> I am running Proxmox 7 with ceph 16.2.6 with 46 OSDs.
>
> I enabled snap_schedule about a month ago, and it seemed to be going fine, at least at the beginning.
>
> I’ve noticed, however, that snapshots stopped happening, as shown below:
>
> root@vis-mgmt:/ceph/backups/nassie/NAS/.snap# ls
> scheduled-2021-09-12-23_00_00 scheduled-2021-09-24-23_00_00 scheduled-2021-09-27-18_00_00
> scheduled-2021-09-19-23_00_00 scheduled-2021-09-25-23_00_00 scheduled-2021-09-27-19_00_00
> scheduled-2021-09-20-23_00_00 scheduled-2021-09-26-23_00_00 scheduled-2021-09-27-20_00_00
> scheduled-2021-09-21-23_00_00 scheduled-2021-09-27-15_00_00 scheduled-2021-09-27-21_00_00
> scheduled-2021-09-22-23_00_00 scheduled-2021-09-27-16_00_00
> scheduled-2021-09-23-23_00_00 scheduled-2021-09-27-17_00_00
> root@vis-mgmt:/ceph/backups/nassie/NAS/.snap#
>
> Snap-schedule is below:
>
> root@vis-mgmt:/ceph/backups/nassie/NAS/.snap# ceph fs snap-schedule list /backups/nassie/NAS
> /backups/nassie/NAS 1h
> /backups/nassie/NAS 24h
> /backups/nassie/NAS 7d
> /backups/nassie/NAS 4w
> root@vis-mgmt:/ceph/backups/nassie/NAS/.snap#
>
> And snap-schedule status:
>
> root@vis-mgmt:/ceph/backups/nassie/NAS/.snap# ceph fs snap-schedule status /backups/nassie/NAS
> {"fs": "cephfs", "subvol": null, "path": "/backups/nassie/NAS", "rel_path": "/backups/nassie/NAS", "schedule": "1h", "retention": {}, "start": "2021-09-08T02:00:00", "created": "2021-09-09T22:57:14", "first": "2021-09-09T23:00:00", "last": "2021-09-09T23:00:00", "last_pruned": null, "created_count": 1, "pruned_count": 0, "active": true}
> ===
> {"fs": "cephfs", "subvol": null, "path": "/backups/nassie/NAS", "rel_path": "/backups/nassie/NAS", "schedule": "24h", "retention": {}, "start": "2021-09-08T02:00:00", "created": "2021-09-09T23:01:17", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}
> ===
> {"fs": "cephfs", "subvol": null, "path": "/backups/nassie/NAS", "rel_path": "/backups/nassie/NAS", "schedule": "7d", "retention": {}, "start": "2021-09-08T02:00:00", "created": "2021-09-09T23:01:26", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}
> ===
> {"fs": "cephfs", "subvol": null, "path": "/backups/nassie/NAS", "rel_path": "/backups/nassie/NAS", "schedule": "4w", "retention": {}, "start": "2021-09-08T02:00:00", "created": "2021-09-09T23:01:36", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}
> root@vis-mgmt:/ceph/backups/nassie/NAS/.snap#
>
> So, snap scheduler’s looks like it’s active, but no snapshots are being taken.
>
> /var/log/ceph/ceph-mgr.<hostname>.*.log on the node running ceph-mgr only has the following lines regarding snapshot schedules:
>
> 2021-10-13T22:44:11.339-0500 7f3acac28700 0 [snap_schedule INFO mgr_util] scanning for idle connections..
> 2021-10-13T22:44:11.339-0500 7f3acac28700 0 [snap_schedule INFO mgr_util] cleaning up connections: []
> 2021-10-13T22:44:41.336-0500 7f3acac28700 0 [snap_schedule INFO mgr_util] scanning for idle connections..
> 2021-10-13T22:44:41.336-0500 7f3acac28700 0 [snap_schedule INFO mgr_util] cleaning up connections: []
>
>
> Any reasons why snapshot schedule would stop working? Why would they get stuck?
>
> Thank you!
>
> George
>
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
