On Mon, Nov 8, 2021 at 3:01 PM Joost Nieuwenhuijse <joost@xxxxxxxxxxx> wrote: > > On 08/11/2021 05:52, Venky Shankar wrote: > > On Sun, Nov 7, 2021 at 3:28 PM Joost Nieuwenhuijse <joost@xxxxxxxxxxx> wrote: > >> > >> Hi, > >> > >> I've enabled a simple CephFS snapshot schedule > >> > >> # ceph fs snap-schedule list / > >> / 8h 6h > >> > >> # ceph fs snap-schedule status / > >> {"fs": "cephfs1", "subvol": null, "path": "/", "rel_path": "/", > >> "schedule": "8h", "retention": {"h": 6}, "start": "2021-11-03T00:00:00", > >> "created": "2021-11-03T16:41:45", "first": null, "last": null, > >> "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} > >> > >> I think this should mean a snapshot is created every 8 hours, and the > >> last 6 snapshots are retained. > >> > >> # ll /cephfs/.snap > >> total 0 > >> drwxr-xr-x 2 root root 0 nov 2 13:58 ./ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 ../ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 scheduled-2021-11-02-16_00_00/ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 scheduled-2021-11-04-00_00_00/ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 scheduled-2021-11-04-08_00_00/ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 scheduled-2021-11-04-16_00_00/ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 scheduled-2021-11-05-00_00_00/ > >> drwxr-xr-x 3 root root 1 nov 2 13:58 scheduled-2021-11-05-08_00_00/ > >> > >> Snapshotting seems to stop after 6 snapshots have been created (today is > >> 2021-11-07). This is after I've already tried removing the schedule and > >> recreating it. > >> > >> A similar problem was reported earlier this month: > >> https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/thread/IWOX3FWI2CAQLDJ73PHTTA76EY3RJRDY/ > >> > >> I'm new to ceph, is this a bug? > > > > Do you see any tracebacks in (ceph-mgr) logs related to snap_schedule plugin? > > No, just this: > > # cat /var/log/ceph/ceph-mgr.miles.log | grep snap > 2021-11-08T07:59:39.518+0000 7fd31d7fa640 0 [snap_schedule INFO > mgr_util] scanning for idle connections.. > 2021-11-08T07:59:39.518+0000 7fd31d7fa640 0 [snap_schedule INFO > mgr_util] cleaning up connections: [] > 2021-11-08T08:00:09.518+0000 7fd31d7fa640 0 [snap_schedule INFO > mgr_util] scanning for idle connections.. > 2021-11-08T08:00:09.518+0000 7fd31d7fa640 0 [snap_schedule INFO > mgr_util] cleaning up connections: [] > 2021-11-08T08:00:39.518+0000 7fd31d7fa640 0 [snap_schedule INFO > mgr_util] scanning for idle connections.. > 2021-11-08T08:00:39.518+0000 7fd31d7fa640 0 [snap_schedule INFO > mgr_util] cleaning up connections: [] > > repeated twice a minute. Could you try restarting ceph-mgr and check if things progress? Also, it would help to enable debug logs for ceph-mgr. > > The snap schedule is still there: > > # ceph fs snap-schedule list / > / 8h 6h > > Joost > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > -- Cheers, Venky _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx