I was able to drill it further down. The messages get logged when I create a VM image snapshot like: "rbd snap create libvirt/wiki@backup" And while the snapshot gets deleted at the end. Btw. I'm runing Ceph 10.2.3 I saw this: http://tracker.ceph.com/issues/18990 and thought this might be related, but the messages are quite different. I'm not sure what else I could try to understand what's going on. Thanks Dieter > On 25. Aug 2017, at 15:42, Dieter Jablanovsky <dieter@xxxxxxxxx> wrote: > > Hi Cephians, > > I wonder if someone has seen this before. > > Every day between 3:09am and 3:19am I'm seeing those entries in the logfile on ONE of the 2 OSD nodes of my cluster. > > 3:09 is the time where I start to backup my qemu/kvm-VM images, which are stored as objects in CEPH. For that, I first "sync" the VM OS, then create a CEPH snapshot of the VM image and then copy this snapshot to an external disk. > After that is done, the snapshot gets deleted and the next VM is processed. The backup of the 7 VM images takes roughly 10 minutes. Later during the day I do not see those messages anymore. > > Anyone any idea what they are caused by ? The cluster is Healthy and I do not see any problems at all. Just these messages in the syslog. > > Many Thanks > Dieter > > > > Aug 24 03:09:03 muc1 kernel: [25906051.274363] EXT4-fs (dm-4): mounted filesystem with ordered data mode. Opts: (null) > Aug 24 03:09:05 muc1 ceph-osd[11276]: 2017-08-24 03:09:05.507291 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e8910665:::inc_osdmap.6265:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6265__0_A6608917__none) in index: (61) No data available > Aug 24 03:09:05 muc1 ceph-osd[11276]: 2017-08-24 03:09:05.508160 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:15dee050:::osdmap.6265:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6265__0_0A077BA8__none) in index: (61) No data available > Aug 24 03:10:00 muc1 ceph-osd[11276]: 2017-08-24 03:10:00.416815 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e5710665:::inc_osdmap.6266:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6266__0_A6608EA7__none) in index: (61) No data available > Aug 24 03:10:00 muc1 ceph-osd[11276]: 2017-08-24 03:10:00.417142 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1edee050:::osdmap.6266:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6266__0_0A077B78__none) in index: (61) No data available > Aug 24 03:10:02 muc1 ceph-osd[11276]: 2017-08-24 03:10:02.596619 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ee710665:::inc_osdmap.6267:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6267__0_A6608E77__none) in index: (61) No data available > Aug 24 03:10:02 muc1 ceph-osd[11276]: 2017-08-24 03:10:02.596706 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:101ee050:::osdmap.6267:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6267__0_0A077808__none) in index: (61) No data available > Aug 24 03:12:14 muc1 ceph-osd[11276]: 2017-08-24 03:12:14.773422 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e0f10665:::inc_osdmap.6268:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6268__0_A6608F07__none) in index: (61) No data available > Aug 24 03:12:14 muc1 ceph-osd[11276]: 2017-08-24 03:12:14.786772 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1b9ee050:::osdmap.6268:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6268__0_0A0779D8__none) in index: (61) No data available > Aug 24 03:12:17 muc1 ceph-osd[11276]: 2017-08-24 03:12:17.476468 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:eb310665:::inc_osdmap.6269:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6269__0_A6608CD7__none) in index: (61) No data available > Aug 24 03:12:17 muc1 ceph-osd[11276]: 2017-08-24 03:12:17.476609 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:169ee050:::osdmap.6269:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6269__0_0A077968__none) in index: (61) No data available > Aug 24 03:14:08 muc1 ceph-osd[11276]: 2017-08-24 03:14:08.295982 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ecb10665:::inc_osdmap.6270:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6270__0_A6608D37__none) in index: (61) No data available > Aug 24 03:14:08 muc1 ceph-osd[11276]: 2017-08-24 03:14:08.296278 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:13fee050:::osdmap.6270:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6270__0_0A077FC8__none) in index: (61) No data available > Aug 24 03:14:09 muc1 ceph-osd[11276]: 2017-08-24 03:14:09.381778 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e3410665:::inc_osdmap.6271:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6271__0_A66082C7__none) in index: (61) No data available > Aug 24 03:14:09 muc1 ceph-osd[11276]: 2017-08-24 03:14:09.397770 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:193ee050:::osdmap.6271:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6271__0_0A077C98__none) in index: (61) No data available > Aug 24 03:15:05 muc1 ceph-osd[11276]: 2017-08-24 03:15:05.290743 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e9c10665:::inc_osdmap.6272:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6272__0_A6608397__none) in index: (61) No data available > Aug 24 03:15:05 muc1 ceph-osd[11276]: 2017-08-24 03:15:05.290888 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:143ee050:::osdmap.6272:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6272__0_0A077C28__none) in index: (61) No data available > Aug 24 03:15:06 muc1 ceph-osd[11276]: 2017-08-24 03:15:06.545915 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e4c10665:::inc_osdmap.6273:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6273__0_A6608327__none) in index: (61) No data available > Aug 24 03:15:06 muc1 ceph-osd[11276]: 2017-08-24 03:15:06.546051 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1fbee050:::osdmap.6273:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6273__0_0A077DF8__none) in index: (61) No data available > Aug 24 03:16:05 muc1 ceph-osd[11276]: 2017-08-24 03:16:05.140376 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ef010665:::inc_osdmap.6274:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6274__0_A66080F7__none) in index: (61) No data available > Aug 24 03:16:05 muc1 ceph-osd[11276]: 2017-08-24 03:16:05.140525 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:114ee050:::osdmap.6274:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6274__0_0A077288__none) in index: (61) No data available > Aug 24 03:16:06 muc1 ceph-osd[11276]: 2017-08-24 03:16:06.397144 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e1810665:::inc_osdmap.6275:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6275__0_A6608187__none) in index: (61) No data available > Aug 24 03:16:06 muc1 ceph-osd[11276]: 2017-08-24 03:16:06.397342 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1a4ee050:::osdmap.6275:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6275__0_0A077258__none) in index: (61) No data available > Aug 24 03:17:56 muc1 ceph-osd[11276]: 2017-08-24 03:17:56.628233 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ea810665:::inc_osdmap.6276:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6276__0_A6608157__none) in index: (61) No data available > Aug 24 03:17:56 muc1 ceph-osd[11276]: 2017-08-24 03:17:56.628486 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:17cee050:::osdmap.6276:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6276__0_0A0773E8__none) in index: (61) No data available > Aug 24 03:17:57 muc1 ceph-osd[11276]: 2017-08-24 03:17:57.893578 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e7610665:::inc_osdmap.6277:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6277__0_A66086E7__none) in index: (61) No data available > Aug 24 03:17:57 muc1 ceph-osd[11276]: 2017-08-24 03:17:57.893713 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1d0ee050:::osdmap.6277:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6277__0_0A0770B8__none) in index: (61) No data available > Aug 24 03:19:42 muc1 ceph-osd[11276]: 2017-08-24 03:19:42.176583 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ede10665:::inc_osdmap.6278:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6278__0_A66087B7__none) in index: (61) No data available > Aug 24 03:19:42 muc1 ceph-osd[11276]: 2017-08-24 03:19:42.186388 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:120ee050:::osdmap.6278:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6278__0_0A077048__none) in index: (61) No data available > -- atsec information security GmbH, Steinstrasse 70, D-81667 München, Germany Phone: +49-89-44249830 / Fax: +49-89-44249831 / Web: atsec.com HRB: 129439 (Amtsgericht München) Geschäftsführer: Salvatore la Pietra, Staffan Persson
Attachment:
signature.asc
Description: Message signed with OpenPGP
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
