Re: Log message --> "bdev(/var/lib/ceph/osd/ceph-x/block) aio_submit retries"

[nokia ceph <nokiacephusers@xxxxxxxxx>]

Hello,

Can we get any update for this problem?

Thanks

On Thu, Mar 2, 2017 at 2:16 PM, nokia ceph <nokiacephusers@xxxxxxxxx> wrote:

Hello,

Env:- v11.2.0 - bluestore - EC 3 + 1

We are getting below entries both in /var/log/messages and osd logs. May I know what is the impact of the below message and as these message were flooded in osd and sys logs. 

~~~

2017-03-01 13:00:59.938839 7f6c96915700 -1 bdev(/var/lib/ceph/osd/ceph-0/block) aio_submit retries 2

2017-03-01 13:00:59.940939 7f6c96915700 -1 bdev(/var/lib/ceph/osd/ceph-0/block) aio_submit retries 4

2017-03-01 13:00:59.941126 7f6c96915700 -1 bdev(/var/lib/ceph/osd/ceph-0/block) aio_submit retries 1

~~~

I found these messages during the activation of ceph-osd's

~~~ From /var/log/messages

Feb 27 13:59:46 PL6-CN2 sh: command_check_call: Running command: /usr/bin/systemctl start ceph-osd@39

Feb 27 13:59:46 PL6-CN2 systemd: Started Ceph disk activation: /dev/sdk2.

Feb 27 13:59:46 PL6-CN2 ceph-osd: 2017-02-27 13:59:46.540781 7f1f3f016700 -1 bdev(/var/lib/ceph/osd/ceph-39/block) aio_submit retries 9

Feb 27 13:59:46 PL6-CN2 ceph-osd: 2017-02-27 13:59:46.544670 7f1f3f016700 -1 bdev(/var/lib/ceph/osd/ceph-39/block) aio_submit retries 2

Feb 27 13:59:46 PL6-CN2 ceph-osd: 2017-02-27 13:59:46.544854 7f1f3f016700 -1 bdev(/var/lib/ceph/osd/ceph-39/block) aio_submit retries 1

Feb 27 13:59:47 PL6-CN2 kernel: sdl: sdl1

Feb 27 13:59:47 PL6-CN2 kernel: sdl: sdl1

Feb 27 13:59:48 PL6-CN2 kernel: sdl: sdl1 sdl2

Feb 27 13:59:48 PL6-CN2 systemd: Cannot add dependency job for unit microcode.service, ignoring: Unit is not loaded properly: Invalid argument.

Feb 27 13:59:48 PL6-CN2 systemd: Starting Ceph disk activation: /dev/sdl2...

~~~

At the same time on OSD logs:-- /var/log/ceph/ceph-osd.43.log-20170228.gz

2017-02-27 14:00:17.121460 7f147351e940  0 osd.43 0 crush map has features 2199057072128, adjusting msgr requires for clients

2017-02-27 14:00:17.121466 7f147351e940  0 osd.43 0 crush map has features 2199057072128 was 8705, adjusting msgr requires for mons

2017-02-27 14:00:17.121468 7f147351e940  0 osd.43 0 crush map has features 2199057072128, adjusting msgr requires for osds

2017-02-27 14:00:17.121511 7f147351e940  0 osd.43 0 load_pgs

2017-02-27 14:00:17.121514 7f147351e940  0 osd.43 0 load_pgs opened 0 pgs

2017-02-27 14:00:17.121517 7f147351e940  0 osd.43 0 using 1 op queue with priority op cut off at 64.

2017-02-27 14:00:17.122364 7f147351e940 -1 osd.43 0 log_to_monitors {default=true}

2017-02-27 14:00:18.371762 7f147351e940  0 osd.43 0 done with init, starting boot process

2017-02-27 14:00:18.486559 7f1459952700 -1 bdev(/var/lib/ceph/osd/ceph-43/block) aio_submit retries 7

2017-02-27 14:00:18.488770 7f1459952700 -1 bdev(/var/lib/ceph/osd/ceph-43/block) aio_submit retries 4

2017-02-27 14:00:18.489306 7f1459952700 -1 bdev(/var/lib/ceph/osd/ceph-43/block) aio_submit retries 2

2017-02-27 14:00:18.489826 7f1459952700 -1 bdev(/var/lib/ceph/osd/ceph-43/block) aio_submit retries 2

<snip>

..

<snip>

2017-02-27 14:00:18.583234 7f145814f700  0 osd.43 93 crush map has features 2200130813952, adjusting msgr requires for clients

2017-02-27 14:00:18.583257 7f145814f700  0 osd.43 93 crush map has features 2200130813952 was 2199057080833, adjusting msgr requires for mons

2017-02-27 14:00:18.583271 7f145814f700  0 osd.43 93 crush map has features 2200130813952, adjusting msgr requires for osds

~~~~

As per my understanding on a bluestore device, we can write with both O_DIRECT and aio way. For some reasons, bdev can't able to commit with aio type. 

~~~

"ms_type": "async"

~~~

Need your suggestion how to skip these messages. 

Thanks

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com