On Mon, Sep 8, 2014 at 6:33 AM, Eduard Kormann <ekormann at dunkel.de> wrote:
> Hello,
>
> have I missed something or is it a feature: When I restart a osd on the
> belonging server so it restarts normally:
>
> root at cephosd10:~# service ceph restart osd.76
> === osd.76 ===
> === osd.76 ===
> Stopping Ceph osd.76 on cephosd10...kill 799176...done
> === osd.76 ===
> create-or-move updating item name 'osd.76' weight 3.64 at location
> {host=cephosd10,root=default} to crush map
> Starting Ceph osd.76 on cephosd10...
> starting osd.76 at :/0 osd_data /var/lib/ceph/osd/ceph-76
> /var/lib/ceph/osd/ceph-76/journal
>
> But if I trie to restart osd on the admin server...:
>
> root at cephadmin:/etc/ceph# service ceph -a restart osd.76
> === osd.76 ===
> === osd.76 ===
> Stopping Ceph osd.76 on cephosd10...kill 800262...kill 800262...done
> === osd.76 ===
> df: `/var/lib/ceph/osd/ceph-76/.': No such file or directory
> df: no file systems processed
> create-or-move updating item name 'osd.76' weight 1 at location
> {host=cephadmin,root=default} to crush map
> Starting Ceph osd.76 on cephosd10...
> starting osd.76 at :/0 osd_data /var/lib/ceph/osd/ceph-76
> /var/lib/ceph/osd/ceph-76/journal
>
> ...it will associated with the admin server in the crush map:
> -17 0 host cephadmin
> 76 0 osd.76 up 0
>
> Before that each osd could be started from arbitrary server with option
> "-a". Apparently it no longer works.
> How do I run any osd from any server without error messages?
...huh. I didn't realize the "-a" option still existed. You should be
able to prevent this from happening by adding "osd crush update on
start = false" to the global section of your ceph.conf on any nodes
which you are going to use to restart OSDs from other nodes with.
I created a ticket to address this issue: http://tracker.ceph.com/issues/9407
-Greg
Software Engineer #42 @ http://inktank.com | http://ceph.com
