Nope. Nothing works. This is VERY frustrating.
What happened:
- I rebooted the box, simulating a system failure.
- When the system came back up, ceph wasn't started, and the osd volumes weren't mounted.
- I did a "service ceph start osd" and the ceph processes don't start
- I did a "ceph-deploy activate" on the devices, so they're mounted. "service ceph start" still doesn't start anything.
Right now:
# service ceph restart
=== osd.18 ===
=== osd.18 ===
Stopping Ceph osd.18 on tm1cldosdl04...done
=== osd.18 ===
create-or-move updated item name 'osd.18' weight 0.45 at location {host=tm1cldosdl04,root=default} to crush map
Starting Ceph osd.18 on tm1cldosdl04...
starting osd.18 at :/0 osd_data /var/lib/ceph/osd/ceph-18 /var/lib/ceph/osd/ceph-18/journal
=== osd.17 ===
=== osd.17 ===
Stopping Ceph osd.17 on tm1cldosdl04...done
=== osd.17 ===
create-or-move updated item name 'osd.17' weight 0.45 at location {host=tm1cldosdl04,root=default} to crush map
Starting Ceph osd.17 on tm1cldosdl04...
starting osd.17 at :/0 osd_data /var/lib/ceph/osd/ceph-17 /var/lib/ceph/osd/ceph-17/journal
=== osd.19 ===
=== osd.19 ===
Stopping Ceph osd.19 on tm1cldosdl04...done
=== osd.19 ===
create-or-move updated item name 'osd.19' weight 0.45 at location {host=tm1cldosdl04,root=default} to crush map
Starting Ceph osd.19 on tm1cldosdl04...
starting osd.19 at :/0 osd_data /var/lib/ceph/osd/ceph-19 /var/lib/ceph/osd/ceph-19/journal
=== osd.16 ===
=== osd.16 ===
Stopping Ceph osd.16 on tm1cldosdl04...done
=== osd.16 ===
create-or-move updated item name 'osd.16' weight 0.45 at location {host=tm1cldosdl04,root=default} to crush map
Starting Ceph osd.16 on tm1cldosdl04...
starting osd.16 at :/0 osd_data /var/lib/ceph/osd/ceph-16 /var/lib/ceph/osd/ceph-16/journal
[NEW:note: root at tm1cldosdl04 on parent: /root]
# ps -eaf|grep ceph
root 7528 6124 0 07:32 pts/0 00:00:00 grep ceph
[NEW:note: root at tm1cldosdl04 on parent: /root]
# ceph osd tree
# id weight type name up/down reweight
-1 9 root default
-2 1.8 host tm1cldosdl01
0 0.45 osd.0 up 1
1 0.45 osd.1 up 1
2 0.45 osd.2 up 1
3 0.45 osd.3 up 1
-3 1.8 host tm1cldosdl02
4 0.45 osd.4 up 1
5 0.45 osd.5 up 1
6 0.45 osd.6 up 1
7 0.45 osd.7 up 1
-4 1.8 host tm1cldosdl03
8 0.45 osd.8 up 1
9 0.45 osd.9 up 1
10 0.45 osd.10 up 1
11 0.45 osd.11 up 1
-5 3.6 host tm1cldosdl04
12 0.45 osd.12 DNE
13 0.45 osd.13 DNE
14 0.45 osd.14 DNE
15 0.45 osd.15 DNE
16 0.45 osd.16 down 0
17 0.45 osd.17 down 0
18 0.45 osd.18 down 0
19 0.45 osd.19 down 0
I'm missing something here. I don't know if it's a config issue or what. But the docs haven't helped me.
From: Karan Singh [mailto:karan.singh@xxxxxx]
Sent: Friday, August 08, 2014 1:11 AM
To: O'Reilly, Dan
Cc: ceph-users at lists.ceph.com
Subject: Re: Can't start OSD
Try to make these OSD IN
ceph osd in osd.12 osd.13 osd.14 osd.15
Then restart osd services
- Karan Singh -
On 08 Aug 2014, at 00:55, O'Reilly, Dan <Daniel.OReilly at dish.com<mailto:Daniel.OReilly at dish.com>> wrote:
# id weight type name up/down reweight
-1 7.2 root default
-2 1.8 host tm1cldosdl01
0 0.45 osd.0 up 1
1 0.45 osd.1 up 1
2 0.45 osd.2 up 1
3 0.45 osd.3 up 1
-3 1.8 host tm1cldosdl02
4 0.45 osd.4 up 1
5 0.45 osd.5 up 1
6 0.45 osd.6 up 1
7 0.45 osd.7 up 1
-4 1.8 host tm1cldosdl03
8 0.45 osd.8 up 1
9 0.45 osd.9 up 1
10 0.45 osd.10 up 1
11 0.45 osd.11 up 1
-5 1.8 host tm1cldosdl04
12 0.45 osd.12 down 0
13 0.45 osd.13 down 0
14 0.45 osd.14 down 0
15 0.45 osd.15 down 0
[ceph at tm1cldosdl04 ~]$ sudo /etc/init.d/ceph start osd.12
/etc/init.d/ceph: osd.12 not found (/etc/ceph/ceph.conf defines , /var/lib/ceph defines )
What am I missing? Specifically, what would need to be in ceph.conf or /var/lib/ceph?
Dan O'Reilly
UNIX Systems Administration
<image001.jpg>
9601 S. Meridian Blvd.
Englewood, CO 80112
720-514-6293
_______________________________________________
ceph-users mailing list
ceph-users at lists.ceph.com<mailto:ceph-users at lists.ceph.com>
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140808/ba401f2d/attachment.htm>
