Samuel Just <samuelj <at> hq.newdream.net> writes: > From the logs, it looks like the osd and mds are failing to bind to > an address. Perhaps b3 is not a valid host name? Thanks! That wasn't it (b3 is valid), but you started me looking at the networking side of things again (for the nth time) and this time around I noticed there was no loopback interface on the box. That in itself was odd, although it didn't immediately spring to mind that the lack of a loopback would stop ceph working. But I added a loopback anyway on the basis of "avoid oddness" and that got it all going. I still don't know why a loopback is required for ceph, but apparently it is! FYI, with it working, the osd and mds are still bound to the wildcard address rather than to a specific address (as they were before the loopback was installed). Without loopback: # lsof -n -i | egrep 'COMMAND|cmon|cmds|cosd' COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME cmon 3321 root 5u IPv4 8451 TCP 10.200.63.129:6789 (LISTEN) cmds 3357 root 4u IPv4 8465 TCP *:6800 (LISTEN) cmds 3357 root 5u IPv4 10044 TCP 10.200.63.129:59480->10.200.63.129:6789 (SYN_SENT) cosd 3466 root 3u IPv4 8548 TCP *:6801 (LISTEN) cosd 3466 root 5u IPv4 8549 TCP *:6802 (LISTEN) cosd 3466 root 6u IPv4 8550 TCP *:6803 (LISTEN) cosd 3466 root 13u IPv4 10046 TCP 10.200.63.129:59481->10.200.63.129:6789 (SYN_SENT) Note that the DEVICE number for the SYN_SENT connections keeps changing in this situation. With the loopback: # lsof -n -i | egrep 'COMMAND|cmon|cmds|cosd' COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME cmon 6633 root 5u IPv4 13277 TCP 10.200.63.129:6789 (LISTEN) cmon 6633 root 6u IPv4 14353 TCP 10.200.63.129:6789->10.200.63.129:32884 (ESTABLISHED) cmon 6633 root 7u IPv4 13367 TCP 10.200.63.129:6789->10.200.63.129:32883 (ESTABLISHED) cmds 6669 root 4u IPv4 13294 TCP *:6800 (LISTEN) cmds 6669 root 5u IPv4 13366 TCP 10.200.63.129:32883->10.200.63.129:6789 (ESTABLISHED) cmds 6669 root 10u IPv4 13456 TCP 10.200.63.129:41828->10.200.63.129:6801 (ESTABLISHED) cosd 6741 root 3u IPv4 14350 TCP *:6801 (LISTEN) cosd 6741 root 5u IPv4 14351 TCP *:6802 (LISTEN) cosd 6741 root 6u IPv4 14352 TCP *:6803 (LISTEN) cosd 6741 root 13u IPv4 13401 TCP 10.200.63.129:32884->10.200.63.129:6789 (ESTABLISHED) cosd 6741 root 14u IPv4 14467 TCP 10.200.63.129:6801->10.200.63.129:41828 (ESTABLISHED) Cheers, Chris. -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
