Thanks for your help!! But I have the other question: If I do "/etc/init.d/ceph -a stop " the system doesn't stop all the deamon which include cmon and cosd. Therefore I have to enter each host to close the deamon seperatly. Finally, there is no deamon running in the system. I want to know why we cannot stop the deamon by "/etc/init.d/ceph -a stop "??? What's wrong with my system?? The ceph.conf as shown below: [global] pid file = /var/run/ceph/$name.pid debug ms =1 auth supported = cephx [mon] mon data = /data1/mon$id ;debug ms = 1 ;debug mon = 20 ;debug paxos = 20 ;debug auth = 20 [mon0] host = Ceph1 mon addr = 192.168.200.201:6789 [mon1] host = Ceph2 mon addr = 192.168.200.202:6789 [mon2] host = Ceph3 mon addr = 192.168.200.203:6789 [mds] keyring = /etc/ceph/keyring.$name ;debug ms = 1 ;debug mds = 20 [mds0] host = Ceph4 [mds1] host = Ceph5 [osd] keyring = /etc/ceph/keyring.$name osd data = /mnt/btrfs/osd$id osd journal = /opt/osd/osd$id/journal ;osd journal = /data/osd$id/journal osd journal size = 512 ;debug ms = 1 ;debug osd = 20 ;debug filestore = 20 ;debug journal = 20 [osd0] host = Ceph6 btrfs devs = /dev/sdb1 [osd1] host = Ceph6 btrfs devs = /dev/sdc1 [osd2] host = Ceph6 btrfs devs = /dev/sdd1 [osd3] host = Ceph7 btrfs devs = /dev/sdb1 [osd4] host = Ceph7 btrfs devs = /dev/sdc1 [osd5] host = Ceph7 btrfs devs = /dev/sdd1 > > 在 2011年4月1日下午4:31,Yuki <chengmao2010@xxxxxxxxx> ?道: >> The cmon deamon is already running,you should stop it first。do >> "/etc/init.d/ceph -a stop " first ,than mkcephfs ,finally start the whole >> ceph system >> >> -----邮件原件----- >> 发件人: ceph-devel-owner@xxxxxxxxxxxxxxx >> [mailto:ceph-devel-owner@xxxxxxxxxxxxxxx] 代表 ??薇 >> 发送时间: 2011年4月1日 14:54 >> 收件人: ceph-devel@xxxxxxxxxxxxxxx >> 主题: The installation: When we start Ceph, the system stops running. >> >> Hi, >> I set an environment of 20 servers which include 2 MDSs, 3 MONs and 15 >> OSDes. >> My version is 0.25.2 and OS is Fedora 14. >> There's a problem when I was installing the Ceph. >> When I finished "mkcephfs -c /etc/ceph/ceph.conf --allhosts --mkbtrfs >> -k keyring.bin" . >> I start the whole Ceph system. >> But here is the problem I met: >> The system stops running and it shows the error messages as shown below: >> >> === mon.0 === >> Starting Ceph mon0 on Ceph1...already running >> === mon.1 === >> Starting Ceph mon1 on Ceph2... >> ** WARNING: Ceph is still under heavy development, and is only suitable for >> ** >> ** testing and review. Do not trust it with important data. >> ** >> starting mon.1 rank 1 at 192.168.200.202:6789/0 mon_data /data1/mon1 >> fsid f1eb5c4c-5127-5038-6ea9-0cf47e6536c2 >> accepter.bind unable to bind to 192.168.200.202:6789: Address already in use >> failed: 'ssh Ceph2 /usr/local/bin/cmon -i 1 -c /tmp/ceph.conf.29519 ' >> >> I want to know why the system cannot run smoothly. 2011/4/2 Tommi Virtanen <tommi.virtanen@xxxxxxxxxxxxx>: > On Fri, Apr 01, 2011 at 02:53:55PM +0800, ??薇 wrote: >> Hi, >> I set an environment of 20 servers which include 2 MDSs, 3 MONs and 15 >> OSDes. >> My version is 0.25.2 and OS is Fedora 14. >> There's a problem when I was installing the Ceph. >> When I finished "mkcephfs -c /etc/ceph/ceph.conf --allhosts --mkbtrfs >> -k keyring.bin" . >> I start the whole Ceph system. >> But here is the problem I met: >> The system stops running and it shows the error messages as shown below: > > Hi. I see Henry already replied, with good ideas. If that was not > enough to get you going -- especially the part about making sure no > ceph daemons are left running from a previous attempt -- please share > your config file. You might e.g. have two cmon daemons trying to bind > to the same port. > > -- > :(){ :|:&};: > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html