Re: problems when hadoop runs upon ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Is this the same cluster you were unable to get the MDS out of "creating" on? Hadoop won't work without an active MDS since it can't mount the filesystem. :) 

The reason your MDS isn't starting up is complicated; look for an email on that shortly...
-Greg


On Saturday, March 24, 2012 at 12:18 AM, lixiaobing10@xxxxxxxxxxxxxxxxxx wrote:

> Hi ceph-devel,
> 
> I installed ceph-0.44, which can be mounted by ceph-fuse correctly. Besides, hadoop-0.20.205.0 patched with hadoop-0.20.205.0-cephfs1.patch can run correctly too, but with hdfs as the underlying fs. (refered to http://ceph.newdream.net/wiki/Hadoop_FileSystem)
> 
> However, when I let hadoop use ceph as the fs, I encountered this problem: 
> 
> 12/03/24 14:45:47 INFO ceph.CephFileSystem: initialize:Ceph initialization arguments: CephFSInterface -k /data/keyring.mds.0 -n client.admin --auth-supported=cephx -m 192.168.122.201:6789 --client-readahead-max-periods=1
> 12/03/24 14:45:47 FATAL ceph.CephFileSystem: initialize:Ceph initialization failed!
> Bad connection to FS. command aborted. exception: Ceph initialization failed!
> 
> I have traced the source code from java-side to ceph-side, and found the connection between them failed to establish. But I have no idea about the real cause. Could someone give me any suggestion on this problem?
> 
> Additionally, hadoop-0.20.205.0 patched with hadoop-0.20.205.0-cephfs1.patch can work with ceph-0.20.1, although it would crashed during reduce task phase, and that is why I turned to the latest ceph version.
> 
> Thanks for your attention!
> 
> Best,
> Xiaobing
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx (mailto:majordomo@xxxxxxxxxxxxxxx)
> More majordomo info at http://vger.kernel.org/majordomo-info.html



--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux