ceph & hbase:

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

Has anyone got hbase working on ceph ? I've got ceph (cuttlefish) and hbase-0.94.9.
My setup is erroring out looking for getDefaultReplication & getDefaultBlockSize ... but I can see those defined in core/org/apache/hadoop/fs/ceph/CephFileSystem.java

hbase seems to be talking to ceph okay ... because I do see initialization stuff like "2013-07-17 10:51:42,912 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=ceph://dmse-141/hbase/-ROOT-/70236052/.tmp/.regioninfo with permission=rwxrwxrwx" in the logs.


hbase master log output:

2013-07-17 10:52:27,934 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultReplication
2013-07-17 10:52:27,934 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultBlockSize
2013-07-17 10:52:27,934 INFO org.apache.hadoop.hbase.HBaseFileSystem: Create Writer, sleeping 1000 times 10
2013-07-17 10:52:37,935 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultReplication
2013-07-17 10:52:37,935 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultBlockSize
2013-07-17 10:52:37,935 WARN org.apache.hadoop.hbase.HBaseFileSystem: Create Writer, retries exhausted
2013-07-17 10:52:37,936 ERROR org.apache.hadoop.hbase.master.MasterFileSystem: bootstrap
java.io.IOException: Exception in createWriter
        at org.apache.hadoop.hbase.regionserver.wal.HLogFileSystem.createWriter(HLogFileSystem.java:66)
        at org.apache.hadoop.hbase.regionserver.wal.HLog.createWriterInstance(HLog.java:688)
        at org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter(HLog.java:621)
        at org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter(HLog.java:565)
        at org.apache.hadoop.hbase.regionserver.wal.HLog.<init>(HLog.java:446)
        at org.apache.hadoop.hbase.regionserver.wal.HLog.<init>(HLog.java:345)
        at org.apache.hadoop.hbase.regionserver.HRegion.createHRegion(HRegion.java:4272)
        at org.apache.hadoop.hbase.regionserver.HRegion.createHRegion(HRegion.java:4231)
        at org.apache.hadoop.hbase.regionserver.HRegion.createHRegion(HRegion.java:4288)
        at org.apache.hadoop.hbase.regionserver.HRegion.createHRegion(HRegion.java:4190)
        at org.apache.hadoop.hbase.master.MasterFileSystem.bootstrap(MasterFileSystem.java:515)
        at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:463)
        at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:148)
        at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:133)
        at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:560)
        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:419)
        at java.lang.Thread.run(Thread.java:662)


Here's the conf/hbase-site.xml

<configuration>
  <property>
    <name>fs.ceph.impl</name>
    <value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
    <description>
    </description>
  </property>
  <property>
    <name>fs.default.name</name>
    <value>ceph://dmse-141/</value>
  </property>
  <property>
    <name>ceph.conf.file</name>
    <value>/etc/ceph/ceph.conf</value>
  </property>
  <property>
    <name>ceph.conf.options</name>
    <value>client_readahead_min=4193404</value>
  </property>
  <property>
    <name>hbase.rootdir</name>
    <value>ceph://dmse-141/hbase</value>
  </property>
  <property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
  </property>
    <property>
      <name>hbase.zookeeper.quorum</name>
      <value>dmse-141</value>
    </property>
</configuration>



_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux