Does anyone succesfully configure hbase to use ceph? I'm having some problems with it, maybe anyone can help.
I have ceph already running and ceph-hadoop bindings installed ('hadoop fs -ls /' working). I'm trying Hbase in pseudo distributed mode, but when starting hbase-master I'm getting this error
2015-12-27 16:41:53,962 INFO [main] mob.MobFileCache: MobFileCache is initialized, and the cache size is 1000
2015-12-27 16:41:54,484 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2046)
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:198)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2060)
Caused by: java.io.IOException: Permission denied
at com.ceph.fs.CephMount.native_ceph_mount(Native Method)
at com.ceph.fs.CephMount.mount(CephMount.java:154)
at org.apache.hadoop.fs.ceph.CephTalker.initialize(CephTalker.java:141)
at org.apache.hadoop.fs.ceph.CephFileSystem.initialize(CephFileSystem.java:98)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2643)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:93)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2680)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2662)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:379)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:1005)
at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:532)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:347)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2041)
This is my core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>ceph://cephmaster:6789/</value>
</property>
<property>
<name>ceph.conf.file</name>
<value>/etc/ceph/ceph.conf</value>
</property>
<property>
<name>ceph.auth.id</name>
<value>admin</value>
</property>
<property>
<name>ceph.auth.keyring</name>
<value>/home/developer/ceph-cluster/ceph.client.admin.keyring</value>
</property>
<property>
<name>fs.ceph.impl</name>
<value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
</property>
<property>
<name>fs.AbstractFileSystem.ceph.impl</name>
<value>org.apache.hadoop.fs.ceph.CephHadoop2FileSystem</value>
</property>
<property>
<name>ceph.data.pools</name>
<value>hadoop1</value>
</property>
<property>
<name>ceph.mon.address</name>
<value>cephmaster:6789</value>
</property>
<property>
<name>ceph.object.size</name>
<value>67108864</value>
</property>
</configuration>
This is my hbase-site.xml
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>ceph://cephmaster:6789/hbase</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>cephmaster</value>
</property>
</configuration>
I already tried adding here fs.defaultFS, ceph.conf.file, ceph.auth.id, ceph.auth.keyfile, fs.ceph.impl and fs.AbstractFileSystem.ceph.impl in hbase-site.xml just in case (although i think they aren't needed here) but I got the same exception.
I suppose from the exception I have some permission error with ceph fs but I'm not sure.
Hope you can help me finding the right direction to fix this:)
Thanks in advance,
