Re: Ceph & Hbase

[Jose M <soloninguno@xxxxxxxxxxx>]

Hi,

Sorry to reask, but I'm not reaching any further. I think i'm missing some really obvious permission configuration, as I was testing the hadoop command and it only works with one user (the one I use to install ceph).

This works

ubuntu@cephmaster:~/ceph-cluster$ hadoop fs -put ceph.conf /

This work (file has 'ubuntu' as owner')

ubuntu@cephmaster:~/ceph-cluster$ hadoop fs -ls /
Found 1 items
-rw-r--r--   3 ubuntu        262 2015-12-29 11:35 /ceph.conf

This doesn't work (using user 'ceph' to list files)

ubuntu@cephmaster:~/ceph-cluster$ sudo -u ceph hadoop fs -ls /

ls: Permission denied

I think Hbase fails to start cause it's using it's own user and it seems only user "ubuntu" is allow to use ceph. Is there any easy way to fix this? Maybe disabling security? Sorry if the question looks silly, I'm really new to ceph and don't know exactly where to search about this.

Thanks in advance,

---

De: Jose M <soloninguno@xxxxxxxxxxx>
Enviado: lunes, 28 de diciembre de 2015 09:45 a.m.
Para: ceph-users@xxxxxxxxxxxxxx
Asunto: Ceph & Hbase

 

Hi!

Does anyone succesfully configure hbase to use ceph? I'm having some problems with it, maybe anyone can help.

I have ceph already running and ceph-hadoop bindings installed ('hadoop fs -ls /' working). I'm trying Hbase in pseudo distributed mode, but when starting hbase-master I'm getting this error

2015-12-27 16:41:53,962 INFO  [main] mob.MobFileCache: MobFileCache is initialized, and the cache size is 1000
2015-12-27 16:41:54,484 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster
        at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2046)
        at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:198)
        at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
        at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2060)
Caused by: java.io.IOException: Permission denied
        at com.ceph.fs.CephMount.native_ceph_mount(Native Method)
        at com.ceph.fs.CephMount.mount(CephMount.java:154)
        at org.apache.hadoop.fs.ceph.CephTalker.initialize(CephTalker.java:141)
        at org.apache.hadoop.fs.ceph.CephFileSystem.initialize(CephFileSystem.java:98)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2643)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:93)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2680)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2662)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:379)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
        at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:1005)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:532)
        at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:347)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2041)

This is my core-site.xml

<configuration>
<property>
         <name>fs.defaultFS</name>
         <value>ceph://cephmaster:6789/</value>
</property>
<property>
        <name>ceph.conf.file</name>
         <value>/etc/ceph/ceph.conf</value>
</property>
<property>
         <name>ceph.auth.id</name>
         <value>admin</value>
</property>
<property>
    <name>ceph.auth.keyring</name>
    <value>/home/developer/ceph-cluster/ceph.client.admin.keyring</value>
</property>
<property>
         <name>fs.ceph.impl</name>
         <value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
</property>
<property>
         <name>fs.AbstractFileSystem.ceph.impl</name>
         <value>org.apache.hadoop.fs.ceph.CephHadoop2FileSystem</value>
</property>
<property>
        <name>ceph.data.pools</name>
        <value>hadoop1</value>
</property>
<property>
        <name>ceph.mon.address</name>
        <value>cephmaster:6789</value>
</property>
<property>
        <name>ceph.object.size</name>
         <value>67108864</value>
</property>
</configuration>

This is my hbase-site.xml

<configuration>
<property>
  <name>hbase.cluster.distributed</name>
  <value>true</value>
</property>
<property>
  <name>hbase.rootdir</name>
  <value>ceph://cephmaster:6789/hbase</value>
</property>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>cephmaster</value>
  </property>
</configuration>

I already tried adding here fs.defaultFS, ceph.conf.file, ceph.auth.id, ceph.auth.keyfile, fs.ceph.impl and fs.AbstractFileSystem.ceph.impl in hbase-site.xml just in case (although i think they aren't needed here) but I got the same exception.

I suppose from the exception I have some permission error with ceph fs but I'm not sure.

Hope you can help me finding the right direction to fix this:)

Thanks in advance,

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com