Re: Ceph & Hbase

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Dec 29, 2015 at 10:42 PM, Jose M <soloninguno@xxxxxxxxxxx> wrote:
> Hi,
>
>
> Sorry to reask, but I'm not reaching any further. I think i'm missing some
> really obvious permission configuration, as I was testing the hadoop command
> and it only works with one user (the one I use to install ceph).
>
>
> This works
>
> ubuntu@cephmaster:~/ceph-cluster$ hadoop fs -put ceph.conf /
>
>
> This work (file has 'ubuntu' as owner')
>
> ubuntu@cephmaster:~/ceph-cluster$ hadoop fs -ls /
> Found 1 items
> -rw-r--r--   3 ubuntu        262 2015-12-29 11:35 /ceph.conf
>
> This doesn't work (using user 'ceph' to list files)
>
> ubuntu@cephmaster:~/ceph-cluster$ sudo -u ceph hadoop fs -ls /
>
> ls: Permission denied

can 'user ceph'  access the ceph keyring file?

Yan, Zheng

>
>
> I think Hbase fails to start cause it's using it's own user and it seems
> only user "ubuntu" is allow to use ceph. Is there any easy way to fix this?
> Maybe disabling security? Sorry if the question looks silly, I'm really new
> to ceph and don't know exactly where to search about this.
>
>
> Thanks in advance,
>
>
>
> ________________________________
> De: Jose M <soloninguno@xxxxxxxxxxx>
> Enviado: lunes, 28 de diciembre de 2015 09:45 a.m.
> Para: ceph-users@xxxxxxxxxxxxxx
> Asunto: Ceph & Hbase
>
> Hi!
>
>
> Does anyone succesfully configure hbase to use ceph? I'm having some
> problems with it, maybe anyone can help.
>
>
> I have ceph already running and ceph-hadoop bindings installed ('hadoop fs
> -ls /' working). I'm trying Hbase in pseudo distributed mode, but when
> starting hbase-master I'm getting this error
>
>
> 2015-12-27 16:41:53,962 INFO  [main] mob.MobFileCache: MobFileCache is
> initialized, and the cache size is 1000
> 2015-12-27 16:41:54,484 ERROR [main] master.HMasterCommandLine: Master
> exiting
> java.lang.RuntimeException: Failed construction of Master: class
> org.apache.hadoop.hbase.master.HMaster
>         at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2046)
>         at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:198)
>         at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
>         at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2060)
> Caused by: java.io.IOException: Permission denied
>         at com.ceph.fs.CephMount.native_ceph_mount(Native Method)
>         at com.ceph.fs.CephMount.mount(CephMount.java:154)
>         at
> org.apache.hadoop.fs.ceph.CephTalker.initialize(CephTalker.java:141)
>         at
> org.apache.hadoop.fs.ceph.CephFileSystem.initialize(CephFileSystem.java:98)
>         at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2643)
>         at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:93)
>         at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2680)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2662)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:379)
>         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
>         at
> org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:1005)
>         at
> org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:532)
>         at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:347)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2041)
>
>
> This is my core-site.xml
>
>
> <configuration>
> <property>
>          <name>fs.defaultFS</name>
>          <value>ceph://cephmaster:6789/</value>
> </property>
> <property>
>         <name>ceph.conf.file</name>
>          <value>/etc/ceph/ceph.conf</value>
> </property>
> <property>
>          <name>ceph.auth.id</name>
>          <value>admin</value>
> </property>
> <property>
>     <name>ceph.auth.keyring</name>
>     <value>/home/developer/ceph-cluster/ceph.client.admin.keyring</value>
> </property>
> <property>
>          <name>fs.ceph.impl</name>
>          <value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
> </property>
> <property>
>          <name>fs.AbstractFileSystem.ceph.impl</name>
>          <value>org.apache.hadoop.fs.ceph.CephHadoop2FileSystem</value>
> </property>
> <property>
>         <name>ceph.data.pools</name>
>         <value>hadoop1</value>
> </property>
> <property>
>         <name>ceph.mon.address</name>
>         <value>cephmaster:6789</value>
> </property>
> <property>
>         <name>ceph.object.size</name>
>          <value>67108864</value>
> </property>
> </configuration>
>
>
> This is my hbase-site.xml
>
>
> <configuration>
> <property>
>   <name>hbase.cluster.distributed</name>
>   <value>true</value>
> </property>
> <property>
>   <name>hbase.rootdir</name>
>   <value>ceph://cephmaster:6789/hbase</value>
> </property>
>   <property>
>     <name>hbase.zookeeper.quorum</name>
>     <value>cephmaster</value>
>   </property>
> </configuration>
>
>
> I already tried adding here fs.defaultFS, ceph.conf.file, ceph.auth.id,
> ceph.auth.keyfile, fs.ceph.impl and fs.AbstractFileSystem.ceph.impl in
> hbase-site.xml just in case (although i think they aren't needed here) but I
> got the same exception.
>
>
> I suppose from the exception I have some permission error with ceph fs but
> I'm not sure.
>
> Hope you can help me finding the right direction to fix this:)
>
>
> Thanks in advance,
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux