Re: ceph & hbase:

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



this is probably something i introduced in my private version ... when i merged the 1.0 branch with the hadoop-topo branch.  Let me fix this and try again.


On Wed, Jul 17, 2013 at 5:35 PM, ker can <kercan74@xxxxxxxxx> wrote:
Some more from lastIOE.printStackTrace():

Caused by: java.io.IOException: java.io.IOException: createNonRecursive unsupported for this filesystem class org.apache.hadoop.fs.ceph.CephFileSystem
        at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.init(SequenceFileLogWriter.java:175)
        at org.apache.hadoop.hbase.regionserver.wal.HLog.createWriter(HLog.java:741)
        ... 17 more
Caused by: java.io.IOException: createNonRecursive unsupported for this filesystem class org.apache.hadoop.fs.ceph.CephFileSystem
        at org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:626)
        at org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:601)
        at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:442)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.init(SequenceFileLogWriter.java:156)
        ... 18 more



On Wed, Jul 17, 2013 at 1:49 PM, Noah Watkins <noah.watkins@xxxxxxxxxxx> wrote:
On Wed, Jul 17, 2013 at 11:07 AM, ker can <kercan74@xxxxxxxxx> wrote:
> Hi,
>
> Has anyone got hbase working on ceph ? I've got ceph (cuttlefish) and
> hbase-0.94.9.
> My setup is erroring out looking for getDefaultReplication &
> getDefaultBlockSize ... but I can see those defined in
> core/org/apache/hadoop/fs/ceph/CephFileSystem.java

It looks like HBase is giving up trying to create a writer... The
lastIOE is probably an exception generated by CephFileSystem. Would it
be possible to add some debug info so we could see where the exception
is coming from? This try block seems to be masking that.

  public Writer createWriter(FileSystem fs, Configuration conf, Path
hlogFile) throws IOException {
    int i = 0;
    IOException lastIOE = null;
    do {
      try {
        return HLog.createWriter(fs, hlogFile, conf);
      } catch (IOException ioe) {
        lastIOE = ioe;
        sleepBeforeRetry("Create Writer", i+1);
      }
    } while (++i <= hdfsClientRetriesNumber);
    throw new IOException("Exception in createWriter", lastIOE);


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux