Re: ceph & hbase:

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Yeh, check if the merge removed createNonRecursive. I specifically
remember adding that function for someone on the mailing list that was
trying to get HBase working.

http://tracker.ceph.com/issues/4555

On Wed, Jul 17, 2013 at 3:41 PM, ker can <kercan74@xxxxxxxxx> wrote:
> this is probably something i introduced in my private version ... when i
> merged the 1.0 branch with the hadoop-topo branch.  Let me fix this and try
> again.
>
>
> On Wed, Jul 17, 2013 at 5:35 PM, ker can <kercan74@xxxxxxxxx> wrote:
>>
>> Some more from lastIOE.printStackTrace():
>>
>> Caused by: java.io.IOException: java.io.IOException: createNonRecursive
>> unsupported for this filesystem class
>> org.apache.hadoop.fs.ceph.CephFileSystem
>>         at
>> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.init(SequenceFileLogWriter.java:175)
>>         at
>> org.apache.hadoop.hbase.regionserver.wal.HLog.createWriter(HLog.java:741)
>>         ... 17 more
>> Caused by: java.io.IOException: createNonRecursive unsupported for this
>> filesystem class org.apache.hadoop.fs.ceph.CephFileSystem
>>         at
>> org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:626)
>>         at
>> org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:601)
>>         at
>> org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:442)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at
>> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.init(SequenceFileLogWriter.java:156)
>>         ... 18 more
>>
>>
>>
>> On Wed, Jul 17, 2013 at 1:49 PM, Noah Watkins <noah.watkins@xxxxxxxxxxx>
>> wrote:
>>>
>>> On Wed, Jul 17, 2013 at 11:07 AM, ker can <kercan74@xxxxxxxxx> wrote:
>>> > Hi,
>>> >
>>> > Has anyone got hbase working on ceph ? I've got ceph (cuttlefish) and
>>> > hbase-0.94.9.
>>> > My setup is erroring out looking for getDefaultReplication &
>>> > getDefaultBlockSize ... but I can see those defined in
>>> > core/org/apache/hadoop/fs/ceph/CephFileSystem.java
>>>
>>> It looks like HBase is giving up trying to create a writer... The
>>> lastIOE is probably an exception generated by CephFileSystem. Would it
>>> be possible to add some debug info so we could see where the exception
>>> is coming from? This try block seems to be masking that.
>>>
>>>   public Writer createWriter(FileSystem fs, Configuration conf, Path
>>> hlogFile) throws IOException {
>>>     int i = 0;
>>>     IOException lastIOE = null;
>>>     do {
>>>       try {
>>>         return HLog.createWriter(fs, hlogFile, conf);
>>>       } catch (IOException ioe) {
>>>         lastIOE = ioe;
>>>         sleepBeforeRetry("Create Writer", i+1);
>>>       }
>>>     } while (++i <= hdfsClientRetriesNumber);
>>>     throw new IOException("Exception in createWriter", lastIOE);
>>
>>
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux