Yup, that was me. We have hbase working here. You'll want to disable localized reads, as per bug #5388. That bug will cause your regionservers to crash fairly often when doing compaction. You'll also want to restart each of the regionservers and masters often (We're doing it once a day) to mitigate the effects of bug #5039, being that your data pool is growing much faster than you might expect, and it being much larger than the visible filesize in cephfs. With those workarounds in place we're running a stable install of openTSDB on top of hbase. Mike On 17 July 2013 23:47, Noah Watkins <noah.watkins@xxxxxxxxxxx> wrote: > Yeh, check if the merge removed createNonRecursive. I specifically > remember adding that function for someone on the mailing list that was > trying to get HBase working. > > http://tracker.ceph.com/issues/4555 > > On Wed, Jul 17, 2013 at 3:41 PM, ker can <kercan74@xxxxxxxxx> wrote: >> this is probably something i introduced in my private version ... when i >> merged the 1.0 branch with the hadoop-topo branch. Let me fix this and try >> again. >> >> >> On Wed, Jul 17, 2013 at 5:35 PM, ker can <kercan74@xxxxxxxxx> wrote: >>> >>> Some more from lastIOE.printStackTrace(): >>> >>> Caused by: java.io.IOException: java.io.IOException: createNonRecursive >>> unsupported for this filesystem class >>> org.apache.hadoop.fs.ceph.CephFileSystem >>> at >>> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.init(SequenceFileLogWriter.java:175) >>> at >>> org.apache.hadoop.hbase.regionserver.wal.HLog.createWriter(HLog.java:741) >>> ... 17 more >>> Caused by: java.io.IOException: createNonRecursive unsupported for this >>> filesystem class org.apache.hadoop.fs.ceph.CephFileSystem >>> at >>> org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:626) >>> at >>> org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:601) >>> at >>> org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:442) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:597) >>> at >>> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.init(SequenceFileLogWriter.java:156) >>> ... 18 more >>> >>> >>> >>> On Wed, Jul 17, 2013 at 1:49 PM, Noah Watkins <noah.watkins@xxxxxxxxxxx> >>> wrote: >>>> >>>> On Wed, Jul 17, 2013 at 11:07 AM, ker can <kercan74@xxxxxxxxx> wrote: >>>> > Hi, >>>> > >>>> > Has anyone got hbase working on ceph ? I've got ceph (cuttlefish) and >>>> > hbase-0.94.9. >>>> > My setup is erroring out looking for getDefaultReplication & >>>> > getDefaultBlockSize ... but I can see those defined in >>>> > core/org/apache/hadoop/fs/ceph/CephFileSystem.java >>>> >>>> It looks like HBase is giving up trying to create a writer... The >>>> lastIOE is probably an exception generated by CephFileSystem. Would it >>>> be possible to add some debug info so we could see where the exception >>>> is coming from? This try block seems to be masking that. >>>> >>>> public Writer createWriter(FileSystem fs, Configuration conf, Path >>>> hlogFile) throws IOException { >>>> int i = 0; >>>> IOException lastIOE = null; >>>> do { >>>> try { >>>> return HLog.createWriter(fs, hlogFile, conf); >>>> } catch (IOException ioe) { >>>> lastIOE = ioe; >>>> sleepBeforeRetry("Create Writer", i+1); >>>> } >>>> } while (++i <= hdfsClientRetriesNumber); >>>> throw new IOException("Exception in createWriter", lastIOE); >>> >>> >> > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Mike Bryant | Systems Administrator | Ocado Technology mike.bryant@xxxxxxxxx | 01707 382148 | www.ocadotechnology.com -- Notice: This email is confidential and may contain copyright material of Ocado Limited (the "Company"). Opinions and views expressed in this message may not necessarily reflect the opinions and views of the Company. If you are not the intended recipient, please notify us immediately and delete all copies of this message. Please note that it is your responsibility to scan this message for viruses. Company reg. no. 3875000. Ocado Limited Titan Court 3 Bishops Square Hatfield Business Park Hatfield Herts AL10 9NE _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |