Re: HBase/HDFS on Ceph/CephFS

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



> local filesystem is a bit tricky,  we just tried a POC that mounting
> CephFS
> into every hadoop ,  configure Hadoop using LocalFS with Replica = 1.
> Which
> end up with each data only write once into cephfs and cephfs take care of
> the data durability.

Can you tell a bit more about this?

well yes I loose data-locality - but HBase is not that well in maintaining
that anyway - When starting up it does not distribute shards to the HDFS
nodes that has data but pulls randomly. It gets locality either by "major
compact" or waiting for compaction to re-write everything again.  I may get
equally good data locality with Ceph-based SSD as with local HDDs (which I
currently have)

Jesper
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux