Re: Hadoop on ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



2012/3/16 Noah Watkins <jayhawk@xxxxxxxxxxx>:
>
> On Mar 16, 2012, at 8:37 AM, Sage Weil wrote:
>
>> Hi Andrey,
>>
>> On Fri, 16 Mar 2012, Andrey Stepachev wrote:
>>
>> possible).  I take it TestDSFIO is a standard hadoop benchmark?
>
> Yes, this is. There are a number of benchmarks that ship with Hadoop. Although this is untested, one reason you might be seeing throughput issues is with the standard read/write interface that copies bytes across the JNI interface. On the short list of stuff for the next Java wrapper set is to use the ByteBuffer interface (NIO) to avoid this copying.

I'm not sure, that problem on java side. All disks loaded at 100%, so
I think, that problem clearly on osd part. But i want to test your new
integration and see, if something changes. You maybe right, but I'm not.

>
> - Noah



-- 
Andrey.
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux