Re: Ceph on ARM ?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



At least in the past, there have been a couple of things you really want to focus on regarding ARM and performance (beyond the obvious core count/clockspeed/ipc/etc):


1) HW acceleration for things like CRC32, MD5, etc

2) context switching overhead

3) memory throughput

4) SATA controller and PCIe throughput


Unfortunately these are the kinds of things that you can't easily generalize between ARM vs x86.  Some ARM processors are going to do wildly better than others.  The good news is that driving 32 SATA drives shouldn't be particularly CPU intensive (128 modern ARM cores is probably sufficient) so the real question is probably what the SATA controller setup looks like.  I think you're best bet if you are serious about pursuing the ARM route is try to get access to one of the Taishan 5280 servers and do some tests.  You could try renting out an EC2 ARM systems and play around there but I doubt it will be a very apples->apples comparison.


Mark


On 11/24/20 6:12 AM, Adrian Nicolae wrote:
Hi guys,

I was looking at some Huawei ARM-based servers and the datasheets are very interesting. The high CPU core numbers and the SoC architecture should be ideal for a distributed storage like Ceph, at least in theory.

 I'm planning to build a new Ceph cluster in the future and my best case scenario right now is to buy 7 servers with  2 x Intel Silver 12-core or 2 x Gold 20-core CPUs, 32 SATA drives each. And of course - SSDs/NVMEs for wal/db and the metadata pools , 256GB RAM and so on.

 I'm curious however if the ARM servers are better or not for this use case (object-storage only).  For example, instead of using 2xSilver/Gold server, I can use a Taishan 5280 server with 2x Kungpen 920 ARM CPUs with up to 128 cores in total .  So I can have twice as many CPU cores (or even more) per server comparing with x86.  Probably the price is lower for the ARM servers as well.

    Has anyone tested Ceph in such scenario ?  Is the Ceph software really optimised for the ARM architecture ?  What do you think about this ?

  Thanks !
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux