Hello, Kev!
AFAIK, it's definitely better to have 50 nodes with 1 OSD than 5 nodes with 10 OSDs each. In the first case your OSD will not compete for resources (CPU, memory, network and controller bandwidth etc) with another OSDs. You will need to sacrifice to ceph only a little part of your compute node resources. At the same time you'll have better failure resolution: in case of any of your node failure it will be necessary to recover data from the only one drive (in opposite to 10 drives in the second case). And so on.
Best regards,
Vladimir
2017-05-22 21:36 GMT+05:00 kevin parrikar <kevin.parker092@xxxxxxxxx>:
KevRegards,can someone please clarify about the performance difference between these two.I asked some of the guys who have worked on ceph in large scale before, but they all say i should run more OSD process per node to get performance over 1 OSD per node but they are not able to justify it.Will there be performance impact running 1 OSD process each on 50 servers vs 10 OSD process each on 5 servers?Question:hello All,I have 50 compute nodes in my environment which are running virtual machines.I can add one more 10k RPM SAS disk and 1X10G interface to each server and thus there will be 50 OSD running on 50 compute nodes. Its not easy to obtain more servers for running Ceph nor taking away servers from existing pool.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph. com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
