Hi Harald, 1. shoud i use a raid controller a create for example a raid 5 with all disks on each osd server? or should i passtrough all disks to ceph osd? If your OSD servers only contain flash drives, I'd suggest you go with a cheap HBA and configure it in JBOD mode (pass-though) If your OSD servers have HDDs, buy a good RAID Controller with a battery-backed write cache and configure it using multiple RAID-0 volumes (1 physical disk per volume). That way, reads and write will be accelerated by the cache on the HBA. 2. if i have a 2 pyhsicaly node osd cluster, did i need 3 physicall mons? Go with a minimum of 3 OSD servers (you'll end-up with 2 in case one dies) and 3 MONs 3. if i have a 3 physically node osd cluster, did i need 5 physicall mons? No. 3 MON are enough 3. where i should in install the mgr? on osd or mon MON 4. where i should in install the rgw? on osd or mon OR on 1 or 2 separate machines? Here is my suggestion: buy 3 standalone KVM servers and install your MONs, RGW and whatever load-balancing servers (i.e. HAProxy) as guests on these KVM servers. Make sure the guests are properly balanced against you 3 KVM servers so in case one dies, it does not affect the service. ________________________________ From: harald.freidhof@xxxxxxxxx <harald.freidhof@xxxxxxxxx> Sent: Monday, April 20, 2020 3:07 PM To: ceph-users@xxxxxxx <ceph-users@xxxxxxx> Subject: some ceph general questions about the design Hello together, we want to create a productive ceph storage system in our datacenter in may this year with openstack and ucs and i tested a lot in my cep test enviroment, and i have some general questions. whats receommended? 1. shoud i use a raid controller a create for example a raid 5 with all disks on each osd server? or should i passtrough all disks to ceph osd? 2. if i have a 2 pyhsicaly node osd cluster, did i need 3 physicall mons? 3. if i have a 3 physically node osd cluster, did i need 5 physicall mons? 3. where i should in install the mgr? on osd or mon 4. where i should in install the rgw? on osd or mon OR on 1 or 2 separate machines? in my testlab i created 3 VMs osds with mgr installed, and 5 VMs mons , and 1 VM as rgw -> is this correct? thx in advance hfreidhof _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |