Went over this with a few clusters built last year, it seems best practices ( at least in the white papers I have read ) only use jbod configuration( and so have we for all clusters ). I agree regarding the writeback cache issues and not using it but that's more due to how we use hardware ( definitely test it with your configuration or have your reseller show you why they recommend it ). Jbod is more intensive to manage when a drive fails... so there is that. Regards, -Brent Existing Clusters: Test: Nautilus 14.2.1 with 3 osd servers, 1 mon/man, 1 gateway ( all virtual on SSD ) US Production(HDD): Nautilus 14.2.1 with 11 osd servers, 3 mons, 4 gateways behind haproxy LB UK Production(HDD): Luminous 12.2.11 with 25 osd servers, 3 mons/man, 3 gateways behind haproxy LB US Production(SSD): Luminous 12.2.11 with 6 osd servers, 3 mons/man, 3 gateways behind haproxy LB -----Original Message----- From: ceph-users <ceph-users-bounces@xxxxxxxxxxxxxx> On Behalf Of Stolte, Felix Sent: Tuesday, July 16, 2019 11:42 AM To: ceph-users <ceph-users@xxxxxxxxxxxxxx> Subject: New best practices for osds??? Hi guys, our ceph cluster is performing way less than it could, based on the disks we are using. We could narrow it down to the storage controller (LSI SAS3008 HBA) in combination with an SAS expander. Yesterday we had a meeting with our hardware reseller and sale representatives of the hardware manufacturer to resolve the issue. They told us, that "best practices" for ceph would be to deploy disks as Raid 0 consisting of one disk using a raid controller with a big writeback cache. Since this "best practice" is new to me, I would like to hear your opinion on this topic. Regards Felix ---------------------------------------------------------------------------- --------- ---------------------------------------------------------------------------- --------- Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender), Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ---------------------------------------------------------------------------- --------- ---------------------------------------------------------------------------- --------- _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |