Sadly, this is one of those things that people find out after running their first production Ceph cluster. Never run with the defaults. I know it's been recently reduced to 3 and 1 or 1 and 3, I forget, but I would advocate 1 and 1. Even that will cause a tremendous amount of traffic with any reasonable sized cluster. Warren -----Original Message----- From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Jimmy Goffaux Sent: Friday, September 04, 2015 8:52 AM To: Ceph users <ceph-users@xxxxxxxxxxxxxx> Subject: Impact add PG English version : Hello everyone, Recently we have increased the number of PG in a pool. We had a big performance problem because everything had CEPH cluster 0 on IOPS while there are production above. So we did this: ceph tell osd.* injectargs '--osd_max_backfills 1' ceph tell osd.* injectargs '--osd_recovery_max_active 1' This changes the priority actions and we found a functional cluster. Hope it can help you;) French Version : Bonjour à tous, Récemment nous avons augmenté le nombre de PG dans un pool. Nous avons eu un gros problème de performances car tout le cluster CEPH avait 0 en IOPS alors qu'il y a de la production dessus. Nous avons donc fait ceci : ceph tell osd.* injectargs '--osd_max_backfills 1' ceph tell osd.* injectargs '--osd_recovery_max_active 1' Cela change la priorité des actions et nous avons retrouvé un cluster fonctionnelle. J'espère que ça pourra vous aider ;) -- Jimmy Goffaux _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |