So if you're monitoring the SSDs (SMART) religiously and take measure to avoid clustered failures (for example by replacing SSDs early or adding new nodes gradually, like 1 every 6 months or so) you probably are OK. Keep in mind however that the larger this cluster grows, the more likely a double failure scenario becomes. Statistics and Murphy are out to get you. With normal disks I would use a Ceph replication of 3 or when using RAID6 nothing larger than 12 disks per set. > > I think in case of disk failure, pgs should replicate fast with 10gbits > links. > That very much also depends on your cluster load and replication settings. Regards, Christian > > So the question is: > > 2x or 3x ? > > > Regards, > > Alexandre -- Christian Balzer Network/Systems Engineer chibi at gol.com Global OnLine Japan/Fusion Communications http://www.gol.com/