On 02/06/2012 01:41 PM, Andrew Holway wrote: > Hi, > > Can anyone tell me about their experiences with 1PB and larger gluster > installations. We are thinking of doing 1PB with 10x 100PB storage > servers and would appreciate some reassurance :). We plan to scale > to....above and beyond.... Greetings Andrew: We've got a bit of experience in scaling to (many large) bricks for gluster. The big issues are reliable/working network connections, RAIDs, etc. Currently you should look carefully at some sort of replication mechanism (if you are storing 1PB of data, recovery time is likely important). 100TB bricks aren't a problem (as long as they are built sanely), though I'd probably suggest subdividing smaller so you can take better advantage of finer grain parallelism. The issue on design of the bricks goes to the bandwidth and the height of the storage bandwidth wall (time required to read/write the entire 100TB). For most designs we see (cascading arrays with SAS/FC), this is going to be problematic at best. But thats another story (and we are biased because of what we do). -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics Inc. email: landman at scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615
