Hi Chris, Is the plan to break down the maintenance in a number of smaller tasks to ensure that each component of the upgrade is successful and to ensure any problems are more easy to diagnose and to have overall less downtime? I'd like to see it broken down into a number of smaller steps to ensure less problems at the end and less downtime overall. http://zenit.senecac.on.ca/wiki/index.php/User:Chris_Tyler/Fedora_ARM_Infra_Redesign Also is the above page still the plan for the upgrade? If so can I suggest that hongkong is reduced to raid 1 and the 2x2tb spinning disks on ireland (OS and DB would easily fit on 128Gb SSD) be removed and put into Australia and/or Chile to give more IOPS on their RAID arrays. Regards, Peter On Thu, Dec 8, 2011 at 11:54 PM, Chris Tyler <chris@xxxxxxxxxxx> wrote: > At a Seneca team meeting this afternoon, we planned out the upgrade > process for the ARM build system. > > There will be several pre-upgrade operations tomorrow and Monday, with > downtime scheduled to begin at 9 am EST / 1400 UTC on Tuesday, December > 13. The upgrades should be completed within 48 hours (by 1400 UTC > Thursday, December 15). Builders will be disabled several hours before > the start of scheduled downtime to prevent new builds from starting. > > The upgrades involve: > > - Doubling the number of x86_64 servers, from two to four. > > - Moving /mnt/koji to SSDs (supporting up to 117 KIOPS read and 69 KIOPS > write). > > - Moving the Koji db to a separate server (using the SSDs we migrated to > yesterday). > > - Switching to a 4-drive RAID-0 configuration for builder scratch space > (from a 2-drive JBOD). > > - Physically re-racking and re-cabling the 60-70 machines for better > airflow and access. > > - Adjusting backups, scripts, network configuration, and DNS to support > the new configuration. > > -- > Chris > > _______________________________________________ > arm mailing list > arm@xxxxxxxxxxxxxxxxxxxxxxx > https://admin.fedoraproject.org/mailman/listinfo/arm _______________________________________________ arm mailing list arm@xxxxxxxxxxxxxxxxxxxxxxx https://admin.fedoraproject.org/mailman/listinfo/arm