On Mon, 9 Mar 2020, David Galloway wrote:
> Hey all,
>
> I wanted to get some input on how to divvy up the new baremetal builders
> for our CI (I decided to name them braggi).
>
> Friday, just as a litmus test, I set up 5 with CentOS 7, 5 with CentOS
> 8, and 10 with Bionic.
>
> I'm SUPER happy to report that CentOS 7 and 8 builds (packaging AND
> containers!) went from between 2 - 2.5 hours to UNDER 1 HOUR! Bionic
> builds went from 1.5 - 2.5 hours to 40-50min!
Glorious!!!
> So our current setup is:
> - We have a few mira running ceph-volume tests
> - We have 8 irvingi that each host 2 VMs (the 16 slave-{ubuntu,centos}##
> builders)
> - We have a few VMs I created in RHV to do CentOS 8 builds as a stopgap
> when CentOS 8 came out (there were no cloud images at the time)
> - When none of the aforementioned builders are available, an ephemeral
> Openstack instance is spun up and is usually bit slower and always less
> reliable than the slave-* builders
>
> My proposal is:
> - 3 braggi with CentOS 7 (default, notcmalloc)
> - 6 braggi with CentOS 8 (default, notcmalloc)
> - 10 braggi with Bionic (default, notcmalloc, crimson)
> - 3 braggi with OpenSUSE
There's no notcmalloc flavor on bionic. Otherwise this sounds great to
me!
Thank you!
sage
> As as reminder, the Bionic slaves build packages for Xenial and Bionic
> using pbuilder so we need more of them.
>
> Of course we can always shuffle around a bit whenever we see a
> particular distro waiting on a builder more than others.
>
> Then we can take the irvingi (which would eliminate the slave-*
> builders) and use 4-6 to do smaller less resource-intensive jobs (maybe
> make check, ceph-dev-setup, kernel, nfs-ganesha, etc.)
>
> The other 2-4 irvingi could go to the ceph-ansible and ceph-container
> teams on 2.jenkins.ceph.com.
>
> The ultimate goal is here to rely less (ideally not at all) on OVH to
> provide ephemeral Jenkins slaves so some shuffling around of OSes is
> inevitable to get to that point.
>
> irvingi: https://wiki.sepia.ceph.com/doku.php?id=hardware:irvingi
> braggi: https://wiki.sepia.ceph.com/doku.php?id=hardware:braggi
>
> --
> David Galloway
> Systems Administrator, RDU
> Ceph Engineering
> IRC: dgalloway
> _______________________________________________
> Dev mailing list -- dev@xxxxxxx
> To unsubscribe send an email to dev-leave@xxxxxxx
>
>
_______________________________________________
Dev mailing list -- dev@xxxxxxx
To unsubscribe send an email to dev-leave@xxxxxxx
