Re: Containerized builds

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thursday, August 11, 2022 5:34:40 PM EDT Josh Durgin wrote:
> I think it's a great idea - it's related to ideas in this thread:
> https://lists.ceph.io/hyperkitty/list/dev@xxxxxxx/thread/UD43OL6YBN5A2QHLKRU
> QLYQRXMHM5FKJ/
> 

Indeed, I remember participating a little in that thread. 

> The main idea there is to make it simple to update containers so you can
> run teuthology tests against code you just changed with very little
> overhead (no need to wait for hours for package + container complete
> rebuilds).

Great, I've been thinking about this as well - I've been poking at cpatch 
here-and-there as well and had started working on a python version that I 
believe will be easier to hack on further. I need to polish it up a little and 
share it.

> 
> Zack Cerza has made a lot of progress on the teuthology side of this -
> running the tests locally using an existing container image. The 2nd half,
> of making it easy and fast to update a container image, is still TBD.
> 

That's great!  I only got Teuthology in Sepia access recently and I would  
love to try out this version too. Is there a link to a WIP PR or something 
along that line? I'd be interested in trying it out a bit.


In the short term, I'll try to put together a proof-of-concept PR for some of 
the build container ideas I'm thinking of.  It seems like there's a fair 
amount of interest.

Thanks!


> Josh
> 
> On Thu, Aug 11, 2022 at 12:09 PM Tom R <precision.automobilia@xxxxxxxxx>
> 
> wrote:
> > John
> > 
> > I think your proposal to separate the build process such that the user can
> > select an os flavor of their liking is a fantastic idea.
> > 
> > I'm not familiar with the process to assist but would love to follow if
> > this proposal is accepted.
> > 
> > 
> > 
> > On Thu, Aug 11, 2022, 1:37 PM John Mulligan <phlogistonjohn@xxxxxxxxxxxxx>
> > 
> > wrote:
> >> On the user's list one thread about the packages took a turn into
> >> discussing
> >> building in containers [1].  This is a topic that I have had some idle
> >> conversations about with Adam King and so I figured that I would raise
> >> this to
> >> a wider audience.
> >> 
> >> My thought is to use container images specifically for building ceph -
> >> and not
> >> just it's container images. The builds may continue to produce packages,
> >> but a
> >> container would be used as an abstraction between the actual OS and the
> >> build
> >> process of (do_cmake.sh, etc.).
> >> 
> >> Builder images would be be available for use both by the build system
> >> (jenkins
> >> builders) as well as individual users. One advantage of this is that the
> >> user
> >> can build the packages for distros that don't match the local distro.
> >> I've
> >> also found it advantageous for my own builds to use the container to
> >> limit
> >> memory and CPU for the build.
> >> 
> >> I'm curious if anyone has discussed this before. Does it interest
> >> anyone?  I
> >> am willing to volunteer some time to help as well.
> >> 
> >> Thanks for reading!
> >> 
> >> 
> >> [1] https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/
> >> VR3ZKP4T2PLZ6BJ23GPZAG3KBV6AI3LA/
> >> <https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/VR3ZKP4
> >> T2PLZ6BJ23GPZAG3KBV6AI3LA/>
> >> 
> >> 
> >> _______________________________________________
> >> Dev mailing list -- dev@xxxxxxx
> >> To unsubscribe send an email to dev-leave@xxxxxxx
> > 
> > _______________________________________________
> > Dev mailing list -- dev@xxxxxxx
> > To unsubscribe send an email to dev-leave@xxxxxxx




_______________________________________________
Dev mailing list -- dev@xxxxxxx
To unsubscribe send an email to dev-leave@xxxxxxx



[Index of Archives]     [CEPH Users]     [Ceph Devel]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux