On Thu, 2013-12-19 at 08:43 -0500, Kamil Paral wrote: > > > I wrote > > > https://fedoraproject.org/wiki/QA:Testcase_anaconda_lvmthinp_rootfs , > > > and I propose we add it to the installation validation matrix for F21 > > > > I am concerned by this sentence: > > "Proceed with installation, leaving all other settings at default where > > possible, using sensible values for anything you must select or fill in " > > > > When I do these kind of test cases (file systems), I usually choose minimal > > install, because it's fastest and the installed package set doesn't really > > matter. The installer needs not to crash and the system needs to boot, > > that's it. I also combine it with other appropriate test cases, like nfs > > repo and vnc or similar. > > > > If we include requirements like this, we will have a bit higher certainty > > that everything worked correctly and no other choices interfered, but we > > will be much less productive. And anaconda test cases drain 90% of our time > > already. > > > > I think that as long as we execute these test cases manually, combining > > multiple test cases in a single pass (or picking non-default but fastest > > methods l > > (Damn Ctrl+Enter) > > I think that as long as we execute these test cases manually, combining multiple test cases in a single pass (or picking non-default but fastest methods like minimal install) is a necessary evil. Once we do it via automation, we can of course try to keep all different variables separated and execute hundreds and hundreds of test runs to cover possible combination. (That will also hit its limit, btw. But adding processing power is easier than adding people.) I didn't really mean to preclude the use of a minimal package set, I'm just trying to exclude the problems we've been having whereby the test cases and criteria are kind of getting 'gamed' with odd choices =) I'll see if I can find a happy medium... -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net -- test mailing list test@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
