On 2013-07-05 10:03, Kevin Fenzi wrote:
Greetings.
I'd like to propose some changes to the spins process for F20.
I'm sending this just to the spins and test lists first, to try and
hash
out things, then we can move on to running it the devel list once we
have more concrete plans.
http://fedoraproject.org/wiki/Releases/20/Spins shall be the cannonical
list of approved spins by the sig.
A Milestone is one of Alpha, Beta, Final.
A basic spin test will be created (Or perhaps we can re-use the Basic
desktop test, or whatever QA folks would prefer). This basic spin test
will test:
At Alpha:
* The image composes.
* The image boots with any method
* The liveuser user can login
* The user can apply updates
At Beta:
* All Alpha tests, and
* The image meets it's size goal
* The image boots with all supported live media boot methods.
At Final:
* All Beta test and
* No selinux denials on boot/login
We already have test cases for all of these. No need for new ones.
At the Alpha milestone, all approved spins will be created by rel-eng.
Each approved spin MUST have at least 2 people fill in the Basic spin
test matrix for at least 1 TC or RC. If the image fails, maintainers
can try again at the next milestone, but the image is NOT shipped for
that milestone. if an image doesn't get 2 people filling in Basic spin
tests, the image is dropped for that cycle and IS NOT SHIPPED FOR THAT
RELEASE! Such images can be reapproved by the spins sig for the next
cycle.
I think this is going way too far.
Specifically: I think *one* test for each spin is more realistic. I
don't think we need to block spins for being oversize, or for SELinux
denials. They're spins. I don't think we can overreach on quality
requirements.
- Is 2 people too many? Should it just be 1? or More?
See above.
- Are there other Basic tests we should require?
No. That's actually all we require from the *release blocking* live
images at Alpha.
- Is there a better way to track things than that wiki page?
Not at present, no. WikiTCMS isn't so bad once you get used to it.
--
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora
http://www.happyassassin.net
--
test mailing list
test@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test
