#151: Tests consistent with Criterion
--------------------------+---------------------------
Reporter: rhe | Owner: pschindl
Type: enhancement | Status: new
Priority: major | Milestone: Fedora 17
Component: Wiki | Version:
Resolution: | Keywords: retrospective
Blocked By: | Blocking:
--------------------------+---------------------------
Comment (by pschindl):
I don't think we can complete this any time. Criteria are changing quite
quickly. Changes I did before Fedora 17 pre-release testing:
I added new test case for uncovered criterion:
"All services in a default install must start properly" ->
https://fedoraproject.org/wiki/QA:Testcase_Services_start (there is a
problem with this, which we should discuss:
http://lists.fedoraproject.org/pipermail/test/2012-February/105685.html)
I removed
http://lists.fedoraproject.org/pipermail/test/2012-February/105685.html
test case from installation matrix.
I changed release level of
https://fedoraproject.org/wiki/QA:Testcase_Kickstart_Http_Server_Ks_Cfg
and https://fedoraproject.org/wiki/QA:Testcase_Mediakit_ISO_Size to beta
I changed release level of
https://fedoraproject.org/wiki/QA:Testcase_Anaconda_traceback_debug_mode
to non-blocking, because debug mode is not supposed to be used by users.
I changed release level of
https://fedoraproject.org/wiki/QA:Testcase_Anaconda_User_Interface_serial_console
to Beta and level of
https://fedoraproject.org/wiki/QA:Testcase_Anaconda_User_Interface_Cmdline
to Final.
I added new alpha criterion: "A correct checksum must be published for
each official release image." and final criterion "If there is embedded
checksum on ISO media, it must be correct." and I set release level of
https://fedoraproject.org/wiki/QA:Testcase_Mediakit_ISO_Checksums to Alpha
/ Final
I added new alpha criteria:
* "The installer must be able to download and use an [[Anaconda/Updates|
installer update image]] from an HTTP server"
I added new beta criteria:
* "The installer must be able to use an [[Anaconda/Updates|installer
update image]] retrieved from removable media, remote installation source
and HTTP url" - this one was lately moved to the final"
* "The installer must be able to complete an installation using the serial
console interface"
I added new final criteria:
* "All release media must include a standalone memory test utility. A boot
menu option to launch this utility must be present and must work
correctly."
* "The installer must be able to complete an installation using all
supported interfaces"
I changed criterion "The installer must be able to report failures to
Bugzilla, with appropriate information included" to
"The installer must be able to report failures to Bugzilla and local disk,
with appropriate information included" and I changed release level of
https://fedoraproject.org/wiki/QA:Testcase_Anaconda_save_traceback_to_remote_system
to non-blocking
All those changes were made after discussion on test mailing list.
--
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/151#comment:22>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance
--
test mailing list
test@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test
