#72: Proposal for reducing test permutations
--------------------------+-------------------------------------------------
Reporter: rhe | Owner: rhe
Type: enhancement | Status: new
Priority: major | Milestone: Fedora 14
Component: Test Review | Version:
Resolution: | Keywords:
--------------------------+-------------------------------------------------
Comment (by jlaska):
Apologies, I missed your latest updates in this ticket.
Replying to [comment:10 rhe]:
> I further updated the
[https://fedoraproject.org/wiki/User:Rhe/Draft2#Test_Matrix matrix], and
I'm not sure if the following tests can be removed or not:
>
> * [https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_efidisk.img
QA:Testcase_Boot_Methods_efidisk.img]
>
> Reason: Not commonly used and require special device to support it.
I'd like to remove this test, but I'm afraid we need to ensure this is
functional since it is included in the Beta release criteria
(https://fedoraproject.org/wiki/Fedora_14_Beta_Release_Criteria). I've
relied on feedback from pjones in previous releases to run this test.
Mainly because running this test is still a mystery to me. I agree the
conditions around this test are not ideal, but I don't have any great
ideas for improving this right now :(
> * [https://fedoraproject.org/wiki/QA/TestCases/PartitioningNoSwap
QA/TestCases/PartitioningNoSwap]
>
> Reason: I don't think No Swap should be separated as a test.
This test still exists to target the dialog warning that swap is
recommended. What do you recommend, should this test be absorbed into
another test?
> * [https://fedoraproject.org/wiki/QA/TestCases/KickstartKsFilePathKsCfg
QA/TestCases/KickstartKsFilePathKsCfg]
>
> Reason: Is it a usual way to load kickstart file? I seldom use this way.
This is how preupgrade and snake delivery kickstarts. They open up the
initrd.img and insert the ks.cfg there. We'll need to continue supporting
this.
> *
[https://fedoraproject.org/wiki/QA:Testcase_Preupgrade_low_/boot_disk_space_to_install
QA:Testcase_Preupgrade_low_/boot_disk_space_to_install]
>
> Reason:
[https://fedoraproject.org/wiki/QA:Testcase_Preupgrade_from_older_release
QA:Testcase_Preupgrade_from_older_release] is already the case of low
/boot disk space. And for upgrading from F13, 500M /boot is enough for
preupgrading.
Good point, this should be less of an issue preupgrading from F13 -> F14.
The remaining preupgrade test is written to mimic a real-world upgrade
scenario, so we should capture any /boot size issues as they surface.
> What do you think? Please feel free to add comments and tell me if there
are other tests in the removing list.
I can't think of any others at this time. Thanks!
--
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/72#comment:11>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance
--
test mailing list
test@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test
