Test cases and criteria proposition

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi all,

I have some things to propose. We have some missing test cases and criteria. I'd like to know your opinion on this, so please, let me know if you have some notes.

I propose these changes in test cases:
* https://fedoraproject.org/wiki/QA:Testcase_Mediakit_ISO_Size is marked as alpha release level. I propose to change it to beta. We have beta criterion "The network installation image, DVD image, and live images for release-blocking desktops must meet current size requirements" for this. 
* https://fedoraproject.org/wiki/QA:Testcase_Kickstart_Http_Server_Ks_Cfg is associated with alpha release. I propose to change it to beta level, where is criterion: The installer must be able to use all kickstart delivery methods.

I propose these new criteria:
* Final criterion: "There must be published correct checksum for each ISO media. Also if there is embedded checksum on ISO media, it must be correct." - I think we should check this. We have already test case. I propose to change release level for this test case to final.
* Final criterion: "The installer must be able to run memory test." - again, we have test case for this yet. I'd move it to final level.
* Beta criterion: "The installer must be able to install system with minimal usable set of packages." - there is test case associated with alpha, I'd change it to beta release level
* Alpha criterion: "The installer must be able to download and apply updates.img file using a HTTP url and use it" - we have test cases for this, but no criterion. I think it's pretty importing -> alpha
* Beta criterion: "The installer must be able to use updates.img obtained by any supported way" - I think, that this should be at criteria too
* Final criterion: "The installer must be able to handle the failure and report the issue. The installer must be also able to access debug mode." - we have test case for this. It's useful to have this feature.

I propose to remove https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_efidisk.img test case as we don't need it anymore.

I propose to enhance alpha criterion "The installer must be able to report failures to Bugzilla, with appropriate information included" to "The installer must be able to report failures to Bugzilla, remote system and local disk, with appopriate information included" - especially saving failures to disk is important for installation without net access

And finaly, I propose these two test cases, both I'd like to have in final release level:
* https://fedoraproject.org/wiki/User:Pschindl/Draft_QA_Testcase_Install_without_selinux - this test case is related to final criterion - "The installed system must run normally if the user chooses to install without SELinux" - I have one note on this. There is used noselinux option, but it doesn't work now. I filled bug https://bugzilla.redhat.com/show_bug.cgi?id=784828 there is another option with the same effect - selinux=0 and this one works fine, but Anaconda have noselinux in documentation, so it should work and they're working on it.
* https://fedoraproject.org/wiki/User:Pschindl/Draft_QA_Testcase_Services_start - this one is related to final criterion "All services in a default install must start properly"

Regard
Petr Schindler
-- 
test mailing list
test@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test



[Index of Archives]     [Fedora Desktop]     [Fedora SELinux]     [Photo Sharing]     [Yosemite Forum]     [KDE Users]

  Powered by Linux