I want to discuss the QA:Testcase Memtest86 [1] from our F14 installation matrix. The test case is a little weird to me and took me quite some time to understand what to test and when to report outcome. > How to test: > 1. Boot the installer using any available means We don't want to boot the installer (anaconda), just show the main boot menu (grub). > 2. At the bootloader prompt, select the option labeled Memory Test > 3. Make some changes to the configurations and other settings > Expected Results: > 1. Memory test works successfully Meaning the program works or there are not RAM failures? The latter is hardware issue. Let's rephrase that. > 2. Test report is shown once a test is completed. The test is never completed, it runs infinitely over and over again. It takes quite some time too. Also, no report is ever shown, just statistics are continuously updated in the lower part of the screen. Very confusing. > 3. The configurations are able to be set and changed. Yep, but according to what you set, you may wait ages until some test passes at least once. I think this test case is needlessly overcomplicated. We just need to test that Memory Test available on installation media "just works", right? So what about something like: How to test: 1. Insert installation media and display its boot prompt 2. Select option Memory Test 3. Have the test running for a few moments Expected results: 1. Memory test runs a tests your memory, it seems to work correctly. 2. You can use configuration to change test settings, e.g. select just one single test out of the test set to be tested. Sounds better? [1] https://fedoraproject.org/wiki/QA:Testcase_Memtest86 -- test mailing list test@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test