Hi Kamil, On Wed, 2010-08-11 at 06:27 -0400, Kamil Paral wrote: > I want to discuss the QA:Testcase Memtest86 [1] from our F14 installation > matrix. > > The test case is a little weird to me and took me quite some time to > understand what to test and when to report outcome. > > > How to test: > > 1. Boot the installer using any available means > > We don't want to boot the installer (anaconda), just show the main > boot menu (grub). Ah, right. > > 2. At the bootloader prompt, select the option labeled Memory Test > > 3. Make some changes to the configurations and other settings > > > Expected Results: > > 1. Memory test works successfully > > Meaning the program works or there are not RAM failures? The latter is > hardware issue. Let's rephrase that. > > > 2. Test report is shown once a test is completed. > > The test is never completed, it runs infinitely over and over again. > It takes quite some time too. > Also, no report is ever shown, just statistics are continuously updated > in the lower part of the screen. > Very confusing. If a test cycle is completed(From test#1 to test#8, About 5 mins for 512M memory), A test result will be shown at the bottom: ************ Pass Complete, no errors, press ESC to exit ************ I haven't met the failure status, but a relative result is supposed to be provided after one cycle is finished as well. > > > 3. The configurations are able to be set and changed. > > Yep, but according to what you set, you may wait ages until some > test passes at least once. This is meant to test the configurations and make sure they are functional. > > I think this test case is needlessly overcomplicated. We just need > to test that Memory Test available on installation media "just works", > right? So what about something like: > > How to test: > 1. Insert installation media and display its boot prompt > 2. Select option Memory Test > 3. Have the test running for a few moments 'A few moments' should be more accurate, at least test#1 - test#8 is finished. > > Expected results: > 1. Memory test runs a tests your memory, it seems to work correctly. > 2. You can use configuration to change test settings, e.g. select just > one single test out of the test set to be tested. > > > Sounds better? Also add this one to verify the test result: 3. Test Report(Or test result) is shown once a test cycle(test#1-test#8) is done. Thanks, Hurry -- Contacts Hurry FAS Name: Rhe Timezone: UTC+8 TEL: 86-010-62608141 IRC nick: rhe #fedora-qa #fedora-zh -- test mailing list test@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test