On Thu, 2020-04-16 at 12:24 -0400, pmkellly@xxxxxxxxxxxx wrote: > > On 4/16/20 11:21, Adam Williamson wrote: > > > > > If we're gonna write test cases like that, we should probably just have > > an alternative template, or an alternative "mode" for the template we > > have. I don't like using a template which clearly expects the "Here are > > the steps, and here are the expected results" format but actually uses > > "Step 1, step 1 expected result, step 2, step 2 expected result..." > > format. Writing templates isn't that hard, so I feel like that would be > > nicer :) > > > > We certainly have test cases where the results are open to > interprettation and so the test case results could be centralized and > allow for that interpretation. > > We also have test cases where there are specific steps with specific > actions that are required to produce specific results. An example is the > Services Manipulation test case. In a tests like this, it has always > served me well, to have the Expected Results for each step of the test > case at the end of each test case step. This eliminates confusion over > what the results for a step must be and so increases the accuracy of the > test case results. In a test case like this, I don't think we want > people interpreting the results. > > Two templates might be the right thing to do. One for exact tests and > one for tests where interpretation is or is likely to be involved. It's not about interpretation or not, it's just about a preference for this: Test Steps ---------- 1. Step 1 2. Step 2 3. Step 3 Expected Results ---------------- 1. Expected result 1 2. Expected result 2 3. Expected result 3 versus this: Test Steps and Expected Results ------------------------------- 1. Step 1 2. Expected result 1 3. Step 2 4. Expected result 2 5. Step 3 6. Expected result 3 Our current template really only handles the first style, if you want to do the second style you have to do some kind of 'hack' like kparal did. I'm just saying if the second style is clearly better for some test, we should probably add an alternative template or tweak the existing template to have a 'mode' which works better for that style. -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net _______________________________________________ test mailing list -- test@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to test-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@xxxxxxxxxxxxxxxxxxxxxxx
