Tweaks to printing test cases and matrix

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hey folks! Just wanted to send a heads-up about some tweaks I made to
the printing test cases and desktop matrix.

At the blocker review meeting, we reviewed
https://bugzilla.redhat.com/show_bug.cgi?id=2050615 - a bug printing to
PDF via cups-pdf that was found by openQA. We noted that this test is
not exactly in line with the requirements of either the Beta or Final
criteria; it turns out we don't really want to block on cups-pdf,
specifically, not working, what we block on is the native print-to-PDF
offered by GNOME and KDE (which is different).

However, it is useful for openQA to test this way as it's closer to the
flow of printing to a real printer than the native print-to-PDF
features are, so openQA may indeed catch a blocker bug with this test
that it wouldn't catch by testing native print-to-PDF, if that bug were
not specific to cups-pdf but rather in a different part of the flow
which would also affect a hardware printer.

So we decided to have openQA keep the cups-pdf test but *also* test the
native print-to-PDF functions in KDE/GNOME (thanks to Lukas for
implementing that). To match this in the wiki, I created a new "native
print to PDF" test case:

https://fedoraproject.org/wiki/QA:Testcase_Printing_PDF

and added it to the matrix template:

https://fedoraproject.org/wiki/Template:Desktop_test_matrix

I marked that test and the existing "real printer" test as Beta/Final,
since the criteria are actually split across Beta and Final. I moved
the existing "virtual printer" test to Optional, since the criteria
don't exactly require a "virtual printer" (which is something like
cups-pdf) to work.

Going forward, openQA will file results for the "virtual printer" and
Printing_PDF tests. The "real printer" test will still require a human
to do it.

This all seemed kinda 'obvious' in light of the meeting discussion, so
I figured it didn't need a draft and review, but I wanted to mention it
at least! If anyone sees any problems with it, please yell and we can
fix it. Thanks!
-- 
Adam Williamson
Fedora QA
IRC: adamw | Twitter: adamw_ha
https://www.happyassassin.net

_______________________________________________
test mailing list -- test@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to test-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/test@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure




[Index of Archives]     [Fedora Desktop]     [Fedora SELinux]     [Photo Sharing]     [Yosemite Forum]     [KDE Users]

  Powered by Linux