Re: Verification testings and processes.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, 2017-05-22 at 17:17 -0700, Ryan wrote:
> Hello everyone,

Hi Ryan!

> I gave a shot at running a verification test. I was looking at
> Fedora_26_Branched_20170513.n.0 installation Should I be testing the
> milestones labeled as Final in the nightly builds?

Yes, absolutely! If a test is labeled as Final, that means that a
failure of the test likely blocks the Final release. But that doesn't
mean we should only run the Alpha tests on Alpha candidates and only
the Alpha+Beta tests on Beta candidates; we should run as many of the
tests as possible on all candidates, because it's much better to find
and fix *all* the important bugs early. If we can find a Final blocker
now and fix it, that's so much the better than waiting till after Beta
comes out :)

> I hope I did this the right way. Here is what I did.
> Went to Fedora_26_Branched_20170513.n.0 installation, Image sanity,
> and chose the repoclosure test case. Followed the procedures and got
> the results below:
> Added myrepo repo from /media
> Reading in repository metadata - please wait....
> Checking Dependencies
> Repos looked at: 1
>    myrepo
> Num Packages in Repos: 2836
> package: python-smbios-2.3.0-4.fc26.x86_64 from myrepo
>   unresolved deps: 
>      python-ctypes
> Which shows one unresolved dependency. If I am correct this would
> qualify as a automatic blocker for the final release and I should
> submit a bug report and update the test results page to show failed?

That sounds exactly right, yep! Thanks very much for running this. A
similar check is actually run on each compose automatically by releng,
and that confirms your test:

https://kojipkgs.fedoraproject.org/compose/branched/Fedora-26-20170523.n.0/logs/x86_64/repoclosure-Server.x86_64.log

I keep meaning to set up a little thing to take the releng test result
and report it to the wiki, but haven't got around to it yet.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net
_______________________________________________
test mailing list -- test@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to test-leave@xxxxxxxxxxxxxxxxxxxxxxx




[Index of Archives]     [Fedora Desktop]     [Fedora SELinux]     [Photo Sharing]     [Yosemite Forum]     [KDE Users]

  Powered by Linux