Re: measuring success [was Re: Bodhi 0.7.5 release]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



If there are any discrepancy with the proventesters critpath policy then please feel free to file a ticket with FESCo and allow our elected officials decide the fate of this.

-AdamM (From Android)

On Jul 2, 2010 8:16 PM, "Kevin Kofler" <kevin.kofler@xxxxxxxxx> wrote:

Will Woods wrote:
> The main reasons we want to perform testing are things like: to avoid
> pushing ...

The right way to prevent that is to get AutoQA completed, which will, if it
works as intended, automatically detect and throw out updates with broken
dependencies without needlessly delaying all those updates which don't have
broken dependencies. Once AutoQA is completed, the testing process will do
NOTHING whatsoever to prevent broken dependencies because they wouldn't make
it through AutoQA anyway.


> or updates that cause serious regressions requiring manual intervention /
> emergency update repl...

No amount of testing is going to catch all such cases, and when it does
happen, the testing requirements actually HINDER a quick fix, increasing the
window of exposure to the bug and therefore making it affect many more users
and for longer time.


> In fact, Kevin, given a set of metrics we're both happy with, I'd be
> willing to stake my subscr...

No. Metrics just encourage working to the metric to game the system, and any
improvement you measure from the new process might just be due to chance or
to factors we aren't considering at all. Plus, do we even have the
historical data to compare with, given that everything older than F12 is
deleted from Bodhi?

       Kevin Kofler


--
devel mailing list
devel@xxxxxxxxxxxxxxxxxxxxxxx
https://admin.fedoraproject.org/mailman/listin...

-- 
devel mailing list
devel@xxxxxxxxxxxxxxxxxxxxxxx
https://admin.fedoraproject.org/mailman/listinfo/devel

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Fedora Announce]     [Fedora Kernel]     [Fedora Testing]     [Fedora Formulas]     [Fedora PHP Devel]     [Kernel Development]     [Fedora Legacy]     [Fedora Maintainers]     [Fedora Desktop]     [PAM]     [Red Hat Development]     [Gimp]     [Yosemite News]
  Powered by Linux