On 06/08/2010 10:51 PM, Luke Macken wrote: > I recently wrote some code to generate detailed statistics of Fedora& EPEL updates within bodhi. Eventually this will be auto-generated and exposed within bodhi itself, but for now here are the initial metrics. > > This report definitely conveys the shortcomings in our testing, however, it does show us improving with each release. For Fedora 13, we implemented the No Frozen Rawhide process with improved Critical Path policies, which were definitely a success. With these enhanced procedures, along with the upcoming implementation of AutoQA and the new Package update acceptance criteria (https://fedoraproject.org/wiki/Package_update_acceptance_criteria), I think we'll see these numbers drastically improve in the future. > I can't agree that this update policy is success (in any dictionary). Since I'm forced to wait two weeks for pushing into stable, I have more tickets about packages that I've already fixed. Users want fixes immediately, they are not interested in some processes. Many users don't even have FAS account and they want fixes and updates now. Not in next release as offer enterprise solution. Other thing is that I'm forgetting packages in bodhi, because I believed until yesterday that updates will be pushed after two weeks automatically. Not sure whether policy changed or it's a bug [1]. Karma in bodhi updates doesn't speak about quality of updates at all. At least my packages which has more dependencies are pushed without testing, and less important are "tested" even testers don't know what does it do [2]. For example here were testers happy because it was updated without any warning message, but they don't know if it's working or not. I'm looking forward to qa project that could really improve quality - like testing updates, which fixed bugs with bugzilla and testers really reproduce them before and not after. Otherwise is bodhi good only for checking update by yum without errors. Best regards, Marcela [1] https://admin.fedoraproject.org/updates/perl-LDAP-0.40-1.fc13 [2] https://admin.fedoraproject.org/updates/perl-version-0.82-1.fc13 -- devel mailing list devel@xxxxxxxxxxxxxxxxxxxxxxx https://admin.fedoraproject.org/mailman/listinfo/devel
