On Mon, Sep 12, 2011 at 01:02:26AM -0700, Adam Williamson wrote: > On Mon, 2011-09-12 at 08:56 +0100, Richard W.M. Jones wrote: > > > I thought AutoQA was going to do this, but it's been disappointing. > > AutoQA is under active development, still. It's a complex project. I hope I can make a suggestion: Can we have it so that packagers can commit a file into Fedora git (eg. "autoqa.sh"), and have that picked up by AutoQA and run whenever a new package appears in Rawhide. It could just return exit status zero / non-zero, or if someone is feeling ambitious: http://en.wikipedia.org/wiki/Test_Anything_Protocol > Especially being able to automate this kind of high level functionality > testing is tricky: remember, to properly test OpenSSH, we'd need to set > up two separate installations with current packages and then connect one > to the other, all without any kind of human interaction and with 100% > reliability - any breakdown in the *testing mechanism* which is > misrepresented as a failure in the *thing being tested* tends to make > people scream bloody murder. Rome wasn't built in a day, etc etc. I think you are overthinking this. Look at how libguestfs builds, boots up and tests a Rawhide distro, *inside Koji!* (there's no root, no network, ...) Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones libguestfs lets you edit virtual machines. Supports shell scripting, bindings from many languages. http://libguestfs.org -- devel mailing list devel@xxxxxxxxxxxxxxxxxxxxxxx https://admin.fedoraproject.org/mailman/listinfo/devel
