On Tue, 2005-04-05 at 10:55 -0400, Andrew Overholt wrote: > Hi, > > I was talking with Billy last night about Eclipse unit tests and I ran the > UI ones this morning. There are 806 tests and we get 152 Errors and 40 > Failures. 144 of the 152 Errors are from > org.eclipse.ui.tests.dnd.DragTestSuite in which Billy said to expect errors > (since this is 3.1M5a I'm testing). > > I'd like to set things up to run these automatically (Aaron is looking into > it) and get some hard data that we can work with. I've been working on running them with a headless eclipse as outlined here, http://download.eclipse.org/eclipse/downloads/drops/S-3.1M5a-200502191500/automatedtesting.html and using 3.0 have been able to run them however using 3.1 M5 I've been unable to successfully run them due to a number of issues. First the instructions on the page appear to be incomplete, first the runtests script requires a directory test-eclipse/eclipse which is not created by the script, as well the line unzip -qq -o -C eclipse-junit-tests-*.zip */plugins/org.eclipse.test* does not fully expand the tests. To run them successfully on 3.0.1 I run unzip eclipse-SDK-*.zip unzip eclipse-junit-*.zip mkdir test-eclipse cp -r eclipse test-eclipse/ ./runtests -os linux -ws gtk -arch x86 -vm /usr/lib/jvm/java-1.4.2- ibm-1.4.2.1//jre/bin/java -noclean which works, however of M5 using the identical steps (with zips changed to tar.gz) I get Buildfile: test.xml all: jdttext: runtests: setup: junit: init: BUILD FAILED /notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse- testing/test.xml:299: The following error occurred while executing this line: /notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse- testing/test.xml:155: The following error occurred while executing this line: /notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse- testing/test.xml:84: The following error occurred while executing this line: /notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse- testing/test.xml:65: The following error occurred while executing this line: /notnfs/eclipse-tests/nightlies/eclipse-tests-devel/eclipse- testing/test- eclipse/eclipse/plugins/org.eclipse.jdt.text.tests_3.1.0/test.xml:17: org.eclipse.ant.core.AntSecurityException Total time: 1 second Aaron
