Comment 1 Tao Zhang 2011-08-24 19:58:51 EDT

Created attachment 202109 [details]
Error file

The 3.4.2 tests are running fine in the same imac machine, but 3.7 is not, I need someone tell me why 3.7 is not working and the 3.7 readme file looks same as 3.4.2
but saying last updated in March 2011, but by following the steps, it is not working.

Comment 2 Stephan Herrmann 2011-08-25 05:09:51 EDT

(In reply to comment #0)
> Build Identifier: 3.7-201106131736
> 
> I downloaded the eclipse-Automated-Tests-3.7.zip,
> eclipse-test-framework-3.7.zip,
> eclipse-SDK-3.7-macosx-cocoa-x86_64.tar.gz and
> eclipse-platform-3.7-macosx-cocoa-x86_64.tar.gz from
> http://download.eclipse.org/eclipse/downloads/drops/R-3.7-201106131736/index.php
> 
> I followed the readme file set up steps, but I got the errors by running the
> tests:
> BUILD FAILED
> /Users/uadmin/eclipse/3.7/eclipse-testing/test.xml:1005: The following error
> occurred while executing this line:
> /Users/uadmin/eclipse/3.7/eclipse-testing/test.xml:804: Problem: failed to
> create task or type antlib:org.jacoco.ant:merge
> Cause: The name is undefined.

The build has been extended to include generating code coverage reports
using JaCoCo. You will have to either disable this task in the ant file
or install JaCoCo from http://www.eclemma.org/jacoco/
See specifically the section on using JaCoCo with ant:
http://www.eclemma.org/jacoco/trunk/doc/ant.html

HTH.

Comment 3 Olivier Thomann 2011-08-25 08:13:38 EDT

This belongs to Platform/Releng.

Comment 4 Tao Zhang 2011-08-25 12:22:01 EDT

(In reply to comment #2)
> (In reply to comment #0)
> > Build Identifier: 3.7-201106131736
> > 
> > I downloaded the eclipse-Automated-Tests-3.7.zip,
> > eclipse-test-framework-3.7.zip,
> > eclipse-SDK-3.7-macosx-cocoa-x86_64.tar.gz and
> > eclipse-platform-3.7-macosx-cocoa-x86_64.tar.gz from
> > http://download.eclipse.org/eclipse/downloads/drops/R-3.7-201106131736/index.php
> > 
> > I followed the readme file set up steps, but I got the errors by running the
> > tests:
> > BUILD FAILED
> > /Users/uadmin/eclipse/3.7/eclipse-testing/test.xml:1005: The following error
> > occurred while executing this line:
> > /Users/uadmin/eclipse/3.7/eclipse-testing/test.xml:804: Problem: failed to
> > create task or type antlib:org.jacoco.ant:merge
> > Cause: The name is undefined.
> 
> The build has been extended to include generating code coverage reports
> using JaCoCo. You will have to either disable this task in the ant file
> or install JaCoCo from http://www.eclemma.org/jacoco/
> See specifically the section on using JaCoCo with ant:
> http://www.eclemma.org/jacoco/trunk/doc/ant.html
> 
> HTH.

Thanks for this information, I remove the JaCoCo part, this error is gone, 
but I still have the errors which cannot find find *tests_*, so the build is successful, but nothing is running.
Seems to me, the running script should find these files and copy over to there and run the tests, but it fails.

Need someone give me the information where are these files, and should be in the all the jar files? I did extract couple of jar files, but cannot found the text.xml for each package.
genResults:
     [xslt] Transforming into /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/html
BUILD SUCCESSFUL

BUILD SUCCESSFUL
Total time: 26 seconds

[copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.text.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ant.tests.core.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.compare.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.core.tests.runtime.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.core.tests.resources.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.osgi.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.core.expressions.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.update.tests.core.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.team.tests.core.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.core.tests.performance.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.core.tests.builder.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.core.tests.compiler.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.tests.performance.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.editors.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.tests.navigator.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.workbench.texteditor.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.tests.rcp.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.tests.views.properties.tabbed.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.debug.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.ui.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.ui.tests.refactoring.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ltk.ui.refactoring.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ltk.core.refactoring.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.text.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jface.text.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jface.tests.databinding.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.core.filebuffers.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ant.tests.ui.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.core.tests.net.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.build.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ua.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.tests.forms.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.equinox.security.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.search.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ds.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.jdt.core.tests.model.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ua.tests.doc.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.debug.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.ui.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.releng.tests.xml to copy.
     [move] Warning: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/chkpii does not exist.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.swt.tests.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.team.tests.cvs.core.xml to copy.
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.equinox.ds.tests.xml to copy.

Comment 5 Tao Zhang 2011-08-25 12:23:42 EDT

Created attachment 202165 [details]
Cannot find these tests.xml files

Please let me know where are these files, seems to me, in order to run the tests,
these tests.xml files should be in place.

Comment 6 Tao Zhang 2011-08-25 12:25:35 EDT

Comment on attachment 202165 [details]
Cannot find these tests.xml files

The readme file within the eclipse-Automated-Tests-3.7.zip should be updated too.

Comment 7 Kim Moir 2011-08-26 14:53:52 EDT

Can you paste the line you used to invoke runtests 

For instance
./runtests -properties vm.properties -os macosx -ws cocoa -arch x86 -vm path_to_vm 

Also, to make it easier it would be good to just try running one suite to try to troubleshoot the problem.  For example
./runtests -properties vm.properties -os linux -ws gtk -arch x86 -vm /runtests -properties vm.properties -os macosx -ws cocoa -arch x86 -vm path_to_vm pdeui

Also, as a side note, you don't need to modify the test.xml to point to the VMs, this should be included in your vm.properties file

Comment 8 Tao Zhang 2011-08-29 11:43:58 EDT

(In reply to comment #7)
> Can you paste the line you used to invoke runtests 
> 
> For instance
> ./runtests -properties vm.properties -os macosx -ws cocoa -arch x86 -vm
> path_to_vm 
> 
> Also, to make it easier it would be good to just try running one suite to try
> to troubleshoot the problem.  For example
> ./runtests -properties vm.properties -os linux -ws gtk -arch x86 -vm /runtests
> -properties vm.properties -os macosx -ws cocoa -arch x86 -vm path_to_vm pdeui
> 
> Also, as a side note, you don't need to modify the test.xml to point to the
> VMs, this should be included in your vm.properties file

I used the following to execute the tests:

./runtests -properties ./test.properties -os macosx -ws carbon -arch ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui

Still failed

If I don't modified the test.xml, I got the following errors:
sh runtests -properties ./test.properties -os macosx -ws carbon -arch ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
caution: filename not matched:  */plugins/org.eclipse.test*
Buildfile: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml

pdeui:

junit:

setRuntimeArchive:
     [echo] setRuntimeArchive os macosx ws carbon arch ppc
     [echo] runtimeArchive eclipse-SDK-I20110613-1736-macosx-carbon.tar.gz !!! 

init:
    [mkdir] Created dir: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/xml
    [mkdir] Created dir: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/html
    [mkdir] Created dir: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/macosx.carbon.ppc
     [exec] chflags: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test-eclipse: No such file or directory
     [exec] Result: 1

setup:
     [echo] trying to find org.eclipse.pde.ui.tests_*

BUILD FAILED
/Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml:654: The following error occurred while executing this line:
/Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml:421: The following error occurred while executing this line:
/Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml:438: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test-eclipse/eclipse/plugins does not exist.

Total time: 1 second
An error has occurred. See the log file
/Users/anjanaprabhakar/eclipse3.7/eclipse-testing/workspace/.metadata/.log.

Comment 9 Tao Zhang 2011-08-29 11:45:41 EDT

(In reply to comment #8)
> (In reply to comment #7)
> > Can you paste the line you used to invoke runtests 
> > 
> > For instance
> > ./runtests -properties vm.properties -os macosx -ws cocoa -arch x86 -vm
> > path_to_vm 
> > 
> > Also, to make it easier it would be good to just try running one suite to try
> > to troubleshoot the problem.  For example
> > ./runtests -properties vm.properties -os linux -ws gtk -arch x86 -vm /runtests
> > -properties vm.properties -os macosx -ws cocoa -arch x86 -vm path_to_vm pdeui
> > 
> > Also, as a side note, you don't need to modify the test.xml to point to the
> > VMs, this should be included in your vm.properties file
> 
> I used the following to execute the tests:
> 
> ./runtests -properties ./test.properties -os macosx -ws carbon -arch ppc
> -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
> 
> Still failed
> 
> If I don't modified the test.xml, I got the following errors:
> sh runtests -properties ./test.properties -os macosx -ws carbon -arch ppc
> -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
> caution: filename not matched:  */plugins/org.eclipse.test*
> Buildfile: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml
> 
> pdeui:
> 
> junit:
> 
> setRuntimeArchive:
>      [echo] setRuntimeArchive os macosx ws carbon arch ppc
>      [echo] runtimeArchive eclipse-SDK-I20110613-1736-macosx-carbon.tar.gz !!! 
> 
> init:
>     [mkdir] Created dir:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/xml
>     [mkdir] Created dir:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/html
>     [mkdir] Created dir:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/macosx.carbon.ppc
>      [exec] chflags:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test-eclipse: No such file or
> directory
>      [exec] Result: 1
> 
> setup:
>      [echo] trying to find org.eclipse.pde.ui.tests_*
> 
> BUILD FAILED
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml:654: The following
> error occurred while executing this line:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml:421: The following
> error occurred while executing this line:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml:438:
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test-eclipse/eclipse/plugins
> does not exist.
> 
> Total time: 1 second
> An error has occurred. See the log file
> /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/workspace/.metadata/.log.

Please see attached test.xml and test.properties files which originally included in the bundle(no any modification at all)

Comment 10 Tao Zhang 2011-08-29 11:48:11 EDT

Created attachment 202341 [details]
test.properties

Comment 11 Tao Zhang 2011-08-29 11:49:24 EDT

Created attachment 202342 [details]
test.xml

test.xml has been modified to remove the jacoco

Comment 12 Tao Zhang 2011-08-30 16:08:38 EDT

(In reply to comment #7)
> Can you paste the line you used to invoke runtests 
> 
> For instance
> ./runtests -properties vm.properties -os macosx -ws cocoa -arch x86 -vm
> path_to_vm 
> 
> Also, to make it easier it would be good to just try running one suite to try
> to troubleshoot the problem.  For example
> ./runtests -properties vm.properties -os linux -ws gtk -arch x86 -vm /runtests
> -properties vm.properties -os macosx -ws cocoa -arch x86 -vm path_to_vm pdeui
> 
> Also, as a side note, you don't need to modify the test.xml to point to the
> VMs, this should be included in your vm.properties file

Hi, 

Any update?
The problem is the file cannot be found, "Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy."
Even the build is fine, but nothing is running.

please output see below:

sh runtests -properties ./test.properties -os macosx -ws carbon -arch ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
Buildfile: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml

pdeui:

junit:

setRuntimeArchive:
     [echo] setRuntimeArchive os macosx ws carbon arch ppc
     [echo] runtimeArchive eclipse-SDK-I20110613-1736-macosx-carbon.tar.gz !!! 

init:

setup:
     [echo] trying to find org.eclipse.pde.ui.tests_*
     [echo] trying to find 

runSuite:

genResults:
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy.
     [xslt] Transforming into /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/html
BUILD SUCCESSFUL

BUILD SUCCESSFUL
Total time: 1 second

Comment 13 Tao Zhang 2011-08-31 20:53:04 EDT

(In reply to comment #7)
> Can you paste the line you used to invoke runtests 
> 
> For instance
> ./runtests -properties vm.properties -os macosx -ws cocoa -arch x86 -vm
> path_to_vm 
> 
> Also, to make it easier it would be good to just try running one suite to try
> to troubleshoot the problem.  For example
> ./runtests -properties vm.properties -os linux -ws gtk -arch x86 -vm /runtests
> -properties vm.properties -os macosx -ws cocoa -arch x86 -vm path_to_vm pdeui
> 
> Also, as a side note, you don't need to modify the test.xml to point to the
> VMs, this should be included in your vm.properties file

Can you let me know how I can make this running?
I need to run this tests, currently it is a blocker to my other work.
Thanks for any information to make it runs.

Comment 14 Kim Moir 2011-09-01 11:20:17 EDT

What does your label.properties look like?

I updated mine to look like this and it worked fine.

luiimac:eclipse-testing ibmemployee$ cat label.properties

                        timestamp=201106131736
                        buildType=R
                        buildId=3.7
                        buildLabel=3.7


When we promote a build to a release, we just rename a build to a new name.  Some of the properties for running tests still reflect the old build name.  I can update the documentation to reflect this.  

Sorry I didn't see that issue before, I actually ran the tests with a newer 3.7.x build which had not been renamed to a release build and therefore didn't have this issue.

Comment 15 Tao Zhang 2011-09-01 12:46:58 EDT

(In reply to comment #14)
> What does your label.properties look like?
> 
> I updated mine to look like this and it worked fine.
> 
> luiimac:eclipse-testing ibmemployee$ cat label.properties
> 
>                         timestamp=201106131736
>                         buildType=R
>                         buildId=3.7
>                         buildLabel=3.7
> 
> 
> When we promote a build to a release, we just rename a build to a new name. 
> Some of the properties for running tests still reflect the old build name.  I
> can update the documentation to reflect this.  
> 
> Sorry I didn't see that issue before, I actually ran the tests with a newer
> 3.7.x build which had not been renamed to a release build and therefore didn't
> have this issue.

Thanks for the info. but it is still not working for me, please take a look this output which run after I modified label.properties file as yours, I guess it is lookinf or a file /eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy, but cannot find this file, so nothing is running, and I search this file, it is not there:

sc22bk08:eclipse-testing anjanaprabhakar$ cat label.properties

                        timestamp=201106131736
                        buildType=I
                        buildId=I20110613-1736
                        buildLabel=I20110613-1736
                
sc22bk08:eclipse-testing anjanaprabhakar$ vi label.txt 
sc22bk08:eclipse-testing anjanaprabhakar$ cat label.properties
> 
>                         timestamp=201106131736
>                         buildType=R
>                         buildId=3.7
>                         buildLabel=3.7
sc22bk08:eclipse-testing anjanaprabhakar$ sh runtests -properties ./test.properties -os macosx -ws carbon -arch ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
Buildfile: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml

pdeui:

junit:

setRuntimeArchive:
     [echo] setRuntimeArchive os macosx ws carbon arch ppc
     [echo] runtimeArchive eclipse-SDK-3.7-macosx-carbon.tar.gz !!! 

init:

setup:
     [echo] trying to find org.eclipse.pde.ui.tests_*
     [echo] trying to find 

runSuite:

genResults:
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy.
     [xslt] Transforming into /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/html
BUILD SUCCESSFUL

BUILD SUCCESSFUL
Total time: 1 second
sc22bk08:eclipse-testing anjanaprabhakar$ ls results/xml
sc22bk08:eclipse-testing anjanaprabhakar$

Comment 16 Tao Zhang 2011-09-01 12:48:53 EDT

After I modified the label.properties file as Kim Moir's information, I still got the file cannot find error, so no tests are running.

Comment 17 Tao Zhang 2011-09-01 13:12:13 EDT

Can someone tell me exact steps to run the tests?
For example:
Step 1:
   go to http://download.eclipse.org/eclipse/downloads/drops/R-3.7-201106131736/index.php

Step 2: download
        1)eclipse-SDK-3.7-macosx-cocoa-x86_64.tar.gz
        2)eclipse-test-framework-3.7.zip
        3)eclipse-Automated-Tests-3.7.zip
        4) what else? 
            eclipse-3.7-delta-pack.zip?
            eclipse-platform-3.7-macosx-cocoa-x86_64.tar.gz?

Step 3:
       unzip eclipse-Automated-Tests-3.7.zip
Step 4: 
       copy all gz and zip files under eclipse-testing
Step 5:
       sh runtests -properties ./test.properties -os macosx -ws carbon -arch ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui

Step 6: 
       Does that work for you?
       1)Modify the test.xml to remove jacoco coverage section?
       2)Modify the label.properties?
       3)Where the file eclipse-junit-tests-I20110613-1736.zip should be?
       after you unzip eclipse-Automated-Test-3.7.zip, above file is under eclipse-testing, but the readme file does not say anything about the location of this file, if you run the tests, the error will say: cannot find JUNIT.XSL in eclipse/dropins/plugins
       4)anything else missing here? 
       after you solve all these problems, you still get "Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy." 
       this is warning, but no tests are running.

I need to run the tests to make sure the new release not break the IDE3.7, 3.4 is too old, but I cannot make 3.7 running, I need steps to make these tests running.

Thanks for any inputs and tips

Comment 18 Kim Moir 2011-09-02 11:10:40 EDT

When you run the tests you should 

1)Modify the test.xml to remove jacoco coverage section? << Yes
2)Modify the label.properties? << Yes
3)Where the file eclipse-junit-tests-I20110613-1736.zip should be? << it will get unzipped automatically when you run the scripts, don't unzip it manually
       after you unzip eclipse-Automated-Test-3.7.zip, above file is under
eclipse-testing, but the readme file does not say anything about the location
of this file, if you run the tests, the error will say: cannot find JUNIT.XSL
in eclipse/dropins/plugins
4)anything else missing here? 

You're running the tests like this

sh runtests -properties ./test.properties -os macosx -ws carbon -arch
ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui

It should be 
./runtests -properties ./test.properties -os macosx -ws cocoa -arch
x86_64 -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui

You seem to be downloading eclipse-SDK-3.7-macosx-cocoa-x86_64.tar.gz but your previous comment indicates you're running the tests with -os macosx -ws carbon -arch ppc  which is a mismatch.

Comment 19 Tao Zhang 2011-09-02 13:48:12 EDT

(In reply to comment #18)
> When you run the tests you should 
> 
> 1)Modify the test.xml to remove jacoco coverage section? << Yes
> 2)Modify the label.properties? << Yes
> 3)Where the file eclipse-junit-tests-I20110613-1736.zip should be? << it will
> get unzipped automatically when you run the scripts, don't unzip it manually
>        after you unzip eclipse-Automated-Test-3.7.zip, above file is under
> eclipse-testing, but the readme file does not say anything about the location
> of this file, if you run the tests, the error will say: cannot find JUNIT.XSL
> in eclipse/dropins/plugins
> 4)anything else missing here? 
> 
> You're running the tests like this
> 
> sh runtests -properties ./test.properties -os macosx -ws carbon -arch
> ppc -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
> 
> It should be 
> ./runtests -properties ./test.properties -os macosx -ws cocoa -arch
> x86_64 -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
> 
> You seem to be downloading eclipse-SDK-3.7-macosx-cocoa-x86_64.tar.gz but your
> previous comment indicates you're running the tests with -os macosx -ws carbon
> -arch ppc  which is a mismatch.

Thanks for the info, I tried your above command, I got errors as below:
sc22bk08:eclipse-testing anjanaprabhakar$ sh runtests -properties ./test.properties -os macosx -ws cocoa -arch x86_64 -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
runtests: line 69: [: missing `]'
The os, ws and arch values are either invalid or are an invalid combination

I looked at the runtests, it does not have x86_64 for the arch for macosx, only x86, not sure I should update the runtests as well?
the bundle is x86_64, but runtests does not have x86_64 arch, only x86
let me know if that is a problem.

So I did modify the command which is x86(not x86_64), still cannot find the file, please see below:

sc22bk08:eclipse-testing anjanaprabhakar$ sh runtests -properties ./test.properties -os macosx -ws cocoa -arch x86 -noclean -vm /Users/anjanaprabhakar/jdk7/b204/bin/java  pdeui
Buildfile: /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/test.xml

pdeui:

junit:

setRuntimeArchive:
     [echo] setRuntimeArchive os macosx ws cocoa arch x86
     [echo] runtimeArchive eclipse-SDK-3.7-macosx-cocoa.tar.gz !!! 

init:

setup:
     [echo] trying to find org.eclipse.pde.ui.tests_*
     [echo] trying to find 

runSuite:

genResults:
     [copy] Warning: Could not find file /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/eclipse/org.eclipse.pde.ui.tests.xml to copy.
     [xslt] Transforming into /Users/anjanaprabhakar/eclipse3.7/eclipse-testing/results/html
BUILD SUCCESSFUL

BUILD SUCCESSFUL
Total time: 1 second
sc22bk08:eclipse-testing anjanaprabhakar$

Comment 20 Tao Zhang 2011-09-02 13:49:15 EDT

Please let me know the runtests also need to be updated as well?
my bundle is x86_64 for macosx, but the runtests did not have x86_64 arch.

Comment 21 Kim Moir 2011-09-02 15:54:22 EDT

What architecture is your machine?  Most macs these days are either x86 or  x86_64, and run cocoa.

Comment 22 Tao Zhang 2011-09-02 16:43:39 EDT

(In reply to comment #21)
> What architecture is your machine?  Most macs these days are either x86 or 
> x86_64, and run cocoa.

This is iMac (new arrived, a couple months ago), it is Mac OS X Darwin Kernel version is 10.7.0
processor 3.2 GHz Intel Core i3
It is 64 bits, we run 64 bit java on it.
So should be x86_64

Comment 23 Kim Moir 2011-09-06 11:22:34 EDT

Created attachment 202813 [details]
updated runtests.sh

Comment 24 Tao Zhang 2011-09-06 12:57:36 EDT

Created attachment 202828 [details]
cannot find the file after update runtests

Please see attached output file which has the updated runtests.sh and run errors.

Comment 25 Tao Zhang 2011-09-06 13:00:10 EDT

(In reply to comment #23)
> Created attachment 202813 [details]
> updated runtests.sh

Can you give me the one 3.7.x bundle which is working for you if possible?
The updated runtests.sh is not working, I also did added x86_64 in the script, it does not matter, still saying cannot find the file which tests.xml? or some files needed to run the tests.

Comment 26 Tao Zhang 2011-09-12 13:27:50 EDT

(In reply to comment #23)
> Created attachment 202813 [details]
> updated runtests.sh

Do you have any more information on that?
The updated runtests.sh is not working, still has the same problem, cannot find the files to run the tests.
Suggest you check the the bundle to see any missing files in the 3.7 bundles.

Comment 27 Tao Zhang 2011-10-05 17:09:08 EDT

Kim, any update? can you also check the bundles size? on the download sit, it says 133MB for the test bundle, what the size should be?

Comment 28 Taras Ledkov 2012-02-07 04:25:31 EST

I followed the readme file set up steps and fully read this bug description. 
I got the same errors.
I try 3.7 release (see #1) and 3.7.1 (http://download.eclipse.org/eclipse/downloads/drops/R-3.7.1-201109091335/index.php). There are no difference 
in the output errors:

init:
     [exec] chflags: /Users/tledkov/eclipse/test-3.7.1/eclipse-testing/test-eclipse: No such file or directory
     [exec] Result: 1

setup:
     [echo] trying to find org.eclipse.pde.ui.tests_*

BUILD FAILED
/Users/tledkov/eclipse/test-3.7.1/eclipse-testing/test.xml:654: The following error occurred while executing this line:
/Users/tledkov/eclipse/test-3.7.1/eclipse-testing/test.xml:421: The following error occurred while executing this line:
/Users/tledkov/eclipse/test-3.7.1/eclipse-testing/test.xml:438: /Users/tledkov/eclipse/test-3.7.1/eclipse-testing/test-eclipse/eclipse/plugins does not exist.

Test launch command line is:
$THIS_PATH/runtests \
    -properties $THIS_PATH/test.properties \
    -os macosx \
    -ws cocoa \
    -arch x86_64 \
    -noclean \
    -vm $JDK/bin/java \
    performance pdeui

Modified text.xml from attach is not used. I use 'performance' target instead it because property 'codecoverage' is set up when there is not target 'performance' - see test.xml:31 (do i understand correct?).

I doesn't understand why script search anything in 'eclipse-testing/test-eclipse/eclipse' when eclipse is extracted to 'eclipse-testing/eclipse'.

Comment 29 Paul Webster 2012-03-12 07:56:17 EDT

(In reply to comment #28)
> 
> I doesn't understand why script search anything in
> 'eclipse-testing/test-eclipse/eclipse' when eclipse is extracted to
> 'eclipse-testing/eclipse'.

IIRC eclipse-testing/eclipse is running the ant file and eclipse-testing/test-eclipse/eclipse will be running the test (it will have the test plugins installed into it, and is deleted and re-installed for every set of tests).

Is eclipse-testing/test-eclipse/eclipse not being extracted?  It's extraction is controlled by the test.xml and the "setup" and "install" targets.

PW

Comment 30 John Arthorne 2012-03-12 09:56:33 EDT

If it's any help, here is the console output from our current Hudson job that runs our Mac tests:

https://hudson.eclipse.org/hudson/job/eclipse-JUnit-mac2/lastBuild/console

Comment 31 Kim Moir 2012-03-13 10:42:41 EDT

Okay, this is what I did last night to run the tests
mkdir on mac kimtest
cd kimtest
copy eclipse-Automated-Tests-3.7.2.zip to kimtest
unzip eclipse-Automated-Tests-3.7.2.zip
cd eclipse-testing

mv eclipse-junit-tests-M20120208-0800.zip eclipse-junit-tests-3.7.2.zip

copy the following zips to eclipse-testing

eclipse-3.7.2-delta-pack.zip                            
eclipse-SDK-3.7.2-macosx-cocoa-x86_64.tar.gz            
eclipse-platform-3.7.1-macosx-cocoa-x86_64.tar.gz

update label.properties to reflect the following values
luiimac:eclipse-testing ibmemployee$ cat label.properties

                        timestamp=201202080800
                        buildType=R
                        buildId=3.7.2
                        buildLabel=3.7.2


luiimac:eclipse-testing ibmemployee$ cat equinoxp2tests.properties
#Properties required by equinox p2 tests
#Wed, 08 Feb 2012 12:18:19 -0500

org.eclipse.equinox.p2.reconciler.tests.platform.archive.macosx=/Users/ibmemployee/buildtest/kimtest/eclipse-testing/eclipse-platform-3.7.2-macosx-cocoa-x86_64.tar.gz
org.eclipse.equinox.p2.reconciler.tests.lastrelease.platform.archive.macosx=/Users/ibmemployee/buildtest/kimtest/eclipse-testing/eclipse-platform-3.7.1-macosx-cocoa-x86_64.tar.gz
org.eclipse.equinox.p2.tests.current.build.repo=http\://download.eclipse.org/eclipse/updates/3.7/R-3.7.2-201202080800
org.eclipse.equinox.p2.tests.last.release.build.repo=http\://download.eclipse.org/eclipse/updates/3.7/R-3.7-201106131736

./runtests -os macosx -ws cocoa -arch x86_64 

Wheeee!  Tests are running :-)

The root issue is that we promote the M20120208-0800 build to Release 3.7.2.  Some of the files in the enclosed zips aren't updated when we release so they need to reflect the release versions of the zip.  Also, we only run tests on x86, not x86_64 so the equinoxp2tests.properties file doesn't reflect the correct platform.

Comment 32 Ludmila Shikhvarg 2012-03-14 20:54:36 EDT

Hi Kim,

I used your recomendations, but test failed to start:
ls: eclipse/plugins/org.eclipse.equinox.launcher_*.jar : No such file or directory
Error: Unable to access jarfile workspace.

BTW, I didn't find org.eclipse.equinox.launcher_*.jar in the ws.

Comment 33 Kim Moir 2012-03-14 22:09:11 EDT

What does the workspace look like?

what's in  eclipse/plugins/ - anything?

Comment 34 Taras Ledkov 2012-03-15 05:54:30 EDT

Hi Kim,

I used your recomendations and i have remarks:
1. All bundles were downloaded from: http://download.eclipse.org/eclipse/downloads/drops/R-3.7.2-201202080800/index.php, excluding clipse-platform-3.7.1-macosx-cocoa-x86_64.tar.gz;

2. There is a problem with 'runtests' shell script:

$ ./runtests -os macosx -ws cocoa -arch x86_64
./runtests: line 69: [: missing `]'
The os, ws and arch values are either invalid or are an invalid combination
$

But after fixing script at line: 'if [ "$os-$ws-$arch" = "bla-bla-bla..."' Tests are running.

3. Also i update 'equinoxp2tests.properties' with my local path.

PS. Mega-thanks for your great suggestion!

Comment 35 Kim Moir 2012-03-15 08:41:01 EDT

Yes, I had to update the runtests script with the other arch.  Sorry I forgot to mention that.  I ran the tests at night and wrote on the bug in the morning, never a good combination :-)

Comment 36 Taras Ledkov 2012-03-19 09:02:08 EDT

Please take a look at the bug #374645 (if you have an opportunity).

I have many failures of the automated tests. May be my tests environment does not set up correctly?
I post my tests results in the bug #374645. I need any help or suggestions to discover reasons of this failures.

Comment 37 Kim Moir 2012-03-23 15:16:57 EDT

To resolve this bug the documentation for running tests needs to be changed to state how to run the tests against a release build (update properties etc).

Comment 38 David Williams 2012-06-20 22:06:00 EDT

This had target set to 3.7.2, so assume still not done. Sounds like the needed action is to update some instructions on how to run the tests ... and I've seen another bug about that ... but, for now, will simply "untarget"

Comment 39 Alexander Kurtakov 2017-07-04 14:10:48 EDT

Closing. Please open a new one if you still has the issue with latest versions and detail the issues you see.