Simultaneous execution of test suites on different platforms

• US 7,287,190 B2
• Filed: 01/29/2004
• Issued: 10/23/2007
• Est. Priority Date: 01/29/2004
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Rosenman, Victor, Kuturianu, Olga
• Primary Examiner(s): Baderman; Scott
• Assistant Examiner(s): LOHN, JOSHUA A
• Application Number:
  US10/767,846
• Publication Number:
  US 20050188262A1
• Time in Patent Office: 1,363 Days
• Field of Search: 714/32
• US Class Current: 714/32
• CPC Class Codes: G06F 11/2294 by remote test

Abstract

In an arrangement for testing multiple low-end computing devices simultaneously, different tests are executed simultaneously on different platforms using a single instance of a test harness to which multiple devices are connected. A platform-specific API is provided for independent components of the tests and platform-specific components are implemented for each test according to the respective platform-specific API. At run-time the test harness deploys each test together with a platform-specific execution agent, configured according to the components of the test. The agents execute the test suites, and return test results to the test harness.

Claims

1. A method for testing computing devices, the method comprising:

providing a plurality of suites of test programs for access by a server, wherein a first suite and a second suite of said plurality of suites are respectively adapted to run on a first platform and a second platform;

storing a first execution agent that is adapted to run on said first platform and a second execution agent that is adapted to run on said second platform for access by said server;

providing a test harness on said server to support execution of said test programs by at least a first computing device and a second computing device, wherein said first and second computing devices are coupled to said server, and wherein said first computing device is adapted to operate using said first platform and said second computing device is adapted to operate using said second platform;

using said test harness, packaging a first test object with said first execution agent for download to said first computing device in a first package and packaging a second test object with said second execution agent for download to said second computing device in a second package;

responsively to an instruction of said test harness, downloading said first package and said second package to said first computing device and said second computing device, respectively; and

concurrently executing a test program of said first package in said first computing device and a test program of said second package in said second computing device.

2. The method according to claim 1, wherein said first suite and said second suite comprise platform-specific JAR files.

3. The method according to claim 1, wherein said first package and said second package comprise JAR files.

4. The method according to claim 1, further comprising:

displaying said suites as a hierarchy of identifiers of test objects corresponding to said test programs; and

responsively to said step of displaying said suites, selecting said first test object from said first suite for execution thereof by said first computing device, and selecting said second test object from said second suite for execution thereof by said second computing device.

5. The method according to claim 1, further comprising receiving requests at said server from said computing devices requesting said server to provide test programs to the computing devices.

6. The method according to claim 1, further comprising:

receiving requests at said server from said computing devices requesting said server to provide test programs to the computing devices; and

in response to receiving a request, assigning a thread to process the request;

wherein each received request is assigned a separate thread to allow concurrent execution of the test programs in said computing devices.

7. The method according to claim 6, further comprising each thread assigned to process a received request retrieving a unique identifier from the request that identifies a requesting computing device, calling components of the test harness that are used to process the request, and returning a response to the requesting computing device.

8. The method according to claim 1, further comprising:

receiving messages from said computing devices with respect to execution of said test programs; and

controlling said execution of said test programs in said suite based on said messages by communicating responses to said messages to said computing devices.

9. The method according to claim 1, further comprising:

selecting a test program for execution in one of the computing devices, wherein the computing device is adapted to operate using a particular platform;

retrieving an object corresponding to a test suite that includes the selected test program;

extracting JAR files that are specific to the platform of the computing device from the object;

extracting classes and an execution agent from the JAR files;

packaging the extracted classes and execution agent in a first package for download to the computing device; and

downloading the first package to the computing device for execution.

10. The method according to claim 1, further comprising:

receiving a request from one of the computing devices at said server requesting a next test program to execute at the computing device, wherein the request includes a unique identifier corresponding to the requesting computing device; and

determining a next test program to be executed by the requesting device.

11. A computer software product, comprising a computer-readable storage medium in which computer program instructions are stored, which instructions, when read by a computer, cause the computer to perform a method for testing computing devices, the method comprising:

providing a plurality of suites of test programs for access by a server, wherein a first suite and a second suite of said plurality of suites are respectively adapted to run on a first platform and a second platform;

storing a first execution agent that is adapted to run on said first platform and a second execution agent that is adapted to run on said second platform for access by said server;

providing a test harness on said server to support execution of said test programs by at least a first computing device and a second computing device, wherein said first and second computing devices are coupled to said server, and wherein said first computing device is adapted to operate using said first platform and said second computing device is adapted to operate using said second platform;

using said test harness, packaging a first test object with said first execution agent for download to said first computing device in a first package and packaging a second test object with said second execution agent for download to said second computing device in a second package;

responsively to an instruction of said test harness, downloading said first package and said second package to said first computing device and said second computing device, respectively; and

initiating concurrent execution of a test program of said first package in said first computing device and a test program of said second package in said second computing device.

12. The computer software product according to claim 11, wherein said first suite and said second suite comprise platform-specific JAR files.

13. The computer software product according to claim 11, wherein said first package and said second package comprise JAR files.

14. The computer software product according to claim 11, wherein said method for testing computing devices further comprises:

displaying said suites as a hierarchy of identifiers of test objects corresponding to said test programs for selection of said first test object from said first suite for execution thereof by said first computing device, and said second test object from said second suite for execution thereof by said second computing device.

15. A system for testing computing devices, comprising:

a communication interface for coupling at least a first computing device and a second computing device thereto for use in communicating with said system, wherein said first computing device is adapted to operate using a first platform and said second computing device is adapted to operate using a second platform;

a memory;

a test harness object stored in said memory;

a plurality of suites of test programs stored in said memory for execution by said computing devices that are coupled to said system, wherein a first suite and a second suite of said plurality of suites are respectively adapted to run on said first platform and said second platform;

a first execution agent and a second execution agent stored in said memory, wherein said first execution agent is adapted to run on said first platform and said second execution agent is adapted to run on said second platform;

a processor configured to access said suite and said test harness object, wherein said processor using said test harness is operable to;

package a first test object with said first execution agent for download to said first computing device in a first package and package a second test object with said second execution agent for download to said second computing device in a second package;

download said first package and said second package to said first computing device and said second computing device, respectively; and

initiate concurrent execution of a test program of said first package in said first computing device and a test program of said second package in said second computing device.

16. The system according to claim 15, wherein said first and second test programs are executed substantially simultaneously under control of said processor.

17. The system according to claim 15, wherein said processor using said test harness is further operable to receive messages via said communication interface from said computing devices with respect to execution of said test programs, and to control said execution of said test programs in said suite based on said messages by communicating responses to said messages via said communication interface.

18. The system according to claim 17, wherein said first and second packages comprise platform-specific JAR files.

19. The system according to claim 15, further comprising a graphical user interface in said processor for displaying said test programs as a hierarchy for selection of said first and second test programs therefrom.

20. The system according to claim 15, wherein said computing devices are coupled to said communication interface via a common test host.