Software testing apparatus and method
First Claim
1. A computer-implemented method for testing a software product through the use of a test suite designed to exercise the software product and generate a test suite log indicative of test results obtained from executing the test suite, the method being performed through the use of a server computer system and a plurality of servant computer systems, the method comprising the steps of:
- transmitting the software product and the test suite to each of a plurality of selected ones of the plurality of servant computer systems and loading the software product and test suite on each of the selected servant computer systems;
executing the software product and test suite on each of the plurality of selected servant computer systems, wherein the execution of the test suite on each of the selected servant computer system causes the generation of a test suite log on each of the selected servant computer systems; and
transmitting the test suite logs generated by each of the selected servant computer systems to the server computer system.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention discloses a computer-implemented method for testing a software product using a server computer system and a plurality of servant computer systems which are networked together. The method includes the step of providing the server computer system with the software product to be tested and an associated test suite. The test suite being designed to exercise the software product and generate a test suite log indicative of test results obtained from executing the test suite. The server computer system then transmits the software product and the test suite to user-defined servant computer systems such that the software product and test suite is executed on each of the user-defined servant computer systems. A test suite log is then generated on each of the selected servant computer systems and transmitted back to the server computer system.
-
Citations
32 Claims
-
1. A computer-implemented method for testing a software product through the use of a test suite designed to exercise the software product and generate a test suite log indicative of test results obtained from executing the test suite, the method being performed through the use of a server computer system and a plurality of servant computer systems, the method comprising the steps of:
-
transmitting the software product and the test suite to each of a plurality of selected ones of the plurality of servant computer systems and loading the software product and test suite on each of the selected servant computer systems; executing the software product and test suite on each of the plurality of selected servant computer systems, wherein the execution of the test suite on each of the selected servant computer system causes the generation of a test suite log on each of the selected servant computer systems; and transmitting the test suite logs generated by each of the selected servant computer systems to the server computer system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-implemented method for testing a software product on a servant computer system, the method comprising the steps of:
-
receiving an initialization request from a remotely located server computer system, the job initialization request identifying the software product to be tested and a test suite; loading the software product and test suite identified in the job initialization request, the test suite being arranged to exercise the software product and generate a test suite log indicative of test results obtained from exercising the software product; executing the identified test suite whereby a test suite log indicative of test results is generated; and transmitting the test suite log to the server computer system. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. A computer-implemented method for coordinating the testing of a software product, the method comprising the steps of:
-
receiving a test configuration matrix that designates a job identifying a software product to be tested, a plurality of servant computer systems having different hardware configurations for testing the software product, and a test suite designed to exercise the software product, and the servant computer systems being networked to the server computer system; determining whether each of the servant computer systems is available for testing, and when it is determined that a particular servant computer system is available, scheduling the job on the available servant computer system; transmitting the software product and test suite to selected ones of the servant computer systems identified in the configuration matrix when they are available, and directing the selected servant computer systems to execute the test suite such that a test suite log is generated at each of the selected servant computer systems, the test suite logs being indicative of test results obtained from executing the test suite; and receiving the test suite logs from the selected servant computer systems. - View Dependent Claims (19, 20, 21, 22)
-
-
23. A computer program product comprising a computer-usable medium having computer-readable code embodied thereon for testing a software product on a servant computer system, the computer program product comprising the following computer-readable program code for effecting actions in the computer:
-
program code for receiving an initialization request from a remotely located server computer system, the job initialization request identifying the software product to be tested and a test suite; program code for loading the software product and test suite identified in the job initialization request, the test suite being arranged to exercise the software product and generate a test suite log indicative of test results obtained from exercising the software product; and program code for executing the identified test suite whereby a test suite log indicative of test results is generated and then transmitted to the server computer system. - View Dependent Claims (24)
-
-
25. A computer program product comprising a computer-usable medium having computer-readable code embodied thereon for coordinating the testing of a software product, the computer program product comprising:
-
program code for receiving a test configuration matrix that designates a job identifying a software product to be tested, a plurality of servant computer systems having different hardware configurations for testing the software product, and a test suite designed to exercise the software product; program code for determining whether each of the servant computer systems is available for testing, and when it is determined that a particular servant computer system is available, scheduling the job on the available servant computer system; program code for transmitting the software product and test suite to selected ones of the servant computer systems identified in the configuration matrix when they are available, and directing the selected servant computer systems to execute the test suite such that a test suite log is generated at each of the selected servant computer systems, the test suite logs being indicative of test results obtained from executing the test suite; and program code for receiving the test suite logs from the selected servant computer systems. - View Dependent Claims (26)
-
-
27. An automated system for testing software, the system comprising:
-
a server computer system; a plurality of servant computer systems defining a plurality of different hardware configurations, the plurality of servant computer systems being networked to the server computer system; a test software product; a test suite designed to exercise the test software product on selected ones of the plurality of servant computer systems, the test suite being arranged to create a test suite log indicative of test results obtained from exercising the test software product; a dispatcher associated with the server computer system for transmitting the test software product and the test suite to the selected servant computer systems; and wherein each servant computer system includes a mechanism configured to execute the test suite to generate the test suite log and a mechanism configured to transmit the test suite log generated thereon to the server computer system. - View Dependent Claims (28, 29)
-
-
30. In a computer based software testing configuration that includes a server computer system, a plurality of servant computer systems defining a plurality of different hardware configurations, the plurality of servant computer systems being networked to the server computer system, a test software product to be tested and a test suite designed to exercise the test software product on selected ones of the plurality of servant computer systems, the test suite being arranged to create a test suite log indicative of test results is obtained from exercising the software product, an automated system comprising:
-
a dispatcher associated with the server computer system for transmitting the test software product and the test suite to the selected servant computer systems; and wherein at least one servant computer system includes a mechanism configured to execute the test suite to generate the test suite logs and a mechanism configured to transmit the test suite log generated thereon to the server computer system.
-
-
31. A method for testing a software product through the use of a test suite designed to exercise the software product and generate a test suite log indicative of test results obtained from executing the test suite, the method comprising:
-
arranging a server computer system to be networked to a plurality of servant computer systems; transmitting a test coverage build defining selected portions of the software product identified for special consideration and the test suite to the plurality of servant computer systems, and loading the test coverage build and test suite on each of the selected servant computer systems when a test coverage flag is set; executing the test coverage build and test suite on each of the plurality of selected servant computer systems, wherein the execution of the test suite on each of the selected servant computer systems causes the generation of a test coverage data file on each of the selected servant computer systems; and transmitting the test coverage data file generated by each of the selected servant computer systems to the server computer system.
-
-
32. In a software testing system that includes a server computer system, a plurality of servant computer systems being networked to the server computer system, a test software product to be tested and a test suite designed to exercise the test software product on selected ones of the plurality of servant computer systems, the test suite being arranged to create a test suite log indicative of test results is obtained from exercising the software product, an automated system comprising:
-
a dispatcher associated with the server computer system for transmitting the test software product and the test suite to the selected servant computer systems, the dispatcher having a queuing mechanism for holding testing jobs until the selected computer systems having a particular computer configuration is available; and wherein at least one servant computer system includes a mechanism configured to execute the test suite to generate the test suite logs and a mechanism configured to transmit the test suite log generated thereon to the server computer system.
-
Specification