System and method for software testing

• US 7,810,070 B2
• Filed: 03/29/2004
• Issued: 10/05/2010
• Est. Priority Date: 03/29/2004
• Status: Active Grant

• Current Assignee: SAS Institute Incorporated
• Original Assignee: SAS Institute Incorporated
• Inventors: Nasuti, William John, Dunbar, Connie Stout
• Primary Examiner(s): WANG, RONGFA PHILIP
• Application Number:
  US10/811,789
• Publication Number:
  US 20050229043A1
• Time in Patent Office: 2,381 Days
• Field of Search: 717/124
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Systems and methods for evaluating the testing of a computer program wherein a test automator generates code to test the computer program with respect to predetermined testing criteria. A test results analyst reviews test results generated by applying the code to test the computer program. The environments of a test automator and a test analyst are separated, thereby relieving a test results analyst from being required to have knowledge of the code that was used to test the computer program.

Claims

1. A system for evaluating tests of a computer program, comprising:

one or more processors;

a computer-readable storage medium containing instructions configured to cause the one or more processors to perform operations, including;

creating a file containing a list of required actions for testing an application, wherein the file includes automation control code, and wherein the file is created by a test designer on a test design automation independent tool within a first insulated environment;

automatically transmitting the file to a test coding and execution automator in a second insulated environment that is separate from the first insulated environment;

receiving the file in the second insulated environment, wherein an interface is generated through which the test coding and execution automator enters one or more code segments, and uses an automation engine to generate test automation code by associating the one or more code segments with one or more details abstracted from the automation control code;

using an automation framework to translate the test automation code into an automation application map by mapping the test automation code to the automation application map, wherein the automation application map includes a lower level of executable computer code used to test the application;

executing the automation application map code to test the application and produce test results;

automatically transmitting the test results to a test analysis automation independent tool in a third insulated environment that is separate from the first and second insulated environments; and

receiving the test results in the third insulated environment and comparing the received test results to one or more other received test results, wherein the comparison is done by a test results analyst using the test analysis automation independent tool in the third insulated environment.

2. The system of claim 1, wherein the automatically transmitting of the test results to the test analysis automation independent tool in the third insulated environment involves copying or moving the test results from the second insulated environment to the third insulated environment.

3. The system of claim 2, wherein the third insulated environment includes an internet web browser for viewing received test results.

4. The system of claim 1, wherein the format of the received test results include JPEG, HTML, GIF, and combinations thereof.

5. The system of claim 1, wherein the list includes an action to test a computer-human interface generated by the computer program.

6. The system of claim 1, wherein the list includes an action to test performance of the computer program.

7. The system of claim 1, wherein the first insulated environment, the second insulated environment, and the third insulated environment operate on a network such that each of the environments are accessible through different computer terminals, wherein the first insulated environment operates on a first computer which does not contain the second insulated environment or the third insulated environment, wherein the second insulated environment operates on a second computer which does not contain the first insulated environment or the third insulated environment, and wherein the third insulated environment operates on a third computer which does not contain the first insulated environment or the second insulated environment.

8. A computer-implemented method for evaluating tests of a computer program, comprising:

creating a file containing a list of required actions for testing an application, wherein the file includes automation control code, and wherein the file is created by a test designer on a test design automation independent tool within a first insulated environment;

automatically transmitting the file to a test coding and execution automator in a second insulated environment that is separate from the first insulated environment;

receiving the file in the second insulated environment, wherein an interface is generated through which the test coding and execution automator enters one or more code segments, and uses an automation engine to generate test automation code by associating the one or more code segments with one or more details abstracted from the automation control code;

using an automation framework to translate the test automation code into an automation application map by mapping the test automation code to the automation application map, wherein the automation application map includes a lower level of executable computer code used to test the application;

executing the automation application map code to test the application and produce test results;

automatically transmitting the test results to a test analysis automation independent tool in a third insulated environment that is separate from the first and second insulated environments; and

receiving the test results in the third insulated environment and comparing the received test results to one or more other received test results, wherein the comparison is done by a test results analyst using the test analysis automation independent tool in the third insulated environment.

9. Computer software stored on one or more computer-readable storage mediums, the computer software comprising program code for carrying out a method for evaluating tests of a computer program, the method comprising:

creating a file containing a list of required actions for testing an application, wherein the file includes automation control code, and wherein the file is created by a test designer on a test design automation independent tool within a first insulated environment;

automatically transmitting the file to a test coding and execution automator in a second insulated environment that is separate from the first insulated environment;

receiving the file in the second insulated environment, wherein an interface is generated through which the test coding and execution automator enters one or more code segments, and uses an automation engine to generate test automation code by associating the one or more code segments with one or more details abstracted from the automation control code;

using an automation framework to translate the test automation code into an automation application map by mapping the test automation code to the automation application map, wherein the automation application map includes a lower level of executable computer code used to test the application;

executing the automation application map code to test the application and produce test results;

automatically transmitting the test results to a test analysis automation independent tool in a third insulated environment that is separate from the first and second insulated environments; and

receiving the test results in the third insulated environment and comparing the received test results to one or more other received test results, wherein the comparison is done by a test results analyst using the test analysis automation independent tool in the third insulated environment.