Automated Framework For Dynamically Creating Test Scripts for Software Testing

• US 20130159974A1
• Filed: 12/15/2011
• Published: 06/20/2013
• Est. Priority Date: 12/15/2011
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Norton, Anthony, Van, Hung T., Sipe, Scott K.
• Granted Patent: US 9,117,028 B2
• Time in Patent Office: Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

A computer program product and method for dynamically creating test scripts for software testing. The method includes selecting one or more reference scripts to create a selected script set, selecting one or more parameters to create a selected parameter set, generating permutations of the selected script set based upon the selected script set and the selected parameter set, and generating permutation test scripts for each of the generated permutations which include test code, a dynamic variable, and varying values for the dynamic variable amongst the permutation test scripts. Depending upon the scope of the parameters, the generation of permutations uses variations of an n-ary Cartesian product to determine the permutations and varying content of the generated permutation test scripts.

Claims

1. A computer program product, comprising a storage medium having a computer readable program code embodied therein, said computer readable program code being adapted to execute a method for dynamically creating test scripts for software testing, said method comprising:

selecting one or more reference scripts to create a selected script set;

selecting one or more parameters for use with said selected script set to create a selected parameter set;

generating permutations of said selected script set based upon said selected script set and said selected parameter set;

generating permutation test scripts for each of the generated permutations, wherein a plurality of the generated permutation test scripts, include test code, a dynamic variable, and variable values for the dynamic variable amongst the plurality of the generated permutation test scripts; and

executing at least one of the plurality of generated permutation test scripts.

2. The computer program product of claim 1 further comprising:

aggregating results of the executed permutation test scripts to create an aggregated result set; and

displaying said aggregated result set to a user.

3. The computer program product of claim 1, wherein the selected parameter set includes at least one per unit of work parameter, and the generation of permutations uses an n-ary Cartesian product based upon the number of per unit of work parameters affecting each selected reference script to determine the permutations for the plurality of generated permutation test scripts.

4. The computer program product of claim 1, wherein the selected parameter set includes at least one global parameter, and the generation of permutations uses an n-ary Cartesian product based upon the number of global parameters affecting the selected script set multiplied by the number of reference scripts to determine the permutations for the plurality of generated permutation test scripts.

5. The computer program product of claim 1, wherein the selected parameter set includes at least one global parameter and at least one per unit of work parameter, and the generation of permutations uses a first n-ary Cartesian product functioning as a summation operator over a sub summation operation using a second n-ary Cartesian product to determine the permutations for the plurality of generated permutation test scripts, with the first n-ary Cartesian product being based upon the number of global parameters affecting the selected script set and the second n-ary Cartesian product being based upon the number of per unit of work parameters affecting each selected reference script.

6. The computer program product of claim 1, wherein generating the permutation test scripts, test code, and variable value for each of said permutations further comprises using a relational algebra operation for each variable assigned to the permutation to dynamically derive a value for said variable in.

7. The computer program product of claim 1, wherein the dynamic variable type is an external calculated variable type.

8. The computer program product of claim 1, wherein the dynamic variable type is one of a database query, a code object, or one or more lines of script for execution with the plurality of generated permutation test scripts.

9. A computer program product, comprising a storage medium having a computer readable program code embodied therein, said computer readable program code being adapted to execute a method for dynamically creating test scripts for software testing, said method comprising:

selecting one or more reference scripts from scripts stored in a script repository to create a selected script set;

selecting one or more parameters for use with said selected script set to create a selected parameter set;

using a formula to generate permutations of said selected script set based upon said selected script set and said selected parameter set, wherein said formula includes at least an n-ary Cartesian product based upon the selected script set and the selected parameter set;

using a relational algebra operation to generate a plurality of permutation test scripts including test code, a dynamic variable, and variable values for the dynamic variable amongst the plurality of the generated permutation test scripts;

executing at least one of said permutation test scripts;

aggregating results of said executed permutation test scripts to create an aggregated result set; and

displaying said aggregated result set to a user.

10. The computer program product of claim 9, wherein said relational algebra operation is represented by a structured query language (SQL) statement.

11. The computer program product of claim 9, wherein said script repository is a relational database.

12. A method for dynamically creating test scripts for software testing, said method comprising:

selecting one or more reference scripts to create a selected script set;

selecting one or more parameters for use with said selected script set to create a selected parameter set;

generating permutations of said selected script set based upon said selected script set and said selected parameter set;

generating permutation test scripts for each of the generated permutations, wherein a plurality of the generated permutation test scripts, include test code, a dynamic variable, and variable values for the dynamic variable amongst the plurality of the generated permutation test scripts; and

executing at least one of the plurality of generated permutation test scripts.

13. The method claim 12 further comprising:

aggregating results of the executed permutation test scripts to create an aggregated result set; and

displaying said aggregated result set to a user.

14. The method of claim 12, wherein the selected parameter set includes at least one per unit of work parameter, and the generation of permutations uses an n-ary Cartesian product based upon the number of per unit of work parameters affecting each selected reference script to determine the permutations for the plurality of generated permutation test scripts.

15. The method of claim 12, wherein the selected parameter set includes at least one global parameter, and the generation of permutations uses an n-ary Cartesian product based upon the number of global parameters affecting the selected script set multiplied by the number of reference scripts to determine the permutations for the plurality of generated permutation test scripts.

16. The method of claim 12, wherein the selected parameter set includes at least one global parameter and at least one per unit of work parameter, and the generation of permutations uses a first n-ary Cartesian product functioning as a summation operator over a sub summation operation using a second n-ary Cartesian product to determine the permutations for the plurality of generated permutation test scripts, with the first n-ary Cartesian product being based upon the number of global parameters affecting the selected script set and the second n-ary Cartesian product being based upon the number of per unit of work parameters affecting each selected reference script.

17. The method of claim 12, wherein generating the permutation test scripts, test code, and variable value for each of said permutations further comprises using a relational algebra operation for each variable assigned to the permutation to dynamically derive a value for said variable in.

18. The method of claim 12, wherein the dynamic variable type is an external calculated variable type.

19. The method of claim 18, wherein the dynamic variable type is one of a database query, a code object, or one or more lines of script for execution with the plurality of generated permutation test scripts.