Assessment system for choosing maintenance approaches for GUI-directed test scripts

• US 8,527,953 B2
• Filed: 06/10/2010
• Issued: 09/03/2013
• Est. Priority Date: 06/11/2009
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Grechanik, Mark, Xie, Qing, Fu, Chen
• Primary Examiner(s): Khatri, Anil
• Application Number:
  US12/813,300
• Publication Number:
  US 20100318970A1
• Time in Patent Office: 1,181 Days
• Field of Search: 717124-129, 715762-763
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling

Abstract

A graphical user interface (GUI) tool analysis system helps determine whether to purchase or license automated testing tools. The system provides guidance, e.g., to test managers, for making decisions on expenditures for the automated test tools. As a result, the test managers need not make purchasing decisions ad hoc, based on their own personal experience and perceived benefits of implementing a tool based automatic testing approach versus a manual testing approach.

Claims

1. A method for recommending graphical user interface (GUI) tools comprising:

identifying statistical variables for evaluating allocation of testing resources for test scripts;

partitioning the statistical variables into input variables and output variables;

defining in a memory statistical constraint equations with at least some of the statistical variables;

defining in the memory an evaluation function, with at least some of the statistical variables, for evaluating a testing cost of allocation of testing resources for test scripts, where the evaluation function determines, as the testing cost, a minimum value of;

a first equation defining a first monetary cost of manual testing of a graphical user interface (GUI), the first equation comprising a first subset of the statistical variables;

a second equation representing a second monetary cost of automated testing of the GUI with manual maintenance, the second equation comprising a second subset of the plurality of statistical variables; and

a third equation representing a third monetary cost of automated testing of the GUI with tool based maintenance, the third equation comprising a third subset of the plurality of statistical variables;

executing with a processor coupled to the memory an optimization program stored in the memory,

the optimization program comprising instructions that when executed cause the processor to;

obtain a workplace dependent value for each of the input variables apply the constraint equations to a parameter space defined by the output variables to define a curve in the parameter space;

execute an optimization algorithm to obtain an optimum point on the curve that achieves a defined goal for the evaluation function;

determine a recommendation based on the optimum point; and

store the recommendation in the memory.

2. The method of claim 1, where the optimization algorithm determines the optimum point on the curve based on returned values of the evaluation function.

3. The method of claim 1, where the evaluation function determines, as the testing cost, a minimum value of:

a first equation defining a manual testing cost;

and a second equation defining an automated testing cost.

4. The method of claim 1, where the statistical variables include any one or more of:

manual testing time (MTT), number of test engineers needed (NTEN), number of manual testers needed (NMT), test script composition time (TSCT), test script running time (TSRT), test script maintenance time (TSMT), and tool based maintenance speed up factor (MS), and the statistical constraint equations comprise any one or more of MTT, NTEN, NMT, TSCT, TSRT, and TSMT.

5. The method of claim 4, where the statistical constraint equations include any one or more of:

6. The method of claim 5, where any one or more of the constraint equations are set to constrain values obtained from controlled experiments on prior test script testing projects.

7. A system for recommending graphical user interface (GUI) tools comprising:

a processor; and

stored on a computer readable memory coupled to the processor;

statistical variables for evaluating allocation of testing resources for test scripts, the statistical variables partitioned into input variables and output variables;

statistical constraint equations with at least some of the statistical variables;

an evaluation function, with at least some of the statistical variables, for evaluating a testing cost of allocation of testing resources for test scripts, where the evaluation function determines, as the testing cost, a minimum value of;

a first equation defining a first monetary cost of manual testing of a graphical user interface (GUI), the first equation comprising a first subset of the statistical variables;

a second equation representing a second monetary cost of automated testing of the GUI with manual maintenance, the second equation comprising a second subset of the plurality of statistical variables; and

a third equation representing a third monetary cost of automated testing of the GUI with tool based maintenance, the third equation comprising a third subset of the plurality of statistical variables;

an optimization program comprising instructions that when executed cause the processor to;

obtain a workplace dependent value for each of the input variables apply the constraint equations to a parameter space defined by the output variables to define a curve in the parameter space;

execute an optimization algorithm to obtain an optimum point on the curve that achieves a defined goal for the evaluation function;

determine a recommendation based on the optimum point; and

store the recommendation in the memory.

8. The system of claim 7, where the optimization algorithm determines the optimum point on the curve based on returned values of the evaluation function.

9. The system of claim 7, where the evaluation function determines, as the testing cost, a minimum value of:

a first equation defining a manual testing cost; and

a second equation defining an automated testing cost.

10. The system of claim 7, where the statistical variables include any one or more of:

manual testing time (MTT), number of test engineers needed (NTEN), number of manual testers needed (NMT), test script composition time (TSCT), test script running time (TSRT), test script maintenance time (TSMT), and tool based maintenance speed up factor (MS), and the statistical constraint equations comprise any one or more of MTT, NTEN, NMT, TSCT, TSRT, and TSMT.

11. The system of claim 10, where the statistical constraint equations include any one or more of:

12. The system of claim 11, where any one or more of the constraint equations are set to constrain values obtained from controlled experiments on prior test script testing projects.

13. An article of manufacture, comprising:

a computer readable non-statutory medium; and

stored on the computer readable medium;

statistical variables for evaluating allocation of testing resources for test scripts, the statistical variables partitioned into input variables and output variables;

statistical constraint equations with at least some of the statistical variables;

an evaluation function, with at least some of the statistical variables, for evaluating a testing cost of allocation of testing resources for test scripts, where the evaluation function determines, as the testing cost, a minimum value of;

a first equation defining a first monetary cost of manual testing of a graphical user interface (GUI), the first equation comprising a first subset of the statistical variables;

a second equation representing a second monetary cost of automated testing of the GUI with manual maintenance, the second equation comprising a second subset of the plurality of statistical variables; and

a third equation representing a third monetary cost of automated testing of the GUI with tool based maintenance, the third equation comprising a third subset of the plurality of statistical variables;

an optimization program comprising instructions that when executed cause a processor to;

obtain a workplace dependent value for each of the input variables apply the constraint equations to a parameter space defined by the output variables to define a curve in the parameter space;

execute an optimization algorithm to obtain an optimum point on the curve that achieves a defined goal for the evaluation function;

determine a recommendation based on the optimum point; and

store the recommendation in the memory.

14. The article of manufacture of claim 13, where the optimization algorithm determines the optimum point on the curve based on returned values of the evaluation function.

15. The article of manufacture of claim 13, where the evaluation function determines, as the testing cost, a minimum value of:

a first equation defining a manual testing cost; and

a second equation defining an automated testing cost.

16. The article of manufacture of claim 13, where the statistical variables include any one or more of:

manual testing time (MTT), number of test engineers needed (NTEN), number of manual testers needed (NMT), test script composition time (TSCT), test script running time (TSRT), test script maintenance time (TSMT), and tool based maintenance speed up factor (MS), and the statistical constraint equations comprise any one or more of MTT, NTEN, NMT, TSCT, TSRT, and TSMT.

17. The article of manufacture of claim 16, where the statistical constraint equations include any one or more of: