System and method for testing applications

• US 8,185,877 B1
• Filed: 06/22/2005
• Issued: 05/22/2012
• Est. Priority Date: 06/22/2005
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Inventors: Colcord, Brian
• Primary Examiner(s): Bullock, Jr., Lewis A
• Assistant Examiner(s): GOORAY, MARK A
• Application Number:
  US11/157,974
• Time in Patent Office: 2,526 Days
• Field of Search: None
• US Class Current: 717/127
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs

Abstract

A system and method for testing at least one application is provided. The system comprises a test plan or script creation module for enabling a user to create at least one test plan or script for use in testing the at least one application. The system also comprises a test results module for initiating and determining test results associated with testing of the at least one application according to the at least one test plan or script. In some embodiments, the test results module determines: (1) baseline test results achieved by resolving the at least one test plan or script against the at least one application prior to the application being put to actual use, and (2) dynamic test results achieved by resolving the at least one test plan or script against the at least one application after the at least one application has been put to actual use. The system may also include a comparison module for comparing the dynamic test results with the baseline test results.

Claims

1. A system for testing at least one application, comprising:

at least one processor; and

at least one storage medium storing instructions that, when executed by the at least one processor, enables a computer to perform the following;

creating at least one test plan comprising a test object, a test method and a test parameter;

identifying at least one object and a parameter each associated with the at least one application, the at least one object or parameter corresponding to the test object or test parameter, respectively, of the at least one test plan;

determining test results associated with testing of the at least one application according to the at least one test plan, the test results comprising;

(1) baseline test results achieved by resolving the at least one test plan against the at least one application, and (2) regression test results achieved by resolving the at least one test plan against the at least one application;

identifying dynamic data to be parameterized;

automatically parameterizing the identified dynamic data associated with the at least one application;

determining changes in dynamic data associated with a failure associated with the at least one application by comparing the regression test results with the associated baseline test results; and

excluding from the determined changes in dynamic data those changes attributed to the parameterized dynamic data associated with the at least one application.

2. The system of claim 1 wherein data and information to conduct baseline and regression tests are received or obtained from a spreadsheet document or interface.

3. The system of claim 1 wherein the baseline or regression test results is/are presented to the user in a spreadsheet document or interface.

4. The system of claim 1 further comprising a test tool interface module for interfacing with a testing tool that conducts the tests according to the test plan, and for presenting and receiving test data and information from and to the testing tool.

5. The system of claim 1 further comprising an object determination module that determines at least one object associated with the at least one application, the at least one object being made available to the user for use during the test plan creation process.

6. The system of claim 1 further comprising an object value module that determines at least one value or parameter associated with the at least one object, the at least one value or parameter being made available to the user during the test plan creation process.

7. The system of claim 1 further comprising test plan-storage means for storing the at least one test plan.

8. The system of claim 1 wherein at least the test object and test method are in a first format when processed by a spreadsheet document, module or interface and in a second format when processed by a testing tool.

15. The system of claim 1, wherein the comparison module avoids registering a failure if parameterized data differ between the baseline test results and the regression test results.

16. The system of claim 1, the processor receives an automatically generated parameterization signal to identify dynamic data.

20. The system of claim 1, wherein the at least one test plan comprises a script.

21. The system of claim 1, wherein the at least one application is a portion of an application.

22. The system of claim 1, wherein the at least one application comprises one or more of a web site, web page, online content, and an interface.

23. The system of claim 1, wherein the object associated with the at least one application comprises one or more of a menu, a drop-down menu, a hyperlink, an address box, a uniform resource locator (URL), a search box, an icon, a radio button, and a screen element.

24. The system of claim 1, wherein the test parameter comprises a value.

25. The system of claim 1, wherein the parameter associated with the at least one test application comprises a value.

26. The system of claim 1, wherein the dynamic data comprises a dynamic object.

31. The method of claim 8, wherein the test parameter comprises a value.

9. A computer-implemented method for testing at least one application, comprising:

creating, by at least one processor, at least one test plan comprising a test object, a test method and a test parameter;

identifying at least one object and a parameter each associated with the at least one application, the at least one object or parameter corresponding to the test object or test parameter, respectively, that comprises the at least one test plan;

conducting, by the at least one processor, a baseline test of the at least one application according to the at least one test plan, the baseline test being performed to obtain baseline results relating to the at least one application;

conducting, by the at least one processor, a regression test of the at least one application according to the at least one test plan, the regression testing being performed to obtain regression results relating to the at least one application;

receiving a parameterization signal including an identification of dynamic data to be parameterized;

automatically parameterizing the identified dynamic data associated with the at least one application;

determining changes in dynamic data associated with a failure associated with the at least one application by comparing the regression test results and associated with the baseline test results; and

excluding, from the determined changes in dynamic data those results attributed to the parameterized dynamic data associated with the at least one application.

10. The method of claim 9 further comprising the step of setting the regression results with the parameterized dynamic data as the baseline results.

11. The method of claim 9 further comprising searching a database for at least one test plan associated with the at least one application.

12. The method of claim 9 where data and information to conduct the baseline and regression tests are received from a spreadsheet document or interface.

13. The method of claim 9 wherein the baseline data and information, test results, or comparison is presented via a spreadsheet document or interface.

17. The method of claim 9, further comprising allowing parameterized data to differ between the baseline test results and the regression test results without registering a failure.

18. The method of claim 9, further comprising receiving an automatically generated parameterization signal to identify dynamic data.

19. The method of claim 9, further comprising receiving a new baseline signal to set the regression results as a new baseline.

27. The method of claim 9, wherein the at least one test plan comprises a script.

28. The method of claim 9, wherein the at least one application is a portion of an application.

29. The method of claim 9, wherein the at least one application comprises one or more of a web site, web page, online content, and an interface.

30. The method of claim 9, wherein the object associated with the at least one application comprises one or more of a menu, a drop-down menu, a hyperlink, an address box, a uniform resource locator (URL), a search box, an icon, a radio button, and a screen element.

32. The method of claim 9, wherein the parameter associated with the at least one test application comprises a value.

33. The method of claim 9, wherein the dynamic data comprises a dynamic object.

14. A system for testing at least one application or portion thereof, comprising:

a spreadsheet module for receiving and presenting test data and information from and to a user in a first format, the spreadsheet module comprising;

a test plan or script creation module for enabling the user to create at least one test plan or script for use in testing the at least one application or portion thereof, the at least one test plan or script comprising at least one object, at least one method, and at least one parameter, the at least one test plan or script being based on data and information received from the user by the spreadsheet module, the test plan or script creation module comprising;

an object module for defining at least one object associated with the at least one application or portion thereof, the object module comprising;

an object determination module for identifying or determining at least one object associated with the at least one application or portion thereof; and

an object parameter determination module for identifying or determining at least one parameter associated with the at least one object; and

an object map creation module for creating object maps; and

a method module for defining at least one method for testing the at least one object associated with the at least one application or portion thereof; and

a test results module for determining results associated with testing of the at least one application or portion thereof, and for presenting the test results to the user through the spreadsheet module, the test results module comprising;

a baseline test results module for determining baseline test results associated with the at least one application or portion thereof;

a regression test results module for determining regression test results; and

a comparison module for comparing the regression test results with the baseline test results;

a parameterization module for parameterizing dynamic data or objects associated with the at least one application or portion thereof and designate dynamic data or objects for which changes will be excluded from the results produced by the comparison module the dynamic data or objects being determined by the comparison;

an interpreter module for converting the test data and information between the first and a second format; and

a test tool interface module for interfacing with a testing tool and for presenting and receiving test data and information from and to the testing tool in the second format, the testing tool interfacing with the application or portion thereof to conduct the test.