System, method, and computer readable medium for universal software testing

• US 8,856,743 B2
• Filed: 04/01/2011
• Issued: 10/07/2014
• Est. Priority Date: 10/17/2006
• Status: Active Grant

• Current Assignee: Progress Software Corporation
• Original Assignee: Telerik Incorporated (Progress Software Corporation)
• Inventors: Sweis, Faris
• Primary Examiner(s): COYER, RYAN D
• Application Number:
  US13/078,142
• Publication Number:
  US 20110239198A1
• Time in Patent Office: 1,285 Days
• Field of Search: 717/124
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3608 using formal methods, e.g. model checking, abstract interpretation theorem proving G06N5/013
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 8/74 Reverse engineering; Extracting design information from source code

Abstract

An automated software testing and validation system allows testing of a software application under test (SAUT) regardless of the dynamic nature of the SAUT. An abstracted set of hierarchal or linear objects model certain regions of the SAUT. Automated test scripts utilize theses regions to intuitively navigate and identify potions of the SAUT to automate. The scripts can also access specific SAUT elements contain within each defined region. These elements can then be used to invoke actions or verify outputs there from. The system uses a set of rich identification rules embodied in the system which allow the user to configure the identification of any element within the abstracted region. The rules are customizable to allow the user to configure the desired level of loose coupling between the automated scripts and the target element to adapt the scripts to the nature of the SAUT.

Claims

1. A computer-assisted method for software testing and validation, the method comprising:

generating, by a processor of a computing device, an abstract model defined by data embedded in a software application under test (SAUT), said generating comprising;

identifying, by the processor, the embedded data within at least one region of the SAUT by parsing the at least one region of the SAUT, wherein the embedded data comprises a tag identifying a test region; and

constructing a test region object representing the test region, wherein the test region object stores hierarchical information defining a hierarchy comprising;

(i) a location of the test region within the SAUT, (ii) a parent region that the test region is contained within, (iii) one or more sub-regions contained within the test region, and (iv) one or more test objects associated with the test region; and

executing, by the processor, a test script, wherein the test script navigates the abstract model thereby invoking an action of the test region and/or verifying an output of the test region, wherein the abstract model enables the test script to navigate the abstract model by one or both of (a) directly accessing the test region using the tag thereby locating the test region regardless of location of the test region within the abstract model, and/or (b) using the hierarchical information to navigate up or down the hierarchy re-executing, by the processor, the test script to test an altered test region, wherein the altered test region has been altered by at least one of relocating and redefining the altered test region of the SAUT, the altering resulting in a change of expression of the abstract model of the altered test region without affecting other test regions within the SAUT, wherein the test script is unaffected by updates or changes outside the altered test region.

2. The method of claim 1, wherein the tag is nested within other tags thereby creating a hierarchy within the abstract model.

3. The method of claim 2, wherein the tag comprises one or more unique identifiers which identify the at least one region of the SAUT used to generate the abstract model, and wherein the test script utilizes the hierarchy within the abstract model to navigate the abstracted model to test the at least one object.

4. The method of claim 2, wherein the tag comprises one or more unique identifiers which identify at least one element of the at least one region of the SAUT used to generate the abstract model.

5. The method of claim 2, wherein the test script utilizes the abstract model to conduct the testing through the use of an identification rule used to locate certain elements within the SAUT.

6. The method of claim 5, wherein the identification rule further comprises a reference parameter within the SAUT used as a starting point for the identification rule.

7. The method of claim 6, wherein the identification rule identifies one or more of the following:

an element based on the hierarchy within the abstract model;

an element based on a combination of attributes set on the element;

an element based on a tag of the element; and

an element based on a regular expression.

8. The method of claim 5, wherein a plurality of identification rules are combined to identify the element within the SAUT.

9. A system for software testing and validation, the system comprising:

a processor of a computing device;

a non-transitory computer readable medium associated with a software testing and validation program, the software testing and validation program stored on the non-transitory computer readable medium and including instructions that, when executed by the processor, cause the processor to perform the steps of;

generating, by a processor of a computing device, an abstract model defined by data embedded in a software application under test (SAUT), said generating comprising;

identifying, by the processor, the embedded data within at least one region of the SAUT by parsing the at least one region of the SAUT, wherein the embedded data comprises a tag identifying a test region; and

constructing a test region object representing the test region, wherein the test region object stores hierarchical information defining a hierarchy comprising;

(i) a location of the test region within the SAUT, (ii) a parent region that the test region is contained within, (iii) one or more sub-regions contained within the test region, and (iv) one or more test objects associated with the test region; and

executing, by the processor, a test script, wherein the test script navigates the abstract model thereby invoking an action of the test region and/or verifying an output of the test region, wherein the abstract model enables the test script to navigate the abstract model by one or both of (a) directly accessing the test region using the tag thereby locating the test region regardless of a location of the test region within the abstract model, and/or (b) using the hierarchical information to navigate up or down the hierarchy re-executing, by the processor, the test script to test an altered test region, wherein the altered test region has been altered by at least one of relocating and redefining the altered test region of the SAUT, the altering resulting in a change of expression of the abstract model of the altered test region without affecting other test regions within the SAUT, wherein the test script is unaffected by updates or changes outside the altered test region.

10. The system of claim 9, wherein the at least one tag is nested within other tags, thereby creating a hierarchy within the abstract model.

11. The system of claim 10, wherein the at least one tag further comprises unique identifiers which identify the at least one region of the SAUT used to generate the abstract model, and wherein the test script utilizes the hierarchy within the abstract model to navigate the abstracted model to test the at least one object.

12. The system of claim 10, wherein the at least one tag further comprises unique identifiers which identify at least one element of the at least one region of the SAUT used to generate the abstract model.

13. The system of claim 10, wherein the software testing and validation program product further includes instructions that, when executed by the processor, causes the processor to perform the operations of instructing the test script to utilize the abstract model to conduct the testing through the use of an identification rule used to locate certain elements within the SAUT.

14. The system of claim 13, wherein the identification rule further comprises a reference parameter within the SAUT used as a starting point for the identification rule.

15. The system of claim 14, wherein the identification rule identifies one or more of the following:

an element based on the hierarchy within the abstract model;

an element based on a combination of attributes set on the element;

an element based on a tag of the element; and

an element based on a regular expression.

16. The system of claim 13, wherein a plurality of identification rules are combined to identify the element within the SAUT.

17. A non-transitory computer readable medium that is readable by a computer for software testing and validation, the computer readable medium comprising a set of instructions that, when executed by a processor, causes the processor to perform the steps of:

generating, by a processor of a computing device, an abstract model defined by data embedded in a software application under test (SAUT), said generating comprising identifying, by the processor, the embedded data within at least one region of the SAUT by parsing the at least one region of the SAUT, wherein the embedded data comprises a first tag identifying a test region and one or more second tags each identifying a test object; and

executing, by the processor, a test script, wherein the test script navigates the abstract model thereby invoking an action of the test region and/or verifying an output of the test region, wherein the abstract model enables the test script to navigate the abstract model by one or both of (a) directly accessing the test region using the first tag thereby locating the test region regardless of a location of the test region within the abstract model, and/or (b) using the hierarchical information to navigate up or down the hierarchy re-executing, by the processor, the test script to test an altered test region, wherein the altered test region has been altered by at least one of relocating and redefining the altered test region of the SAUT, the altering resulting in a change of expression of the abstract model of the altered test region without affecting other test regions within the SAUT, wherein the test script is unaffected by updates or changes outside the altered test region.

18. The computer readable medium of claim 17, the computer readable medium further including instructions that, when executed by the processor, causes the processor to perform the step of directing the test script to utilize the abstract model to conduct the testing through the use of an identification rule used to locate certain elements within the SAUT.

19. The computer readable medium of claim 18, wherein the identification rule further comprises a reference parameter within the SAUT used as a starting point of the identification rule.

20. The computer readable medium of claim 19, wherein the identification rule identifies one or more of the following:

an element based on the hierarchy within the abstract model;

an element based on a combination of attributes set on the element;

an element based on a tag of the element; and

an element basal on a regular expression.

21. The computer readable medium of claim 19, wherein a plurality of identification rules are combined to identify the element within the SAUT.