CONFIGURABLE TESTING OF COMPUTER PROGRAMS

• US 20140189653A1
• Filed: 01/28/2014
• Published: 07/03/2014
• Est. Priority Date: 01/03/2013
• Status: Active Grant

• Current Assignee: Ab Initio Technology LLC (Ab Initio Software Corporation)
• Original Assignee: Ab Initio Technology LLC (Ab Initio Software Corporation)
• Inventors: Larson, Brond, Wholey, Joseph Skeffington III, Offner, Carl
• Granted Patent: US 9,274,926 B2
• Time in Patent Office: Days
• US Class Current: 717/125
• CPC Class Codes: G06F 11/3604 Software analysis for verifying properties of programs byte-code verification G06F9/44589
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Configurable testing of a computer program includes: storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and processing, using at least one processor, the computer program according to at least a first testing specification associated with the computer program. The processing includes: traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program, and while traversing the representation, recognizing recognizable portions of the computer program, and storing values of attributes, defined by the attribute information, of the recognized portions of the computer program.

Claims

1. A computing system for configurable testing of a computer program, the computing system including:

a storage medium storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and

a configurable testing module, including at least one processor, configured to process the computer program according to at least a first testing specification associated with the computer program, the processing including;

traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program, and

while traversing the representation, recognizing recognizable portions of the computer program, and storing values of attributes, defined by the attribute information, of the recognized portions of the computer program.

2. The system of claim 1, wherein the processing further includes:

performing at least one test specified in at least the first testing specification based at least in part on stored values of attributes of one or more recognized portions of the computer program.

3. The system of claim 2, wherein the first testing specification includes a test that tests at least one characteristic of the computer program that does not prevent the computer program from executing without error.

4. The system of claim 2, wherein the first testing specification includes a test that tests at least one characteristic of the computer program associated with code reuse efficiency.

5. The system of claim 2, wherein the first testing specification includes a test that tests at least one characteristic of the computer program associated with memory use constraints.

6. The system of claim 5, wherein the characteristic of the computer program associated with memory use constraints includes a maximum amount of main memory that a particular recognized portion of the computer program is allowed to use when the computer program executes.

7. The system of claim 2, wherein the first testing specification includes a test that tests a number of times at least one particular operation is used in the computer program.

8. The system of claim 2, wherein the first testing specification includes a test that references a value of a name attribute of a recognizable portion of the computer program to determine whether to continue applying the test.

9. The system of claim 2, the processing further including presenting in a user interface a result of at least one test, the result being visually associated with a displayed portion of the computer program on which the test was performed.

10. The system of claim 1, wherein the storage medium stores activation information indicating which of the testing specifications are active.

11. The system of claim 10, wherein at least one of the testing specifications includes at least one local test that applies to a particular portion of the computer program, and at least one of the testing specifications includes at least one global test that applies to multiple portions of the computer program.

12. The system of claim 11, wherein the processing further includes:

accessing the activation information to determine one or more testing specifications that are indicated as active.

13. The system of claim 12, wherein the set of one or more testing specifications is a hierarchical set that relates at least some of the testing specifications to each other according to a hierarchy.

14. The system of claim 13, wherein accessing the activation information to determine one or more testing specifications that are indicated as active includes identifying active testing specifications along a path up the hierarchy between the first testing specification and a root of the hierarchy.

15. The system of claim 12, wherein the processing further includes:

while traversing the representation, performing any local tests specified in any active testing specifications based at least in part on stored values of attributes of one or more recognized portions of the computer program.

16. The system of claim 12, wherein the processing further includes:

while traversing the representation, performing any aggregation functions specified in any active testing specifications based at least in part on stored values of attributes of one or more recognized portions of the computer program.

17. The system of claim 16, wherein the processing further includes:

after traversing the representation, performing any global tests specified in any active testing specifications based at least in part on stored results of any aggregation functions performed while traversing the representation.

18. The system of claim 1, wherein the representation of the computer program is a graph based-representation and the elements include:

nodes that represent at least some of the recognizable portions, and links that represent relationships between the recognizable portions represented by the nodes.

19. The system of claim 18, wherein the graph-based representation includes a dataflow graph that includes:

processing components represented by the nodes, and flows of data between processing components represented by the links.

20. The system of claim 19, wherein at least some of the recognizable portions include a flow of data between processing components.

21. The system of claim 19, wherein at least some of the recognizable portions include an input or output port of a processing component.

22. The system of claim 19, wherein at least some of the recognizable portions include a parameter associated with a processing component or a flow of data between processing components.

23. The system of claim 18, wherein the graph-based representation includes a control flow graph that includes:

basic blocks of code represented by the nodes, and changes of control between basic blocks represented by the links.

24. The system of claim 1, the testing further including receiving user input for specifying at least one testing specification of the set of one or more testing specifications.

25. The system of claim 24, wherein at least some of the attribute information is predetermined before at least some of the user input is received.

26. A computing system for configurable testing of a computer program, the computing system including:

means for storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and

means for processing the computer program according to at least a first testing specification associated with the computer program, the processing including;

traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program, and

while traversing the representation, recognizing recognizable portions of the computer program, and storing values of attributes, defined by the attribute information, of the recognized portions of the computer program.

27. A method for configurable testing of a computer program, the method including:

storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and

processing, using at least one processor, the computer program according to at least a first testing specification associated with the computer program, the processing including;

traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program, and

while traversing the representation, recognizing recognizable portions of the computer program, and storing values of attributes, defined by the attribute information, of the recognized portions of the computer program.

28. Software stored on a computer-readable medium, for configurable testing of a computer program, the software including instructions for causing a computing system to:

store a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and

process the computer program according to at least a first testing specification associated with the computer program, the processing including;

traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program, and

while traversing the representation, recognizing recognizable portions of the computer program, and storing values of attributes, defined by the attribute information, of the recognized portions of the computer program.