IDENTIFYING TEST CASES TO BE RUN AFTER CHANGES TO MODULES OF A SOFTWARE APPLICATION

• US 20110219359A1
• Filed: 03/04/2010
• Published: 09/08/2011
• Est. Priority Date: 03/04/2010
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Gupta, Ravi Kant
• Granted Patent: US 8,694,966 B2
• Time in Patent Office: Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs

Abstract

An aspect of the present invention facilitates identification of test cases to be run after changes to modules of a software application. In one embodiment, a reference data is generated by inspecting the instructions (static analysis) forming the modules of the software application, with the reference data specifying a corresponding set of modules in the application that are referenced by each of the modules in the application. The reference data is then examined to find a referencing set of modules which reference any of the changed modules either as immediate reference or multi-level reference through other modules. Test cases invoking any of the modules in the referencing set are identified as suitable test cases to be run.

Claims

1. A method of testing an application after changes to any of a plurality of modules forming said application, said method comprising:

receiving an indication that a set of modules have changed, wherein said set of modules is contained in said plurality of modules;

identifying a set of test cases to cover testing of said changed set of modules and a second set of modules having a reference to any of said changed set of modules, wherein said second set of modules are identified by static analysis of said plurality of modules, said second set of modules being contained in said plurality of modules; and

running said set of test cases with said changed set of modules merged into said plurality of modules.

2. The method of claim 1, wherein said set of test cases is a minimal set that covers testing of all of said changed set of modules, and a referencing set of modules which reference any of said changed set of modules either as immediate reference or multi-level reference through other modules, said referencing set of modules including said second set of modules and being contained in said plurality of modules.

3. The method of claim 2, wherein said plurality of modules are maintained in a code repository, and wherein said identifying is performed before merging said changed set of modules with said application in said code repository.

4. The method of claim 2, further comprising notifying a developer of the lack of test cases to cover testing of said changed set of modules if said identifying identifies said set of test cases to be empty.

5. The method of claim 2, wherein said identifying by said static analysis comprises:

generating a reference data by inspecting the instructions forming said plurality of modules, wherein said reference data specifies for each module a corresponding set of modules contained in said plurality of modules that are referenced by said module;

finding, in response to said receiving, said referencing set of modules by examining said reference data;

adding said referencing set of modules to said changed set of modules to create a final changed set of modules; and

determining said set of test cases based on said final changed set of modules.

6. The method of claim 5, wherein said generating further comprises:

receiving, from a developer, additional data indicating that a first module is indirectly referenced by a second module, said first module and said second module being contained in said plurality of modules,

wherein said generating generates said reference data to specify that said first module is referenced by said second module based on said additional data.

7. The method of claim 5, wherein said finding comprises:

examining said reference data to identify said second set of modules, wherein each of said second set of modules has an immediate reference to at least one of said changed set of modules;

performing iteratively said examining to identify a plurality of levels of modules based on said second set of modules, wherein said second set of modules is considered as a first level of modules and each of a next level of modules has reference to at least one of a previous level of modules, said next level of modules and said previous level of modules being contained in said plurality of modules; and

including said second set of modules and said plurality of levels of modules in said referencing set of modules.

8. The method of claim 5, wherein a plurality of test cases are used to test said application, said method further comprising:

maintaining a mapping data specifying a corresponding one of a plurality of subsets of modules tested by each of said plurality of test cases, said plurality of subsets of modules being contained in said plurality of modules,

wherein said determining said set of test cases for a first module contained in said final changed set of modules comprises;

checking whether said first module is contained in said plurality of subsets of modules; and

including a first test case in said set of test cases only if said first module is contained in the corresponding subset of modules, said first test case being contained in said plurality of test cases.

9. The method of claim 8, wherein each of said plurality of modules corresponds to a code file containing instructions according to a programming language and each of said plurality of test cases corresponds to a test script containing instructions according to a scripting language, wherein said scripting language is different from said programming language.

10. The method of claim 5, wherein a plurality of test cases are used to test said application, wherein said plurality of test cases are also included in said plurality of modules forming said application, wherein said determining comprises:

checking whether each of said final changed set of modules is of a test case type; and

including the modules that are of said test case type in said set of test cases.

11. The method of claim 10, wherein each of said plurality of modules including said plurality of test cases corresponds to a code file containing instructions according to a programming language.

12. The method of claim 5, wherein said application is a multi-layered application with said plurality of modules belonging to a set of layers, wherein the modules for each of said set of layers is maintained in different code repositories, wherein said changed set of modules belong to a first layer contained in said set of layers, said method comprising:

checking, after said finding, whether said referencing set of modules includes a second module belonging to a second layer contained in said set of layers, said second layer being different from said first layer; and

notifying a developer of an interface mismatch between said first layer and said second layer if there exists said second module, wherein said interface mismatch corresponds to changes made to a first module contained in said final changed set of modules referenced by said second module,

whereby said developer is enabled to fix said interface mismatch before integration of said set of layers from different code repositories.

13. The method of claim 12, further comprising storing said reference data in a secondary storage after said generating,

wherein said finding finds said referencing set of modules after retrieving said reference data from said secondary storage without requiring said inspecting of the instructions forming the modules in layers other than said first layer.

14. The method of claim 5, wherein said plurality of modules forming said application is divided into a set of packages, with each package related a corresponding functionality provided by said application, wherein said changed set of modules is contained in a first package contained in said set of packages, said first package being related to a first functionality provided by said application, said method comprising:

checking whether said referencing set of modules includes a third module belonging to a third package contained in said set of packages, said third package being different from said first package and being related to a third functionality different from said first functionality;

notifying a code reviewer to review the impact of said first functionality on said third functionality if there exists said third module.

15. A system facilitating testing of an application in relation to changes to a set of modules contained in a plurality of modules forming said application, said system comprising:

a processor;

a random access memory (RAM); and

a machine readable medium to store a first set of instructions and a second set of instructions, wherein said first set of instructions when retrieved into said RAM and executed by said processor form said application, said second set of instructions when retrieved into said RAM and executed by said processor form a testing tool designed to perform the actions of;

identifying a set of test cases to cover testing of said changed set of modules and a second set of modules having a reference to any of said changed set of modules, wherein said second set of modules is identified by static analysis of said plurality of modules, said second set of modules being contained in said plurality of modules; and

running said set of test cases with said changed set of modules merged into said plurality of modules.

16. The system of claim 15, wherein said set of test cases is a minimal set that covers testing of all of said changed set of modules, and a referencing set of modules which reference any of said changed set of modules either as immediate reference or multi-level reference through other modules, said referencing set of modules including said second set of modules and being contained in said plurality of modules.

17. The system of claim 16, wherein said plurality of modules are maintained in a code repository, and wherein said testing tool performs said identifying before merging said changed set of modules with said application in said code repository.

18. The system of claim 16, wherein for said identifying by said static analysis, said testing tool performs the actions of:

generating a reference data by inspecting said first set of instructions forming said plurality of modules, wherein said reference data specifies for each module a corresponding set of modules contained in said plurality of modules that are referenced by said module;

finding said referencing set of modules by examining said reference data;

adding said referencing set of modules to said changed set of modules to create a final changed set of modules; and

determining said set of test cases based on said final changed set of modules.

19. The system of claim 18, wherein for said generating, said testing tool further performs the actions of:

receiving, from a developer, additional data indicating that a first module is indirectly referenced by a second module, said first module and said second module being contained in said plurality of modules,

wherein said generating generates said reference data to specify that said first module is referenced by said second module based on said additional data.

20. The system of claim 18, wherein for said finding, said testing tool performs the actions of:

examining said reference data to identify said second set of modules, wherein each of said second set of modules has an immediate reference to at least one of said changed set of modules;

performing iteratively said examining to identify a plurality of levels of modules based on said second set of modules, wherein said second set of modules is considered as a first level of modules and each of a next level of modules has reference to at least one of a previous level of modules, said next level of modules and said previous level of modules being contained in said plurality of modules; and

including said second set of modules and said plurality of levels of modules in said referencing set of modules.

21. The system of claim 18, wherein a plurality of test cases are used to test said application, said testing tool further performing the actions of:

maintaining a mapping data specifying a corresponding one of a plurality of subsets of modules tested by each of said plurality of test cases, said plurality of subsets of modules being contained in said plurality of modules,

wherein for said determining said set of test cases for a first module contained in said final changed set of modules, said testing tool performs the actions of;

checking whether said first module is contained in said plurality of subsets of modules; and

including a first test case in said set of test cases only if said first module is contained in the corresponding subset of modules, said first test case being contained in said plurality of test cases.

22. The system of claim 18, wherein a plurality of test cases are used to test said application, wherein said plurality of test cases are also included in said plurality of modules forming said application, wherein for said determining, said testing tool performs the actions of:

checking whether each of said final changed set of modules is of a test case type; and

including the modules that are of said test case type in said set of test cases.

23. A machine readable medium storing one or more sequences of instructions for causing a system to facilitate identifying of test cases to be run after changes to changes to any of a plurality of modules forming an application, wherein execution of said one or more sequences of instructions by one or more processors contained in said system causes said system to perform the actions of:

generating a reference data by inspecting the instructions forming said plurality of modules, wherein said reference data specifies for each module a corresponding set of modules contained in said plurality of modules that are referenced by said module;

receiving an indication that a set of modules have changed, wherein said set of modules is contained in said plurality of modules;

finding, based on said reference data, a referencing set of modules which reference any of said changed set of modules either as immediate reference or multi-level reference through other modules, said referencing set of modules being contained in said plurality of modules; and

determining a set of test cases to cover testing of said changed set of modules and said referencing set of modules.

24. The machine readable medium of claim 23, wherein said set of test cases is a minimal set that covers testing of all of said changed set of modules and said referencing set of modules.

25. The machine readable medium of claim 24, wherein said generating comprises one or more instructions for:

receiving, from a developer, additional data indicating that a first module is indirectly referenced by a second module, said first module and said second module being contained in said plurality of modules,

wherein said generating generates said reference data to specify that said first module is referenced by said second module based on said additional data.

26. The machine readable medium of claim 23, wherein said finding comprises one or more instructions for:

examining said reference data to identify a first level of modules, wherein each of said first level of modules has an immediate reference to at least one of said changed set of modules;

performing iteratively said examining to identify a plurality of levels of modules based on said first level of modules, wherein a next level of modules has reference to at least one of a previous level of modules; and

including said first level of modules and said plurality of levels of modules in said referencing set of modules,

wherein said first level of modules, said next level of modules and said previous level of modules are contained in said plurality of modules.

27. The machine readable medium of claim 23, wherein a plurality of test cases are used to test said application, further comprising one or more instructions for:

maintaining a mapping data specifying a corresponding one of a plurality of subsets of modules tested by each of said plurality of test cases, said plurality of subsets of modules being contained in said plurality of modules,

wherein said determining said set of test cases for a first module contained in said final changed set of modules comprises one or more instructions for;

checking whether said first module is contained in said plurality of subsets of modules; and

including a first test case in said set of test cases only if said first module is contained in the corresponding subset of modules, said first test case being contained in said plurality of test cases.

28. The machine readable medium of claim 27, wherein a plurality of test cases are used to test said application, wherein said plurality of test cases are also included in said plurality of modules forming said application, wherein said determining comprises one or more instructions for:

checking whether each of said final changed set of modules is of a test case type; and

including the modules that are of said test case type in said set of test cases.