Agile Unit and Regression Testing Framework for Domain Specific Languages

• US 20130159963A1
• Filed: 06/12/2012
• Published: 06/20/2013
• Est. Priority Date: 12/15/2011
• Status: Active Grant

• Current Assignee: TATA Consultancy Services Limited (Tata Sons Pvt Ltd.)
• Original Assignee: TATA Consultancy Services Limited (Tata Sons Pvt Ltd.)
• Inventors: Dhalait, ShamimAhmad Dadamir
• Granted Patent: US 9,032,361 B2
• Time in Patent Office: Days
• US Class Current: 717/104
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

According to one aspect of the invention, a system and method for unit and regression testing has been developed. The system is capable to automate unit/regression test case preparation, remote execution, provide XML based assert mechanism to evaluate test results, maintenance and versioning. The present system enables model driven testing of domain specific languages and provides a user friendly mechanism to perform Unit and Regression Testing.

Claims

1. A method of unit and regression testing for model aware domain specific languages, the method comprising a processor implemented steps of:

a. modeling an operation present in a repository, each operation comprising a specification of designing requirements for testing, to generate an application library code;

b. generating a blank operation template from the application library code thereof corresponding to each operation, the blank operation template comprising an input XML and an expected output XML thereof;

c. building an executable unit test load to integrate business logic therein the each load by using predefined unit test stubs and system libraries;

d. executing the unit test load and comparing the resulting actual output XML with the expected output XML files to determine the state of the test cases;

e. identifying defects unveiled during the comparison and iteratively repeating the above steps b to d until the test cases gain a pass state; and

f. versioning of the test cases for the future reusability by selecting valid test cases.

2. The method of claim 1, wherein the operation refers to a unit testing module.

3. The method of claim 1, wherein the repository consists of artifacts but not limited to input XML files, expected output XML files, regression test suite metadata and the like.

4. The method of claim 1, wherein the input XML refers to the set of input test cases.

5. The method of claim 1, wherein the expected output XML refers to the results that are obtained post running of the test cases.

6. The method of claim 1, wherein the application library code provides functionalities of sophisticated memory management and object oriented view of database.

7. The method of claim 1, wherein the blank operation template refers to a template generated by MasterCraft.

8. The method of claim 1, wherein the unit test load comprises of dependent components of drive modules, object binaries and application code library.

9. The method of claim 1, wherein the state of the test case refers to either pass state or fail state.

10. A system of unit and regression testing for domain specific languages, the system comprising:

An input module configured to generate an input XML and an expected output XML;

a modeling unit adapted to accept input from a repository and generate an operation for testing;

Code generating module coupled with the repository and is configured to generate domain specific language code templates and an application library code for operations accessed from the repository;

Executing module configured to invoke a function that reads the input XML and call an unit test load to write the output to an output file;

comparing module adapted to assign a flag to the each compared test case, the flag indicating the state of the test case; and

a result generating module adapted to report defects unveiled during comparison and iteratively repeating the process until the test cases gains a pass state.

11. The system of claim 10, wherein the function refers to Job Control Language.

12. The system of claim 10, wherein the output file refers to the output file generated post execution of the test procedures.

13. The system of claim 10, wherein the operation refers to a unit testing module.

14. The system of claim 10, wherein the repository consists of artifacts including but not limited to input XML files, expected output XML files, regression test suite metadata and the like.

15. The system of claim 10, wherein the input XML comprises of refers to the set of input test cases.

16. The system of claim 10, wherein the expected output XML refers to the results that are obtained post running of the test cases.

17. The system of claim 10, wherein the application library code provides functionalities of sophisticated memory management and object oriented view of database.

18. The system of claim 10, wherein the blank operation template refers to a template generated by MasterCraft.

19. The system of claim 10, wherein the unit test load comprises of dependent components of drive modules, object binaries and application code library.

20. The system of claim 10, wherein the state of the test case refers to either pass state or fail state.