Recursive use of model based test generation for middleware validation

• US 7,117,484 B2
• Filed: 04/16/2002
• Issued: 10/03/2006
• Est. Priority Date: 04/16/2002
• Status: Expired due to Fees

• Current Assignee: LinkedIn Corporation (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Sharon, Guy, Hartman, Alan, Nagin, Kenneth
• Primary Examiner(s): Zhen, Wei
• Assistant Examiner(s): RAMPURIA, SATISH
• Application Number:
  US10/122,427
• Publication Number:
  US 20030196191A1
• Time in Patent Office: 1,631 Days
• Field of Search: 717124-136, 717/100, 717104-105, 703 21- 23, 714/38, 716/2
• US Class Current: 717/126
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

Middleware is validated using a two layered modeling strategy for the generation of test suites. A high level model of the syntax of the programming language used to program the middleware generates a series of high level abstract programs. These high level abstract programs then undergo two separate translations. First they are translated directly into actual test programs, which are expressed in the programming language of the middleware. Second, they are translated into second models of the high level abstract programs. Running the model based test generator again on the second models produces a set of suites of test cases, each test case consisting of data inputs and predicted results for one of the actual test programs. The actual test programs are run repetitively using the middleware execution engine. The results are compared with the predicted results, using a generic validation engine.

Claims

1. A recursive computer-implemented model-based test generation method for validating a middleware application, comprising the steps of:

generating a model comprising an abstract program in accordance with specifications of said middleware application;

performing a first translation of said model into a set of test programs for programming said middleware application, said test programs comprising meta-data that are acceptable input for said middleware application;

performing a second translation of said model into a set of behavioral models that describe behavior of said middleware application responsively to an application of said meta-data thereto;

generating a set of test cases for each of said test programs according to said behavioral models, said test cases comprising test case data and predicted results;

executing said test programs using said test case data of said test cases therein to cause a stimulation of said middleware application;

observing actual results produced by said stimulation of said middleware application; and

determining validity of said middleware application by comparing said actual results with said predicted results.

2. The method according to claim 1, wherein said step of performing said second translation of said abstract program further comprises automatically generating a coverage criterion for said test cases.

3. The method according to claim 1, wherein said meta-data is expressed in a first language, and said behavioral models are expressed in a second language.

4. The method according to claim 1, wherein said specifications comprise an event definition.

5. The method according to claim 1, wherein said specifications comprise a lifespan definition.

6. The method according to claim 1, wherein said specifications comprise a situation definition.

7. The method according to claim 1, wherein said step of performing a first translation is performed using a translation table.

8. A computer software product for recursive model-based test generation to validate a middleware applications, including a computer-readable medium in which computer program instructions are stored, which instructions, when read by a computer, cause the computer to:

generate a model comprising an abstract program in accordance with specifications of said middleware application;

perform a first translation of said model into a set of test programs for programming said middleware application, said test programs comprising meta-data that are acceptable input for said middleware application;

perform a second translation of said model into a set of behavioral models that describe behavior of said middleware application responsively to an application of said meta-data thereto;

generate a set of test cases for each of said test programs according to said behavioral models, said test cases comprising test case data and predicted results;

execute said test programs using said test case data of said test cases therein to cause a stimulation of said middleware application;

observe actual results produced by said stimulation of said middleware application; and

determine validity of said middleware application by comparing said actual results with said predicted results.

9. The computer software product according to claim 8, wherein said computer is further instructed to automatically generate a coverage criterion for said test cases.

10. The computer software product according to claim 8, wherein said step of performing said second translation of said abstract program further comprises automatically generating a coverage criterion for said test cases.

11. The computer software product according to claim 8, wherein said meta-data is expressed in a first language, and said behavioral models are expressed in a second language.

12. The computer software product according to claim 8, wherein said specifications comprise an event definition.

13. The computer software product according to claim 8, wherein said specifications comprise a lifespan definition.

14. The computer software product according to claim 8, wherein said specifications comprise a situation definition.

15. The computer software product according to claim 8, wherein said computer is further instructed to perform said first translation using a translation table.

16. A recursive computer-implemented model-based test generation method for validating a middleware application, comprising the steps of:

using a test generator a first time to generate a first model comprising an abstract program in accordance with specifications of said middleware application;

performing a first translation of said first model into a set of test programs for programming said middleware application, said test programs comprising meta-data that are acceptable input for said middleware application;

performing a second translation of said first model into a set of second models that describe behavior of said middleware application responsively to an application of said meta-data thereto;

using said test generator a second time to generate a set of test cases for each of said test programs according to said second models, said test cases comprising test case data and predicted results;

executing said test programs using said test case data of said test cases therein to cause a stimulation of said middleware application;

observing actual results produced by said stimulation of said middleware application; and

determining validity of said middleware application by comparing said actual results with said predicted results.

17. The method according to claim 16, wherein said step of performing said second translation of said abstract program further comprises automatically generating a coverage criterion for said test cases.

18. The method according to claim 16, wherein said meta-data is expressed in a first language, and said second models are expressed in a second language.

19. The method according to claim 16, wherein said specifications comprise an event definition.

20. The method according to claim 16, wherein said specifications comprise a lifespan definition.

21. The method according to claim 16, wherein said specifications comprise a situation definition.

22. The method according to claim 16, wherein said step of performing a first translation is performed using a translation table.

23. A computer software product for recursive model-based test generation to validate a middleware application, including a computer-readable medium in which computer program instructions are stored, which instructions, when read by a computer, cause the computer to:

execute a test generator a first time to generate a first model comprising an abstract program in accordance with specifications of said middleware application;

perform a first translation of said first model into a set of test programs for programming said middleware application, said test programs comprising meta-data that are acceptable input for said middleware application;

perform a second translation of said first model into a set of second models that describe behavior of said middleware application responsively to an application of said meta-data thereto;

execute said test generator a second time to generate a set of test cases for each of said test programs according to said second models, said test cases comprising test case data and predicted results;

execute said test programs using said test case data of said test cases therein to cause a stimulation of said middleware application;

observe actual results produced by said stimulation of said middleware application; and

determine validity of said middleware application by comparing said actual results with said predicted results.

24. The computer software product according to claim 23, wherein said computer is further instructed to automatically generate a coverage criterion for said test cases.

25. The computer software product according to claim 23, wherein said step of performing said second translation of said abstract program further comprises automatically generating a coverage criterion for said test cases.

26. The computer software product according to claim 23, wherein said meta-data is expressed in a first language, and said second models are expressed in a second language.

27. The computer software product according to claim 23, wherein said specifications comprise an event definition.

28. The computer software product according to claim 23, wherein said specifications comprise a lifespan definition.

29. The computer software product according to claim 23, wherein said specifications comprise a situation definition.

30. The computer software product according to claim 23, wherein said computer is further instructed to perform said first translation using a translation table.

31. Apparatus for recursive model-based test generation to validate a middleware application, comprising:

a test generator operative a first time to generate a first model comprising an abstract program in accordance with specifications of said middleware application;

a processor operative to perform a first translation of said first model into a set of test programs for programming said middleware application, said test programs comprising meta-data that are acceptable input for said middleware application, said processor operative to perform a second translation of said first model into a set of second models that describe behavior of said middleware application responsively to an application of said meta-data thereto,

wherein said test generator is operative to generate a set of test cases for each of said test programs according to said second models, said test cases comprising test case data and predicted results;

an execution engine operative to cause a stimulation of said middleware application, wherein said test programs are a first input of said execution engine, and said test case data are a second input of said execution engine, and wherein actual results are produced by said stimulation of said middleware application; and

a validation engine for determining validity of said middleware application by comparing said actual results with said predicted results.

32. The apparatus according to claim 31, wherein said processor automatically generates a coverage criterion for said test cases.

33. The apparatus according to claim 31, wherein said meta-data is expressed in a first language, and said second models are expressed in a second language.

34. The apparatus according to claim 31, wherein said specifications comprise an event definition.

35. The apparatus according to claim 31, wherein said specifications comprise a lifespan definition.

36. The apparatus according to claim 31, wherein said specifications comprise a situation definition.