Method and System for Test Case Generation

• US 20080294941A1
• Filed: 06/30/2005
• Published: 11/27/2008
• Est. Priority Date: 07/01/2004
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Copstein, Bernardo, Reginato, Lucas Rosa Cruz, Gobbi Farina, Andre, De Oliveria, Flavio Modeira
• Granted Patent: US 7,685,468 B2
• Time in Patent Office: Days
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

A method and apparatus is described for generating a test case for an application or system modelled using a Stochastic Automata Network model. The method contemplates the inclusion of a plurality of automata and including the steps of: (a) setting an initial global state as the current global state, wherein a global state comprises a set of local states each corresponding to one of the automata; (b) creating a record of the initial global state; (c) selecting an event from a set of events that can be applied to the current global state; creating record of the selected event; (e) identifying those of the automata affected by the selected event and updating the current global state by updating the states of the affected automata; (f) creating a record of the current global state; and repeating steps (c) to (f) until a termination condition is satisfied. The invention may also be used for the generation of test scripts. In terms of specific usage case, the invention may be used for software reliability testing and for fault-tolerance measurements.

Claims

1. A method of generating a test case for an application or system modelled using a Stochastic Automata Network model Including a plurality of automata, including the steps of:

a) setting an initial global state as the current global state (100), wherein a global state comprises a set of local states each corresponding to one of the automata;

b) creating a record of the initial global state (101);

c) selecting an event (103) from a set of events that can be applied to the current global state;

d) creating a record of the selected event (104);

e) identifying those of the automata affected by the selected event (105) and updating the current global state by updating the states of the affected automata (106);

f) creating a record of the current global state (107); and

repeating steps c) to f) until a termination condition is satisfied.

2. A method as claimed in claim 1, wherein step a) comprises selecting an initial global state from a set of possible initial global states.

3. A method as claimed in claim 2, wherein step a) comprises selecting an initial global state from the set of possible initial global states based on the relative probabilities of the possible initial global states.

4. A method as claimed in claim 1, wherein step c) comprises selecting one of the events from the set of events based on the relative probabilities of the events in the set of events.

5. A method as claimed in claim 1, wherein step c) comprises enumerating the set of candidate events (102) that can be applied to the current global state before selecting one of the candidate events.

6. A method as claimed in claim 5, wherein step c) Includes calculating the relative probabilities of the events In the set of events and selecting one of the events based on the relative probabilities.

7. A method as claimed In claim 1, wherein step e) includes the following steps:

e1) determining whether the selected event is local or synchronising;

e2) if the selected event Is local, updating the current global state by updating the state of the affected automaton;

e3) if the selected candidate eVent is synchronising, determining those of the automata affected by the selected event, and updating the current global state by updating the states of the affected automata.

8. A method as claimed in claim 1, wherein the record of the initial global state and the records of selected events and current global states together form a test case description.

9. A method as claimed in claim 1, wherein the termination condition is satisfied when the event selected in step d) is a termination event.

10. A method as claimed in claim 1, wherein the termination condition is satisfied when a predetermined number of records have been created in step e).

11. A method as claimed in claim 1, wherein the current global state is updated in step e) according to transition probabilities.

12. A method of generating a predetermined number of test cases, including:

g) determining a target number of test cases (201);

h) generating a test case by the method of claim 1; and

j) repeating step h) until the target number of test cases is reached.

13. A method as claimed in claim 12, including the step of enumerating a set of possible initial global states (202) before step h).

14. A method of generating a test case for an application or system, including:

creating a model of the application or system using a Stochastic Automata Network; and

generating a test case by the method of claim 1.

15. A method as claimed in claim 14, wherein environmental requirements are explicit in the model.

16. An apparatus for generating a test case for an application or system, the apparatus including memory (211, 212) and a processor (210), characterised in that the memory (211,212) Is configured to store data related to a Stochastic Automata Network based model of the application or system, the Stochastic Automata Network including a plurality of automata, and in that the processor (210) is configured to:

a) select an initial global state from a set of possible initial global states stored in the memory (211,212), each global state comprising a set of local states each corresponding to one of the automata,

b) set the selected initial global state as the current global state;

c) store a record of the current global state in the memory (211,212);

d) select an event from a set of events that can be applied to the current global state, from a set of possible events stored in the memory (211,212);

e) store a record of the selected event In the memory (211,212);

f) identify those of the automata affected by the selected event and update the current global state by updating the local states of the affected automata; and

g) store a record of the updated current global state in the memory (211,212).

17. An apparatus as claimed in claim 16, wherein the processor (210) is configured to perform the operations a) to g) sequentially.

18. An apparatus as claimed in claim 17, wherein the processor (210) is configured to repeat the operations d) to g) until a termination condition is satisfied.

22. A testing apparatus as claimed in claim 17, wherein the processor (210) is further configured to test the application or system by running the application or system using a test case comprising the records of global states and events stored in memory (211,212).

23. A testing apparatus as claimed in claim 22, including an output unit configured to output the results of the test.

24. A testing apparatus as claimed In claim 23, including an input device configured to allow a user to assist in the preparation of a Stochastic Automata Network based model and the processor being configured to store the model (210) in the memory (211,212) when the preparation of the model is complete.

19. A testing apparatus Including a processor (210) and memory (211,212), the memory being configured to store data related to a Stochastic Automata Network based model of an application or system, the Stochastic Automata Network including a plurality of automata, and the processor (210) being configured to:

a) select an Initial global state from a set of possible initial global states stored in the memory, each global state comprising a set of local states each corresponding to one of the automata.

b) set the selected initial global state as the current global state;

c) store a record of the current global state in the memory (211,212);

d) select an event from a set of events that can be applied to the current global state, from a set of possible events stored in the memory (211,212);

e) store a record of the selected event in the memory (211,212);

f) identify those of the automata affected by the selected event and update the current global state by updating the local states of the affected automata; and

g) store a record of the updated current global state in the memory (211,212).

20. A testing apparatus as claimed in claim 19, wherein the processor (210) is configured to perform the operations a) to g) sequentially.

21. A testing apparatus as claimed in claim 20, wherein the processor (210) is configured to repeat the operations d) to g) until a termination condition is satisfied.