Automated testing

• US 20010052089A1
• Filed: 04/18/2001
• Published: 12/13/2001
• Est. Priority Date: 04/27/2000
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Johansson, Stefah, Gustavsson, Johan
• Granted Patent: US 6,804,796 B2
• Time in Patent Office: Days
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3692 for test results analysis

Abstract

A method and a test tool 110 are provided for verifying the functionality of a software based unit 100 which is provided with an interface 105 for its external communication. Pre-recorded data is used for the reproduction of a test case and for the verification of a unit subject to the test case. The pre-recorded data includes pre-recorded input data 125 and pre-recorded output data 126. The pre-recorded input data is applied to an interface of the unit and the pre-recorded output data is compared with the data transmitted from the unit in response to the applied pre-recorded input data. If the data transmitted from the unit is in correspondence with the pre-recorded output data, the functionality of the unit in accordance with the specific test case has been verified.

Claims

1. A method for verifying the functionality of a software based unit, the unit being provided with an interface for its external communication, the method comprising:

placing an external test tool in operative communication with the software based unit by means of a packet data connection, wherein data applied to, and received from, said interface is included in data packets;

recovering pre-recorded input data relating to a predefined test case and applying said input data on said interface;

recovering pre-recorded output data having a verified relation with the prerecorded input data;

replacing at least part of said pre-recorded output data with functional relationships between said pre-recorded input data and said pre-recorded output data, obtaining a set of functional output data; and

comparing the output data received from said packet data protocol interface with said set of functional output data.

2. The method as claimed in

claim 1

, wherein said test tool includes at least one state machine for simulating a signalling sequence of a corresponding protocol which is used by an authentic external unit normally communicating with said software based unit.

3. The method as claimed in

claim 1

, including the acts of:

deriving relations between pieces of the pre-recorded input data and its corresponding pre-recorded output data; and

storing the derived relations in said test tool as functional relationships.

4. The method as claimed in

claim 2

, including the acts of:

deriving relations between pieces of the pre-recorded input data and its corresponding pre-recorded output data; and

storing the derived relations in said test tool as functional relationships.

5. The method as claimed in

claim 1

, wherein said software based unit, or a unit of the same type as said software based unit, in an initial act is arranged to communicate with an authentic external unit over said interface and in accordance with said predefined test case, including the acts of:

recording input data terminating in said interface during said test case;

recording output data originating from said interface during said test case;

verifying the recorded output data; and

storing at least part of the recorded input data as said pre-recorded input data and at least part of the recorded output data as said pre-recorded output data for later retrieval by said test tool when said test tool simulates an authentic external unit.

6. The method as claimed in

claim 2

, wherein said software based unit, or a unit of the same type as said software based unit, in an initial act is arranged to communicate with an authentic external unit over said interface and in accordance with said predefined test case, including the acts of:

recording input data terminating in said interface during said test case;

recording output data originating from said interface during said test case;

verifying the recorded output data; and

storing at least part of the recorded input data as said pre-recorded input data and at least part of the recorded output data as said pre-recorded output data for later retrieval by said test tool when said test tool simulates an authentic external unit.

7. The method as claimed in

claim 5

, including the acts of:

deriving relations between pieces of the pre-recorded input data and its corresponding pre-recorded output data; and

storing the derived relations in said test tool as functional relationships.

8. The method as claimed in

claim 5

, including

removing unnecessary real-time information from the recorded input and output data.

9. The method as claimed in

claim 8

, wherein said real-time information includes data sequence numbers and/or time information.

10. The method as claimed in

claim 1

, wherein the verification of said software based unit includes performing a number of different predefined tests in a sequence.

11. The method as claimed in

claim 1

, wherein said test tool simulates a Short Message Service Center, SMS-C, included in a Global System for Mobile Communication, GSM, network.

12. The method as claimed in

claim 1

, wherein the communication between said test tool and said software based unit is in accordance with a mail transfer protocol.

13. A test tool for verifying the functionality of a software based unit, the software based unit being provided with an interface for its external communication, the test tool comprising:

a) interface means for enabling operative communication with the software based unit by means of a packet data connection, wherein the communicated data is included in data packets;

b) processing means for;

reading pre-recorded input data relating to a predefined test case;

applying the pre-recorded input on said software based unit via said interface means;

reading pre-recorded output data relating to said predefined test case, the pre-recorded output data having a verified relation with the pre-recorded input data;

replacing at least part of said pre-recorded output data with functional relationships between said pre-recorded input data and said pre-recorded output data, obtaining a set of functional output data; and

comparing the output data received from said software based unit via said interface means with said set of functional output data; and

c) memory means for storing said functional relationships to be provided to said processing means.

14. The test tool as claimed in

claim 13

, wherein the execution of said processing means is controlled by at least one state machine which simulates a signalling sequence of a corresponding protocol which is used by an authentic external unit normally communicating with said software based unit.

15. The test tool as claimed in

claim 13

, wherein said processing means are further provided for:

deriving relations between pieces of said pre-recorded input data and its corresponding pre-recorded output data; and

storing the derived relations in said memory means as functional relationships.

16. The test tool as claimed in

claim 14

, wherein said processing means are further provided for:

deriving relations between pieces of said pre-recorded input data and its corresponding pre-recorded output data; and

storing the derived relations in said memory means as functional relationships.

17. The test tool as claimed in

claim 15

, wherein said processing means are arranged to remove unnecessary real-time information from the recorded input and output data.

18. The test tool as claimed in

claim 17

, wherein said real-time information includes data sequence numbers and/or time information.

19. The test tool as claimed in

claim 13

, wherein said processing means is arranged to compare received output data with pre-recorded output data for a number of different predefined tests in a sequence, in order for the test tool to verify said software based unit.

20. The test tool as claimed in

claim 13

, wherein said state machine is defined to operate in accordance with a protocol used by a Short Message Service Center, SMS-C, of a specific type, which SMS-C is included in a Global System for Mobile Communication, GSM, network.

21. The test tool as claimed in

claim 13

, wherein said interface means is adapted to communicate with said software based unit in accordance with a mail transfer protocol.