Automatic statistical test sequence generator and methods thereof

• US 6,792,377 B1
• Filed: 07/01/2002
• Issued: 09/14/2004
• Est. Priority Date: 03/12/2002
• Status: Expired due to Term

• Current Assignee: Calient Networks Incorporated
• Original Assignee: Calient Networks Incorporated
• Inventors: Agrawal, Kaushal K., Wong, David N. K.
• Primary Examiner(s): Cherry, Stephen J
• Application Number:
  US10/188,211
• Time in Patent Office: 806 Days
• Field of Search: 714/33, 714/37, 714/736, 714/738, 702/117, 702/119, 716/4, 716/5, 379/1.01, 379/10.01, 379/26.01, 379/9.01, 379/9.02
• US Class Current: 702/119
• CPC Class Codes: H04M 3/22 Arrangements for supervision, monitoring or testing
• CPC Class Codes: H04M 3/36 Statistical metering, e.g. recording occasions when traffic exceeds capacity of trunks

Abstract

A TL1 usage model generator arranged to provide a statistically accurate usage model based upon a particular user profile is described. The TL1 usage model generator is connected to a translator arranged to expand the usage model provided the by TL1 usage model generator into a fully meshed file. Coupled to the translator, a TL1 sequence generator uses the fully meshed file to automatically generate a random sequence of TL1 commands that is provided to an execution engine configured to read the random sequence of TL1 commands. The execution engine, in turn, sends the random sequence of TL1 commands to the system under test (SUT) the results of which are forwarded to and written in a result data base used by a post processor to verify the validity of the system response.

Claims

1. A statistical test tool for operational testing of a system under test (SUT), comprising:

a user specific usage model generator arranged to provide a statistically accurate user specific usage model based upon a particular user profile;

a translator coupled to the usage model generator arranged to expand the usage model provided the by the usage model generator into a fully meshed file; and

a sequence generator coupled to the translator that uses the fully meshed file to automatically generate a random sequence of commands.

2. A statistical test tool for operational testing of a system under test as recited in claim 1, further comprising:

an execution engine coupled to the sequence generator configured to,

read the random sequence of commands, and

send the random sequence of commands to the system under test (SUT) wherein the SUT generates a system response based upon the random sequence of commands.

3. A statistical test tool for operational testing of a system under test as recited in claim 1, wherein the usage profile comprises:

a test command model that contains a plurality of expected user system test commands; and

a user specific probability profile that contains a plurality of probability indices each of which corresponds to a particular one of the plurality of expected user system test commands.

4. A statistical test tool for operational testing of a system under test as recited in claim 1, wherein the test command model comprises:

a hierarchically ordered test structure formed of a plurality of hierarchically ordered test layers each of which includes,

a test layer entry point,

a plurality of associated test components, and

a test layer exit point,

wherein a highest order test layer includes a start node arranged to provide a test structure entry point and a stop node arranged to provide a test structure exit point.

5. A statistical test tool for operational testing of a system under test as recited in claim 4, wherein the fully meshed file includes most transitions of a particular test component to any other test component, including itself, on a specific test layer.

6. A statistical tool as recited in claim 5, wherein the sequence generator comprises:

a random number generator suitable for providing a random number;

a state walk generator arranged to randomly select a particular test structure node at a current test layer such that a new command is generated and recorded whenever the particular test structure node is not the exit node and the current test layer is a lowest current layer.

7. A test tool as recited in claim 1, wherein the test tool is a TL1 test tool.

8. A method for providing a statistical test tool for operational testing of a system under test (SUT), comprising:

providing a statistically accurate user specific usage model based upon a particular user profile;

expanding the usage model provided the by the usage model generator into a fully meshed file; and

automatically generating a random sequence of commands based upon the fully meshed file.

9. A method as recited in claim 8, further comprising:

reading the random sequence of commands;

sending the random sequence of commands to the system under test (SUT); and

generating a system response based upon the random sequence of commands by the SUT.

10. A method as recited in claim 8, wherein the usage profile comprises:

a test command model that contains a plurality of expected user system test commands; and

a user specific probability profile that contains a plurality of probability indices each of which corresponds to a particular one of the plurality of expected user system test commands.

11. A method as recited in claim 8, wherein the test command model comprises:

a hierarchically ordered test structure formed of a plurality of hierarchically ordered test layers each of which includes,

a test layer entry point,

a plurality of associated test components, and

a test layer exit point,

wherein a highest order test layer includes a start node arranged to provide a test structure entry point and a stop node arranged to provide a test structure exit point.

12. A method as recited in claim 11, wherein the fully meshed file includes most transitions of a particular test component to any other test component, including itself, on a specific test layer.

13. A method as recited in claim 12, further comprising:

providing a random number;

randomly selecting a particular test structure node at a current test layer; and

generating and recording a new command whenever the particular test structure node is not the exit node and the current test layer is a lowest current layer.

14. A test tool as recited in claim 8, wherein the test tool is a TL1 test tool.

15. An apparatus for providing a statistical test tool for operational testing of a system under test (SUT), comprising:

means for providing a statistically accurate user specific usage model based upon a particular user profile;

means for expanding the usage model provided by the usage model generator into a fully meshed file; and

means for automatically generating a random sequence of commands based upon the fully meshed file.

16. An apparatus as recited in claim 15, further comprising:

means for reading the random sequence of commands;

means for sending the random sequence of commands to the system under test (SUT); and

means for generating a system response based upon the random sequence of commands by the SUT.

17. An apparatus as recited in claim 15, wherein the usage profile comprises:

a test command model that contains a plurality of expected user system test commands; and

a user specific probability profile that contains a plurality of probability indices each of which corresponds to a particular one of the plurality of expected user system test commands.

18. An apparatus as recited in claim 15, wherein the test command model comprises:

a hierarchically ordered test structure formed of a plurality of hierarchically ordered test layers each of which includes,

a test layer entry point,

a plurality of associated test components, and

a test layer exit point,

wherein a highest order test layer includes a start node arranged to provide a test structure entry point and a stop node arranged to provide a test structure exit point.

19. An apparatus as recited in claim 18, wherein the fully meshed file includes all transitions of a particular test component to any other test component, including itself on a specific test layer.

20. An apparatus as recited in claim 19, further comprising:

means for providing a random number;

means for randomly selecting a particular test structure node at a current test layer, and

means for generating and recording a new command whenever the particular test structure node is not the exit node and the current test layer is a lowest current layer.

21. An apparatus as claimed in claim 15, wherein said apparatus is a TL1 test tool.

22. A TL1 based statistical test tool for operational testing of a system under test (SUT), comprising:

a TL1 usage model generator arranged to provide a statistically accurate usage model based upon a particular user profile;

a translator coupled to the TL1 usage model generator arranged to expand the usage model provided the by TL1 usage model generator into a fully meshed file;

wherein the fully meshed file includes all transitions of a particular test component to any other test component, including itself on a specific test level;

a TL1 sequence generator coupled to the translator that uses the fully meshed file to automatically generate a random sequence of TL1 commands; and

an execution engine coupled to the TL1 sequence generator configured to,

read the random sequence of TL1 commands, and

send the random sequence of TL1 commands to the system under test (SUT) wherein the SUT generates a system response based upon the random sequence of TL1 commands.