Methods, systems and computer program products for test scenario based communications network performance testing

• US 5,881,237 A
• Filed: 09/10/1996
• Issued: 03/09/1999
• Est. Priority Date: 09/10/1996
• Status: Expired due to Term

• Current Assignee: Ixia (Keysight Technologies, Inc.)
• Original Assignee: Ganymede Software, Inc. (Open Text Corporation)
• Inventors: Joyce, Steven Thomas, Schwaller, Peter James, Walker, John Quillian II, Huntley, Timothy Scott
• Primary Examiner(s): Ramirez, Ellis B.
• Application Number:
  US08/711,195
• Time in Patent Office: 910 Days
• Field of Search: 395/200.54, 395/182.02, 395/183.19, 395/200.76, 395/200.79, 364/578, 702/186, 702/187
• US Class Current: 709/224
• CPC Class Codes: H04L 41/145 involving simulating, designing, planning or modelling of a network
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 43/0888 Throughput
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

Communications network performance is tested utilizing a test scenario simulating actual communications traffic on the network to be tested. A console node is provided on the network for establishing the test scenario and assigning the test scenario to endpoint nodes on the network to be tested. Each endpoint node is assigned an endpoint node specific test protocol. Execution of the test protocols by the endpoint nodes is initiated by the console node. Performance data such as throughput, transaction rate and response time may be monitored at selected ones of the endpoint nodes and reported to the console node either as it is generated or after completion of the test. The test scenario may be terminated when all endpoint node specific test protocols have completed execution or when any one endpoint completes execution of its test protocol. Multiple network protocols may be utilized within a single test scenario. Each endpoint node specific test protocol includes an associated script representing a type of applications traffic such as a credit check, or a database update. Endpoint nodes execute tests as applications level programs on existing endpoint nodes on the network to be tested allowing testing of networks using actual protocol stacks independent of the applications programs available on existing endpoint nodes.

Claims

1. A method for testing the performance of a communications network including a plurality of endpoint nodes comprising the steps of:

adding a console node to the network;

defining a test scenario to simulate communications traffic between the endpoint nodes to be tested including selecting a plurality of endpoint nodes for the test scenario and defining endpoint information including an endpoint node specific test protocol for each of the selected endpoint nodes;

communicating the endpoint information over the network from the console node to the selected endpoint nodes;

initiating execution of the endpoint node specific test protocols on the selected endpoint nodes from the console node; and

,

monitoring the performance of the network while the endpoint node specific test protocols are executed to obtain performance data.

2. A method for testing performance of a communications network according to claim 1 wherein the network is a computer network and wherein the console node resides on a computer.

3. A method for testing performance of a communications network according to claim 2 wherein the console node is executed as an applications level program on a computer.

4. A method for testing performance of a communications network according to claim 2 wherein at least two of the plurality of endpoint nodes reside in a single computer.

5. A method for testing performance of a communications network according to claim 2 wherein said initiating step includes the step of synchronizing initiating the execution on the selected endpoint nodes of the endpoint node specific test protocols.

6. A method for testing performance of a communications network according to claim 2 wherein said step of defining a test scenario is preceded by the step of detecting the communications capabilities of at least one of the endpoint nodes from the console node.

7. A method for testing performance of a communications network according to claim 2 wherein said step of defining a test scenario is preceded by the step of detecting active protocol stacks on at least one of the endpoint nodes from the console node.

8. A method for testing performance of a communications network according to claim 2 wherein said monitoring step is followed by the step of terminating execution of all the endpoint node specific test protocols when one of the endpoint node specific test protocols completes execution.

9. A method for testing performance of a communications network according to claim 2 wherein said monitoring step is followed by the step of analyzing the monitored performance data to generate performance measurements selected from the group consisting of throughput, transaction rate and response time.

10. A method for testing performance of a communications network according to claim 9 wherein the generated performance measurements are selected from the group consisting of throughput and transaction rate.

11. A method for testing performance of a communications network according to claim 2 wherein the endpoint node specific test protocols include information selected from the group consisting of a type of data to transmit, how many times to transmit the data, what portion of the endpoint node specific test protocols to time during execution, and what acknowledgment to receive during execution of the endpoint node specific test protocols.

12. A method for testing performance of a communications network according to claim 11 wherein the endpoint information includes a network protocol.

13. A method for testing performance of a communications network according to claim 2 wherein a plurality of said endpoint node specific test protocols include a test protocol script selected from the group consisting of credit check, database update, file transfer, inquiry and packet transmit and wherein a plurality of different test protocol scripts are included in said test scenario.

14. A method for testing performance of a communications network including a plurality of endpoint nodes comprising the steps of:

determining a type of application communication traffic expected on the communications network;

adding a console node to the network;

defining a test scenario to simulate the expected type of application communication traffic between the endpoint nodes to be tested including selecting a plurality of endpoint nodes for the test scenario and defining endpoint information including an endpoint node specific test protocol for each of the selected endpoint nodes;

communicating the endpoint information over the network from the console node to the selected endpoint nodes;

initiating execution of the endpoint node specific test protocols on the selected endpoint nodes from the console node;

monitoring the performance of the network at at least one of the selected endpoint nodes while the endpoint node specific test protocols are executed;

terminating execution of all the endpoint node specific test protocols when one of the endpoint node specific test protocols completes execution; and

, then

reporting the monitored performance data from said monitoring step to the console node.

15. A method for testing performance of a communications network according to claim 14 wherein said reporting step is followed by the step of removing invalid results from said reported monitored performance data.

16. A method for testing performance of a communications network according to claim 14 wherein said reporting step is followed by the step of analyzing the reported monitored performance data to generate performance measurements.

17. A communications network performance testing system for testing a communications network including a plurality of endpoint nodes and a console node comprising:

means for defining a test scenario to simulate communications traffic between said endpoint nodes to be tested including selecting a plurality of said endpoint nodes for said test scenario and defining endpoint information including an endpoint node specific test protocol for each of said selected endpoint nodes;

means operatively connected to said means for defining for communicating said endpoint information over said network from said console node to said selected endpoint nodes;

means operatively connected to said network for initiating execution of said endpoint node specific test protocols on said selected endpoint nodes from said console node; and

means operatively connected to said network for monitoring performance of said network while said endpoint node specific test protocols are executed to obtain performance data.

18. A communications network performance testing system according to claim 17 where in said network is a computer network and wherein said console node resides on a computer.

19. A communications network performance testing system according to claim 18 wherein said console node is executed as an applications level program on said computer.

20. A communications network performance testing system according to claim 18 wherein at least two of said plurality of endpoint nodes reside in a single computer.

21. A communications network performance testing system according to claim 18 wherein said means for initiating includes means for synchronizing initiating execution on said selected endpoint nodes of said endpoint node specific test protocols.

22. A communications network performance testing system according to claim 18 further including means operatively connected to said network for detecting a communications capability of at least one of said endpoint nodes.

23. A communications network performance testing system according to claim 18 further including means operatively connected to said network for detecting active protocol stacks on at least one of said endpoint nodes.

24. A communications network performance testing system according to claim 18 further comprising means for terminating execution of all of said endpoint node specific test protocols when one of said endpoint node specific test protocols completes execution.

25. A communications network performance testing system according to claim 18 wherein said means for monitoring includes means for receiving said performance data from at least one of said selected endpoint nodes at said console node.

26. A communications network performance testing system according to claim 25 further including means operatively associated with said means for monitoring for analyzing said received performance data to generate performance measurements selected from the group consisting of throughput, transaction rate and response time.

27. A communications network performance testing system according to claim 26 wherein said performance measurements are selected from the group consisting of throughput and transaction rate.

28. A communications network performance testing system according to claim 18 wherein said endpoint node specific test protocols include information selected from the group consisting of a type of data to transmit, how many times to transmit said data, what portion of said endpoint node specific test protocols to time during execution, and what acknowledgment to receive during execution of said endpoint node specific test protocols.

29. A communications network performance testing system according to claim 28 wherein said endpoint information includes a network protocol.

30. A communications network performance testing system according to claim 18 wherein a plurality of said endpoint node specific test protocols include a test protocol script selected from the group consisting of credit check, database update, file transfer, inquiry and packet transmit and wherein a plurality of different test protocol scripts are included in said test scenario.

31. A computer program product for testing performance of a communications network including a plurality of endpoint nodes and a console node, the computer program product comprising:

a computer-readable storage medium having computer-readable program code means embodied in said medium, said computer-readable program code means comprising;

computer-readable program code means for defining a test scenario to simulate communications traffic between said endpoint nodes to be tested including selecting a plurality of endpoint nodes for said test scenario and defining endpoint information including an endpoint node specific test protocol for each of said selected endpoint nodes;

computer-readable code means operatively connected to said computer-readable code means for defining for communicating said endpoint information over said network from said console node to said selected endpoint nodes;

computer-readable code means operatively connected to said network for initiating execution of said endpoint node specific test protocols on said selected endpoint nodes from said console node; and

computer-readable code means operatively connected to said network for monitoring performance of said network while said endpoint node specific test protocols are executed to obtain performance data.

32. A computer program product according to claim 31 wherein said computer-readable code means for initiating includes computer-readable code means for synchronizing initiating the execution on said selected endpoint nodes of said endpoint node specific test protocols.

33. A computer program product according to claim 31 further including computer-readable code means for detecting a communications capability of at least one of said endpoint nodes over said network.

34. A computer program product according to claim 31 further including computer-readable code means for detecting active communication stacks on at least one of said endpoint nodes over said network.

35. A computer program product according to claim 31 further comprising computer-readable code means for terminating execution of all of said endpoint node specific test protocols when one of said endpoint node specific test protocols completes execution.

36. A computer program product according to claim 31 wherein said computer-readable code means for monitoring includes computer-readable code means for receiving said performance data from at least one of said selected endpoint nodes at said console node.

37. A computer program product according to claim 36 further including computer-readable code means operatively associated with said computer-readable code means for monitoring for analyzing said received performance data to generate performance measurements selected from the group consisting of throughput, transaction rate and response time.

38. A computer program product according to claim 37 wherein said performance measurements are selected from the group consisting of throughput and transaction rate.

39. A computer program product according to claim 31 wherein said endpoint node specific test protocols include information selected from the group consisting of a type of data to transmit, how many times to transmit said data, what portion of said endpoint node specific test protocols to time during execution, and what acknowledgment to receive during execution of said endpoint node specific test protocols.

40. A computer program product according to claim 39 wherein said endpoint information includes a network protocol.

41. A computer program product according to claim 31 wherein a plurality of said endpoint node specific test protocols include a test protocol script selected from the group consisting of credit check, database update, file transfer, inquiry and packet transmit and wherein a plurality of different test protocol scripts are included in said test scenario.