Performance testing of a network segment between test appliances

• US 10,621,075 B2
• Filed: 12/30/2014
• Issued: 04/14/2020
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Spirent Communications Incorporated
• Original Assignee: Spirent Communications Incorporated
• Inventors: Buege, Brian
• Primary Examiner(s): Zarka, David P
• Application Number:
  US14/586,180
• Publication Number:
  US 20160191349A1
• Time in Patent Office: 1,932 Days
• Field of Search: 709224
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: H04L 41/5067 Customer-centric QoS measurements
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 43/06 Generation of reports
• CPC Class Codes: H04L 43/062 related to network traffic
• CPC Class Codes: H04L 43/067 using time frame reporting
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 43/55 Testing of service level quality, e.g. simulating service usage
• CPC Class Codes: H04L 47/19 at layers above the network layer network arrangements for networked applications for scheduling or organising the servicing of application requests H04L67/60

Abstract

Computer networks include multiple hardware and software devices, each working together to provide a favorable user experience to an operator. Many of these devices are built to standards that have been published by international standards organizations. These standards include functional test criteria that, when executed successfully, assure functionality of the device within a group of devices. The technology disclosed maintains libraries of canned tests based on these published standards. In addition, the technology disclosed can collect, adapt, and execute sets of predefined transactions to a target test network. This will validate that the target test network can scale up to a desired combination of transactions of different types. This is accomplished by manipulating example transaction sets captured from probes or routers that save network accounting records from a model network.

Claims

1. A method of generating a mix of network traffic types for conducting a network test on a target network segment between first and second test appliances configured respectively as a test generator and a test responder and connected to the network segment of a network under test, the method including:

accessing at least a summary of historical network accounting records that include network traffic type distribution among supported application layer protocols identified in flows in the network under test;

for at least one time interval in the historical network accounting records, using a processor to generate a test traffic mix profile among the supported application layer protocols from analysis of the historical network accounting records;

loading the test traffic mix profile into memory of a network test appliance;

adapting the test traffic mix profile responsive to user input specifying at least a range of test traffic loads, identifiers of first and second test appliances, and network addresses to use for the first and second test appliances;

initiating over a network connection, a performance test of the target network segment that lies between the first and second test appliances disposed at different sides of the network connection including a server side and a client side;

wherein (i) the first test appliance, acting as a test generator, regenerates adapted network traffic by simulating activity, of one or more of a plurality of network devices of a first side selected from the client side and the server side of the network segment of the network under test, as captured in the historical network accounting records that were used to generate the adapted test traffic mix profile and (ii) the second test appliance acting as a test traffic responder, responds to the traffic generated by the first test appliance by simulating activity, of one or more of a plurality of network devices of a second side selected from the client side and the server side of the network segment of the network under test, as captured in the historical network accounting records; and

measuring and reporting test results from conducting the performance test upon the target network segment.

2. The method of claim 1, further including:

generating test traffic mix profiles for multiple time intervals; and

running the performance test against the multiple time intervals without requiring user intervention between the time intervals.

3. The method of claim 1, further including:

generating test traffic mix profiles for multiple time intervals and at least relative load factors;

modifying application of the range of test traffic loads to the multiple time intervals based on the relative load factors; and

running the performance test against the multiple time intervals without requiring user intervention between the time intervals.

4. The method of claim 1, further including:

wherein the historical network accounting records of network traffic volume indicate network traffic volume statistics for the network traffic types;

calculating a distribution of network traffic volume from the historical network accounting records; and

varying test traffic load during the time interval corresponding to the historical network traffic volume distribution.

5. The method of claim 1, wherein the network traffic types of supported application protocols include at least BitTorrent, FTP, Gnutella, Gtalk, HTTP, LDAP, MySQL, Oracle, Raw TCP, Remote Desktop, Skype, SMB, SQL, Telepresence, Video, Video Call, and Voice Call.

6. The method of claim 1, wherein the network traffic types of supported application protocols include at least BitTorrent, BitTorrent Bandwidth, BitTorrent Tracker Traffic, FTP, Gnutella 1, Gnutella 2, HTTP, MySQL, NFS, SMB, and SQL.

7. The method of claim 1, wherein the network traffic types of supported application protocols include at least Gtalk, HTTP, Raw TCP, Skype TCP, Telepresence, Video, Video Call, Voice Call, and Yahoo Commands Only.

8. The method of claim 1, wherein the network traffic types of supported application protocols include at least BitTorrent, BitTorrent Bandwidth, BitTorrent Tracker Traffic, FTP, Gnutella 1, Gnutella 2, Gtalk, HTTP, LDAP, MySQL, NFS V2 UDP, Oracle, Raw TCP, Remote Desktop, Skype TCP, SMB DCERPC for Printer, SQL Queries only, SQL Redirect and Queries, Telepresence, Video, Video Call, Voice Call, and Yahoo Commands Only.

9. The method of claim 1, further including accessing and using the historical accounting records that specify transport layer information about network traffic.

10. The method of claim 1, further including accessing and using the historical accounting records that specify network layer information about network traffic.

11. The method of claim 1, further including accessing and using the historical accounting records that specify data link layer information about network traffic.

12. The method of claim 1, further including using multiple first test appliances on the same network segment to generate test traffic to multiple second test appliances on one or more other network segments.

13. The method of claim 1, further including adapting the test traffic mix profile responsive to user input specifying default or selected values for quality of service (QoS) priority levels, packet frame size, VLAN labels and MLPS values.

14. The method of claim 1, further including the first test appliance connecting with the second test appliance and communicating test parameters for the second test appliance to use during the performance test.

15. The method of claim 1, wherein the first and second test appliances are separated by a wide area network.

16. The method of claim 1, further including:

using additional test appliances on additional network segments different than network segments to which the first and second test appliances are connected,

accessing the historical network accounting records, adapting the historical network accounting records, and generating test traffic inclusive of traffic related to the additional test appliances; and

running the performance test over the first and second test appliances and the additional test appliances.

17. The method of claim 1, further including conducting stress testing, by:

duplicating or scaling captured flow information to represent additional devices and sessions; and

forming regenerated flow data to stress the network under test, from a first data flow level to successively greater flow levels thereby causing a response degradation, by;

receiving from an operator identification of minimum and maximum megabytes per send (MBPS) from the captured flow information; and

generating test traffic according to the minimum and maximum MBPS.

18. A test system that generates a mix of network traffic types for conducting a network test on a target network segment between first and second test appliances connected to the network segment of a network under test, the system including:

a controller that includes a processor, memory and instructions in the memory that implement;

accessing at least a summary of historical network accounting records that include network traffic type distribution among supported application layer protocols identified in flows in the network under test;

for at least one time interval in the historical network accounting records, using a processor to generate a test traffic mix profile among the supported application layer protocols from analysis of the historical network accounting records;

adapting the test traffic mix profile responsive to user input specifying at least a range of test traffic loads, identifiers of first and second test appliances, and network addresses to use for the first and second test appliances;

a first test appliance that includes a processor, network interface, memory and instructions in the memory that implement;

for at least one time interval in the historical network accounting records, using a processor to generate a test traffic mix profile among the supported application layer protocols from analysis of the historical network accounting records;

adapting the test traffic mix profile responsive to user input specifying at least a range of test traffic loads, identifiers of first and second test appliances, and network addresses to use for the first and second test appliances;

a second test appliance that includes a processor, network interface, memory and instructions in the memory that implement receiving and responding to test messages from the first test appliance;

the controller further implementing;

initiating over a network connection, a performance test of the target network segment that lies between the first and second test appliances disposed at different sides of the network connection including a server side and a client side;

wherein (i) the first test appliance, acting as a test generator, regenerates adapted network traffic by simulating activity, of one or more of a plurality of network devices of a first side selected from the client side and the server side of the network segment of the network under test, as captured in the historical network accounting records that were used to generate the adapted test traffic mix profile and (ii) the second test appliance acting as a test traffic responder, responds to the traffic generated by the first test appliance by simulating activity, of one or more of a plurality of network devices of a second side selected from the client side and the server side of the network segment of the network under test, as captured in the historical network accounting records; and

reporting test results from conducting the performance test upon the target network.

19. The system of claim 18, the controller further implementing:

generating test traffic mix profiles for multiple time intervals; and

initiating the performance test against the multiple time intervals without requiring user intervention between the time intervals.

20. The system of claim 18, the controller further implementing:

generating test traffic mix profiles for multiple time intervals and at least relative load factors;

modifying application of the range of test traffic loads to the multiple time intervals based on the relative load factors; and

initiating the performance test against the multiple time intervals without requiring user intervention between the time intervals.

21. The system of claim 18, further including:

wherein the historical network accounting records of network traffic volume indicate network traffic volume statistics for the network traffic types;

the controller further implementing;

calculating a distribution of network traffic volume from the historical network accounting records; and

setting test parameters to vary test traffic load during the time interval corresponding to the network traffic volume distribution.

22. The system of claim 18, wherein the network traffic types of supported application protocols include at least BitTorrent, FTP, Gnutella, Gtalk, HTTP, LDAP, MySQL, Oracle, Raw TCP, Remote Desktop, Skype, SMB, SQL, Telepresence, Video, Video Call, and Voice Call.

23. The system of claim 18, further including multiple first test appliances on the same network segment that transmit test traffic to multiple second test appliances on one or more other network segments.

24. The system of claim 18, the controller further implementing adapting the test traffic mix profile responsive to user input specifying default or selected values for quality of service (QoS) priority levels, packet frame size, VLAN labels and MLPS values.

25. The system of claim 18, further including the first test appliance connecting with the second test appliance and communicating test parameters for the second test appliance to use during the performance test.

26. The system of claim 18, wherein the first and second test appliances are separated by a wide area network.

27. The system of claim 18, further including:

additional test appliances on additional network segments different than network segments to which the first and second test appliances are connected,

the controller further implementing

accessing the historical network accounting records, adapting the historical network accounting records, and generating test traffic inclusive of traffic related to the additional test appliances; and

initiating the performance test over the first and second test appliances and the additional test appliances.