Automated characterization of network traffic

• US 20040236866A1
• Filed: 08/29/2003
• Published: 11/25/2004
• Est. Priority Date: 05/21/2003
• Status: Active Grant

• Current Assignee: Keysight Technologies Singapore Sales Pte Ltd (Keysight Technologies, Inc.)
• Original Assignee: Ixia (Keysight Technologies, Inc.)
• Inventors: Dugatkin, Diego, Hannel, Clifford
• Granted Patent: US 7,840,664 B2
• Time in Patent Office: Days
• US Class Current: 709/235
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
• CPC Class Codes: H04L 41/142 using statistical or mathematical methods
• CPC Class Codes: H04L 41/145 involving simulating, designing, planning or modelling of a network
• CPC Class Codes: H04L 43/00 Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/028 by filtering
• CPC Class Codes: H04L 43/12 Network monitoring probes
• CPC Class Codes: H04L 43/18 Protocol analysers
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

Automated characterization of network traffic. A method may include compiling and/or receiving network traffic data based on the network traffic, preparing a network traffic characterization based on the network traffic data, and generating outgoing network traffic scripts based on the network traffic characterization. A method may also include capturing network traffic and generating test network traffic based on the scripts. A system on which the method may be executed may include one or more chassis and/or computing devices, each having one or more network cards. The chassis and/or computing devices may be connected to one or more networks and to one another. The networks may include a production network and a test network. A system may include a data collector, a characterization engine, and a script generator, and may also include a traffic generator.

Claims

1. A system to automatically generate outgoing network traffic based on observed production network traffic, the system comprising:

a data collector to capture network traffic and to compile network traffic data

a characterization engine to prepare network traffic characterization data based on the network traffic and the network traffic data

a script generator to automatically, without user intervention, prepare scripts based on the network traffic characterization data

a traffic generator to generate test network traffic based on the scripts.

2. The system of claim 1 wherein

the network traffic characterization data includes statistical indicators, a traffic model and traffic profile data,

the characterization engine comprises

a sort and statistics engine to prepare the statistical indicators based on the network traffic data

a modeling engine to prepare the traffic model based on the statistical indicators

a traffic profiler to generate the traffic profile data based on the traffic model and traffic mix profiles stored by the system

3. The system of claim 1 wherein the collector is configured to filter the network traffic based on filters and to translate the network traffic based on uniform format requirements.

4. The system of claim 3 wherein the filters are at least one of user defined and system defined.

5. The system of claim 1 wherein the characterization engine is configured to sanitize the network traffic data and the statistical indictors.

6. The system of claim 5 wherein to sanitize includes removing at least one of personal identifying information, passwords, bank account numbers, and credit card information.

7. The system of claim 1 wherein the network traffic data includes at least one of protocol distribution data, length distribution data, transaction distribution data, header information, and payload data.

8. The system of claim 2 wherein the characterization engine includes a model-tweaking unit to allow a user to edit the traffic model.

9. The system of claim 2 wherein the characterization engine includes a profile-editing unit to allow a user to edit the traffic profile data.

10. The system of claim 1 wherein the data collector includes at least one data collection unit for each of a plurality of communications protocols supported by the system.

11. The system of claim 1 wherein the script generator includes at least one script generation unit for each of a plurality of communications protocols supported by the system.

12. The system of claim 1 wherein the traffic generator includes at least one traffic generation unit for each of a plurality of communications protocols supported by the system.

13. The system of claim 1 wherein the system supports a plurality of communications protocols.

14. The system of claim 13 wherein the plurality of communication protocols includes at least Ethernet, User Datagram Protocol (UDP), Transmission Control Protocol (TCP), and Hypertext Transfer Protocol (HTTP).

15. A system to automatically generate outgoing network traffic based on observed production network traffic, the system comprising:

a data collector to capture network traffic and to compile network traffic data

a sort and statistics engine to prepare statistical indicators based on the network traffic data

a modeling engine to prepare a traffic model based on the statistical indicators

a traffic profiler to generate traffic profile data based on the traffic model and traffic mix profiles stored by the system

a script generator to automatically, without user intervention, prepare scripts based on the traffic profile data

a traffic generator to generate test network traffic based on the scripts.

16. The system of claim 15 wherein the data collector is configured to filter the network traffic based on filters and to translate the network traffic based on uniform format requirements.

17. The system of claim 15 wherein the modeling engine is configured to sanitize the network traffic data and the statistical indictors.

18. The system of claim 15 wherein to sanitize includes removing at least one of personal identifying information, passwords, bank account numbers, and credit card information.

19. The system of claim 15 wherein the network traffic data includes at least one of protocol distribution data, length distribution data, transaction distribution data, header information, and payload data.

20. The system of claim 15 wherein the modeling engine includes a model-tweaking unit to allow a user to edit the traffic model.

21. The system of claim 15 wherein the traffic profiler includes a profile-editing unit to allow a user to edit the traffic profile data.

22. The system of claim 15 wherein the script generator includes at least one script generation unit for each of the communications protocols supported by the system.

23. The system of claim 15 wherein the traffic generator includes at least one traffic generation unit for each of the communications protocols supported by the system.

24. The system of claim 15 wherein the system supports a plurality of communications protocols.

25. The system of claim 24 wherein the plurality of communication protocols includes at least Ethernet, User Datagram Protocol (UDP), Transmission Control Protocol (TCP), and Hypertext Transfer Protocol (HTTP).

26. A method to automatically generate outgoing network traffic based on observed production network traffic, the method comprising:

capturing production network traffic

compiling network traffic data based on the network traffic

preparing network traffic characterization data based on the network traffic and the network traffic data

automatically generating scripts based on the network traffic characterization data

generating test network traffic based on the scripts.

27. The method of claim 26 wherein

the network traffic characterization data includes statistical indicators, a traffic model and traffic profile data,

preparing network traffic characterization data includes

preparing the statistical indicators based on the network traffic data

preparing the traffic model based on the statistical indicators

generating the traffic profile data based on the traffic model and system provided traffic mix profiles.

28. The method of claim 26 wherein

the capturing network traffic comprises filtering the network traffic based on filters

the compiling network traffic data comprises translating the network traffic based on uniform format requirements.

29. The method of claim 26 further comprising

sanitizing the network traffic data and the statistical indicators.

30. The method of claim 29 wherein the sanitizing includes removing at least one of personal identifying information, passwords, bank account numbers, and credit card information.

31. The method of claim 26 wherein the network traffic data includes at least one of protocol distribution data, length distribution data, transaction distribution data, header information, and payload data.

32. The method of claim 26 wherein the production network traffic includes a plurality of data units adhering to a plurality of communications protocols.

33. The method of claim 26 wherein the outgoing network traffic includes a plurality of data units adhering to a plurality of communications protocols.

34. The method of claim 33 wherein the plurality of communications protocols includes at least Ethernet, User Datagram Protocol (UDP), Transmission Control Protocol (TCP), and Hypertext Transfer Protocol (HTTP).

35. A machine readable medium having instructions stored thereon which when executed cause a processor to perform operations comprising:

capturing production network traffic

compiling network traffic data based on the network traffic

preparing network traffic characterization data based on the network traffic and the network traffic data

automatically generating scripts based on the network traffic characterization data

generating test network traffic based on the scripts.

36. The machine readable medium of claim 35 wherein

the network traffic characterization data includes statistical indicators, a traffic model and traffic profile data,

preparing network traffic characterization data includes

preparing the statistical indicators based on the network traffic data

preparing the traffic model based on the statistical indicators

generating the traffic profile data based on the traffic model and system provided traffic mix profiles.

37. The machine readable medium of claim 35 wherein

the capturing network traffic comprises filtering the network traffic based on filters

the compiling network traffic data comprises translating the network traffic based on uniform format requirements.

38. The machine readable medium of claim 35 having further instructions which when executed cause the processor to perform further operations comprising

sanitizing the network traffic data and the statistical indictors.

39. The machine readable medium of claim 38 wherein the sanitizing includes removing at least one of personal identifying information, passwords, bank account numbers, and credit card information.

40. The machine readable medium of claim 35 wherein the network traffic data includes at least one of protocol distribution data, length distribution data, transaction distribution data, header information, and payload data.

41. The machine readable medium of claim 35 wherein the production network traffic includes a plurality of data units adhering to a plurality of communications protocols.

42. The machine readable medium of claim 35 wherein the outgoing network traffic includes a plurality of data units adhering to a plurality of communications protocols.

43. The machine readable medium of claim 42 wherein the plurality of communications protocols includes at least Ethernet, User Datagram Protocol (UDP), Transmission Control Protocol (TCP), and Hypertext Transfer Protocol (HTTP).

44. The machine readable medium of claim 35 coupled with a network testing system.

45. The machine readable medium of claim 44 wherein the network testing system is coupled to a production network.

46. The machine readable medium of claim 45 wherein the network testing system is coupled to a test network.

47. A system to automatically generate outgoing network traffic scripts based on production network traffic, the system comprising:

a collector to receive network traffic data based on the production network traffic

a characterization engine to prepare a network traffic characterization based on the network traffic data

a script generator to automatically, without user intervention, prepare scripts based on the network traffic characterization

48. The system of claim 47 further comprising:

a traffic generator to generate test network traffic based on the scripts.

49. The system of claim 47 wherein

the network traffic characterization includes statistical indicators, a traffic model and traffic profile data,

the characterization engine comprises

a sort and statistics engine to prepare the statistical indicators based on the network traffic data

a modeling engine to prepare the traffic model based on the statistical indicators

a traffic profiler to generate the traffic profile data based on the traffic model and traffic mix profiles stored by the system

50. The system of claim 47 wherein the data collector includes at least one data collection unit for each of a plurality of communications protocols supported by the system.

51. The system of claim 47 wherein the collector is configured to capture network traffic and to compile additional network traffic data based on the captured network traffic.

52. The system of claim 47 wherein the network traffic data includes at least two of protocol distribution data, length distribution data, transaction distribution data, header information, and payload data.

53. The system of claim 47 wherein the collector is configured to filter the network traffic data based on filters and to translate the network traffic data based on uniform format requirements.

54. The system of claim 49 wherein the modeling engine includes a model tweaking unit to allow a user to edit the traffic model.

55. The system of claim 49 wherein the traffic profiler includes a profile editing unit to allow a user to edit the traffic profile data.

56. The system of claim 47 wherein the script generator includes at least one script generation unit for each of a plurality of communications protocols supported by the system.

57. The system of claim 48 wherein the traffic generator includes at least one traffic generation unit for each of a plurality of communications protocols supported by the system.

58. The system of claim 47 wherein the system supports a plurality of communications protocols.

59. The system of claim 58 wherein the plurality of communication protocols includes at least Ethernet, User Datagram Protocol (UDP), Transmission Control Protocol (TCP), and Hypertext Transfer Protocol (HTTP).

60. A method to automatically generate outgoing network traffic scripts based on production network traffic, the method comprising:

receiving network traffic data based on production network traffic

preparing a network traffic characterization based on the network traffic data

automatically preparing outgoing network traffic scripts based on the network traffic characterization.

61. The method of claim 60 further comprising:

generating test network traffic based on the scripts.

62. The method of claim 60 further comprising

capturing additional production network traffic

compiling additional network traffic data based on the additional network traffic

63. The method of claim 60 wherein

the network traffic characterization includes statistical indicators, a traffic model and traffic profile data,

preparing the network traffic characterization includes

preparing the statistical indicators based on the network traffic data

preparing the traffic model based on the statistical indicators

generating the traffic profile data based on the traffic model and system provided traffic mix profiles.

64. The method of claim 60 wherein

the receiving network traffic data comprises

filtering the network traffic data based on filters

translating the network traffic based on uniform format requirements.

65. The method of claim 60 wherein the network traffic data includes at least two of protocol distribution data, length distribution data, transaction distribution data, header information, and payload data.

66. The method of claim 60 wherein the network traffic data is based on a plurality of data units adhering to a plurality of communications protocols.

67. The method of claim 61 wherein the test network traffic includes a plurality of data units adhering to a plurality of communications protocols.

68. The method of claim 60 wherein the plurality of communications protocols includes at least Ethernet, User Datagram Protocol (UDP), Transmission Control Protocol (TCP), and Hypertext Transfer Protocol (HTTP).