Centrally controlled end-to-end service quality monitoring system and method in a distributed environment

• US 20040003070A1
• Filed: 06/26/2002
• Published: 01/01/2004
• Est. Priority Date: 06/26/2002
• Status: Abandoned Application

• Current Assignee: Clarus Systems, Inc. (Riverbed Technology Incorporated)
• Original Assignee: Clarus Systems, Inc. (Riverbed Technology Incorporated)
• Inventors: Powell, Evan L., Fernald, Steven A., McGowan, Kevin
• Application Number:
  US10/184,224
• Publication Number:
  US 20040003070A1
• Time in Patent Office: Days
• US Class Current: 709/223
• CPC Class Codes: H04L 43/00 Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/12 Network monitoring probes
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

A system (and methods) for monitoring telecommunications services end-to-end through a distributed network environment. The system includes a distributed telecommunication network, which is capable of providing communications to a plurality of users during an active state. The system also has a plurality of point of presence servers distributed throughout the cities served by the distributed telecommunication network. Each of the point of presence servers is adapted to provide a test pattern from a plurality of test patterns where each of the test patterns correspond respectively to one of a plurality of services. The test pattern is transferred from one of the point of presence servers to another point of presence server to identify a quality level of the distributed telecommunication network between the one point of presence server and the other point of presence server. Other features are also included.

Claims

1. A system for monitoring telecommunications services end-to-end through a distributed network environment, the system comprising:

a distributed telecommunication network, the distributed telecommunication network being capable of providing communications to a plurality of users during an active state;

a plurality of point of presence servers distributed throughout the geographic regions served by the distributed telecommunications network, each of the point of presence servers being adapted to provide at least a test pattern from a plurality of test patterns where each of the test patterns corresponds respectively to at least one of a plurality of services, whereupon the test pattern is transferred from one of the point of presence servers to another point of presence server to identify a quality level of the distributed telecommunication network between the one point of presence server and the other point of presence server; and

a master controller coupled to each of the point of presence servers via an Internet Protocol Wide Area Network (IP-WAN), the master controller being adapted to select at least one of the services for which a use of the selected service by a user of the selected service is simulated by one of the point of presence servers where the one point of presence server transfers the test pattern associated with the selected service to the other point of presence server, the master controller being adapted to receive information associated with the quality level of the distributed telecommunication network from one of the point of presence servers.

2. The system of claim 1 wherein the services include voice, data, messaging, video, voice conferencing, video conferencing, auto-attendant PBX services, Interactive Voice Response Systems based information recovery and order entry services, mobile data delivery services, mobile web access services, internet web access services, and internet media delivery services.

3. The system of claim 1 wherein the distributed telecommunication network includes one or more networks selected from a group consisting of an IP network, a mobile network, a video network, a cable network, a TDM network, an analog network, ATM network, Frame Relay network, satellite network, Ethernet network, fixed wireless network, fiber networks, and microwave distribution and communication networks.

4. The system of claim 1 wherein the point of presence servers are geographically distributed throughout a plurality of cities served by the distributed telecommunication network.

5. The system of claim 1 wherein the test pattern is transferred during the active state of the distributed telecommunication network.

6. The system of claim 1 wherein the other point of presence server that receives the test pattern is adapted to process the test pattern to identify the quality level.

7. The system of claim 6 wherein the process is adapted to compare the received test pattern with a stored test pattern.

8. The system of claim 1 wherein the test pattern that is transferred from one of the point of presence servers to another point of presence server identifies the quality level of the distributed telecommunication network between the one point of presence server and the other point of presence server in a first direction.

9. The system of claim 1 wherein a second test pattern is transferred from the other point of presence server to the one point of presence server to identify a second quality level of the distributed telecommunication network between the one point of presence server and the other point of presence server in a second direction, where the second direction is opposite to the first direction to form full duplex operation.

10. The system of claim 1 wherein the master controller is adapted to receive, store, and prepare information associated with the test pattern for a plurality of simulations, where each of the simulations is associated with one of the plurality of services.

11. The system of claim 1 wherein the plurality of test patterns are stored in a library.

12. The system of claim 1 wherein one or more of the test patterns is at least simulated or retrieved from memory.

13. The system of claim 1 wherein the test pattern is transferred without any substantial interference to any of a plurality of users during the active state.

14. The system of claim 13 wherein test pattern is transparent to any of the plurality of users during the active state.

15. The system of claim 1 wherein the master controller is adapted for monitoring of one or more distributed telecommunications networks for more than one customer.

16. The system of claim 15 wherein the plurality of point of presence servers are coupled to one or more distributed telecommunications networks for more than one customer.

17. The system of claim 1 wherein the master controller comprises a detection module, the detection module being adapted to monitor the test pattern through one or more anomalies in the distributed telecommunication network.

18. The system of claim 17 wherein the master controller further comprises an isolation module, the isolation module being adapted to identify a location of one of the anomalies.

19. The system of claim 18 wherein the location is associated with a geographical location.

20. The system of claim 19 wherein the master controller further comprises a diagnostic module, the diagnostic module being adapted to identify a type of network element, a sub-network, and a type of transport technology in the telecommunication network associated with one of the anomalies in the geographical location.

21. The system of claim 19 wherein one of the anomalies is associated with a type of network element in the telecommunication network at the geographic location, the element being selected from a fiber, a router, a server, a TDM carrier, a packet switch, a softswitch, a packet voice gateway, a matrix switch, a Service Control Point, a Signal Transfer Point, a Service Management System, a RF transmitter, a RF receiver, a Mobile switch, an application server, a signaling system, an authentication server, an authorization server, a physical interconnection such as wires, a edge packet grooming system, and a web content caching system.

22. The system of claim 20 wherein one of the anomalies is associated with a sub-network portion of the telecommunication network at the geographic location, the sub-network being selected from a access signaling network, access transport network, core signaling network, core transport network, terminating signaling network, and terminating transport network.

23. The system of claim 22 wherein one of the anomalies is associated with each of the sub-networks is further associated with one or more network transport technologies in the sub-network portion of the telecommunications network, the network transport technologies being selected from a group consisting of an IP network, a mobile network, a video network, a cable network, a TDM network, an analog network, ATM network, Frame Relay network, satellite network, Ethernet network, fixed wireless network, fiber networks, and microwave distribution and communication networks.

24. A system for monitoring telecommunications services end-to-end through a distributed network environment, the system comprising:

a plurality of point of presence servers distributed throughout cities served by a distributed telecommunication network, each of the point of presence servers being adapted to provide a test pattern from a plurality of test patterns where each of the test patterns corresponding respectively to one of a plurality of services, whereupon the test pattern is transferred from a first point of presence server to a second point of presence server to identify a quality level of the distributed telecommunication network between the first point of presence server and the second point of presence server; and

a master controller coupled to each of the point of presence servers via a selected Protocol Wide Area Network (IP-WAN), the master controller being adapted to select one of the services to be simulated by the first point of presence server whereupon the first point of presence server transferred the test pattern associated with the selected service to the second point of presence server, the master controller being adapted to monitor information associated with the quality level of the distributed telecommunication network from one of the point of presence servers.

25. A method for monitoring telecommunication services end-to-end through a distributed network, the method comprising:

identifying a pre-recorded third party audio message from one of a plurality of third party audio messages, each of the third party audio messages being stored in memory associated with the third party of a telecommunication answering device;

connecting from one of a plurality of point of presence servers distributed geographically to the identified pre-recorded third party audio message through an active telecommunication network;

receiving the pre-recorded third party audio message from third party telecommunication device by the one point of presence server; and

associating the pre-recorded third party audio message with a pre-determined file for the identified pre-recorded third party audio message to identify a quality level associated with the pre-recorded third party audio message as the pre-recorded third party audio message was received by the point of presence server in the geographic location.

26. The method of claim 25 wherein one or more of the third party audio messages is a voice recording.

27. The method of claim 26 wherein one or more of the third party audio messages is a uniquely identifiable audio message other than voice.

28. The method of claim 26 wherein a representation of each third party audio message prior to transfer through an active telecommunication network is stored in a pre-determined file.

29. The method of claim 25 wherein one of a plurality of pre-recorded third party audio messages is selected for connection.

30. The method of claim 29 wherein service access addresses and service access procedures are stored in memory.

31. The method of claim 29 wherein one of a plurality of point of presence servers connects to a selected pre-recorded third party audio message by correctly completing service access procedures.

32. The method of claim 25 wherein the pre-determined file that is a representation of the pre-recorded audio message prior to transfer through an active telecommunication network is used to determine one of a plurality of quality levels.

33. The method of claim 32 wherein the pre-determined file is a representation of the pre-recorded audio message at a first quality prior to transfer through the active telecommunication network and the pre-recorded audio message as received by the point of presence server is at a second quality level, the first quality level being of the same quality level as the first quality level based upon a portion of the active telecommunication network between the telecommunication answering device and the point of presence server.

34. The method of claim 32 wherein the pre-determined file is a representation of the pre-recorded audio message at a first quality prior to transfer through the active telecommunication network and the pre-recorded audio message as received by the point of presence server is at a second quality level, the second quality level being of a lower quality level than the first quality level based upon a portion of the active telecommunication network between the telecommunication answering device and the point of presence server.

35. The method of claim 32 wherein the pre-determined file is a representation of the pre-recorded audio message at a first quality prior to transfer through the active telecommunication network and the pre-recorded message as received by the point of presence server is at a third quality level, the third quality level being of a lower quality level than the first quality level based upon a portion of the active telecommunication network between the telecommunication answering device and the point of presence server.

36. A method for monitoring telecommunication services end-to-end through a distributed network, the method comprising:

selecting one or more test patterns from a plurality of test patterns using a master controller coupled to a telecommunication network, each of the test patterns corresponding to at least a service;

transferring the, selected test pattern from a first point of presence server to a second point of presence server through the telecommunication network, the first and the second point of presence servers being among a plurality of point of presence servers being distributed geographically and also distributed through the telecommunication network;

receiving the selected test pattern at the second point of presence server; and

associating the selected test pattern with a pre-determined file for the selected test pattern to identify a quality level associated with the selected test pattern as the selected test pattern was received by the second point of presence server.

37. The method of claim 36 wherein the master controller provides end-to-end monitoring of the selected test pattern through a portion of the telecommunication distributed network.

38. The method of claim 37 wherein the master controller provides one or more schedules for regulating a date and time, day of week set for simulations.

39. The method of claim 37 wherein the master controller commands one or more simulation activities in a plurality of point of presence servers.

40. The method of claim 37 wherein the master controller collects and stores quality data associated with the quality level.

41. The method of claim 40 wherein the master controller analyses the quality data.

42. The method of claim 37 wherein the master controller formats one or more results of analysis for display on browser clients.

43. The method of claim 37 wherein the master controller controls an interaction with a customer'"'"'s browser client.

44. The method of claim 37 wherein the master controller manages operations and data communications of the IP-WAN and the plurality of point of presence servers.

45. The method of claim 37 wherein the master controller manages an inventory of simulation resources at selected or all point of presence servers.

46. The method of claim 36 wherein each of the point of presence servers enables end-to-end simulations.

47. The method of claim 46 wherein one or more of the point of presence server collects and temporarily stores quality data resulting from end-to-end simulations.

48. The method of claim 46 wherein one or more of the point of presence server communicates quality data to the master controller.

49. The method of claim 48 wherein one or more of the point of presence server communicates connection failures to the master controller.

50. The method of claim 48 wherein one or more of the point of presence server communicates one or more time intervals as recorded during service access procedures.

51. The method of claim 48 wherein one or more of the point of presence server communicates quality data resulting from the transfer of test patterns for end-to-end simulations.

52. The method of claim 46 wherein one or more of the point of presence server controls testing systems coupled to the telecommunication network.

53. The method of claim 52 wherein one or more of the point of presence server transforms simulation commands received from the master controller into a proper syntax and semantic representations that are native to the testing systems.

54. The method of claim 52 wherein one or more of the point of presence server transforms simulation quality data received from the testing systems native syntax and semantic representations into information of the master controller.

55. The method of claim 46 wherein one or more of the point of presence server controls embedded testing systems.

56. The method of claim 55 wherein one or more of the point of presence server transforms simulation commands received from the master controller into a proper syntax and semantic representations native to the embedded testing systems.

57. The method of claim 55 wherein one or more of the point of presence server transforms simulation quality data received from the embedded testing systems native syntax and semantic representations into the master controller.

58. The method of claim 46 wherein one or more of the point of presence server controls embedded voice recognition systems.

59. The method of claim 58 wherein one or more of the point of presence server transforms simulation commands received from the master controller into a proper syntax and semantic representations native to the embedded voice recognition systems.

60. The method of claim 58 wherein one or more of the point of presence server transforms simulation quality data received from the embedded voice recognition systems native syntax and semantic representations into the master controller.

61. The method of claim 46 wherein one or more of the point of presence server capabilities are encompassed in a software only probe appropriate to efficient operation in a PC based communications client.

62. The method of claim 46 wherein one or more of the point of presence server capabilities are encompassed in a software only implementation appropriate to performing all functions of a hardware based implementation.

63. The method of claim 36 wherein one or more of the point of presence servers perform end-to-end synchronization prior to each simulation involving the transfer of one or more test patterns such that delay and latency in the transfer may be accurately measured and reported.

64. The method of claim 36 wherein the master controller manages the selection of the methods of monitoring to optimize the value of the quality information analyzed for presentation to customer'"'"'s browser clients.

65. The method of claim 64 wherein the master controller selects a customer from the monitoring information store.

66. The method of claim 65 wherein the master controller selects one of customer'"'"'s services from the monitoring information store.

67. The method of claim 66 wherein the master controller selects service access numbers and service access methods from the monitoring information store.

68. The method of claim 66 wherein the master controller selects one of customer'"'"'s distributed telecommunication networks from the monitoring information store.

69. The method of claim 68 wherein the master controller selects, from the monitoring information store, a first point of presence server and a second point of presence server.

70. The method of claim 64 wherein the master controller manages the selection of date, and time, day of week for the start of end-to-end simulations between a plurality of pairs of first point of presence servers and second point of presence servers.

71. The method of claim 70 wherein the master controller manages the selection of start date, and time, day of week for end-to-end simulations to optimize a detection of degradations and/or failures of end-to-end service quality.

72. The method of claim 70 wherein the master controller manages the selection of start date, and time, day of week for end-to-end simulations to optimize collection of quality data in random samples to support accurate inferences from the data.

73. The method of claim 36 wherein the master controller associates each of the plurality of test patterns with at least one of three categories, a first category being optimized for rapid detection of quality degradations above a pre-selected threshold value, a second category being optimized for the rapid isolation of one or more anomalies, causing detected degradations of end-to-end service, in the distributed telecommunication network, a third category being optimized for diagnosis of observed degradation for identifying.

74. The method of claim 36 wherein the master controller stores rules and uses the stored rules to manage a selection of a method of detecting degradations in end-to-end service quality, the method isolating a geographic location of a causing anomaly in the customer'"'"'s distributed network, and the method of diagnosing which of the sub-components of the customer'"'"'s distributed network may be causing the anomaly, or anomalies, to optimize the system'"'"'s ability to present the root cause of the anomaly, or anomalies, on the customer'"'"'s browser clients.

75. The method of claim 74 wherein the rules are optimized to detect degradations of end-to-end service in a distributed telecommunication network.

76. The method of claim 75 wherein the rules are optimized to detect degradations of end-to-end service in a distributed telecommunication network by comparison with industry standard quality thresholds.

77. The method of claim 75 wherein the rules are optimized to detect degradations of end-to-end service in a distributed telecommunication network by comparison with customer defined quality thresholds.

78. The method of claim 75 wherein the rules are optimized to detect degradations of end-to-end service in a distributed telecommunication network by statistical comparisons with recent quality data collected from the current customer'"'"'s same service and same active network.

79. The method of claim 74 wherein the rules are optimized to use quality data collected from a plurality of point of presence servers to isolate one or more anomalies, causing the detected degradations of end-to-end service, in the distributed telecommunication network.

80. The method of claim 79 wherein the anomalies are associated with one or more geographical locations.

81. The method of claim 79 wherein the isolated anomalies are associated with one or more of a type of network element in the telecommunication network at a geographic location, the element being selected from a fiber, a router, a server, a TDM carrier, a packet switch, a softswitch, a packet voice gateway, a matrix switch, a Service Control Point, a Signal Transfer Point, a Service Management System, a RF transmitter, a RF receiver, a Mobile switch, an application server, a signaling system, an authentication server, an authorization server, a physical interconnection such as wires, a edge packet grooming system, and a web content caching system.

82. The method of claim 79 wherein the isolated anomalies are associated with one or more sub-networks selected from a access signaling network, access transport network, core signaling network, core transport network, terminating signaling network, and terminating transport network.

83. The method of claim 79 wherein the isolated anomalies are associated with one or more network transport technologies selected from a group consisting of an IP network, a mobile network, a video network, a cable network, a TDM network, an analog network, ATM network, Frame Relay network, satellite network, Ethernet network, fixed wireless network, fiber networks, microwave distribution and communication networks, a plurality of variations and customizations of each network, and any combination of these and the like.

84. The method of claim 74 wherein the rules are optimized to use quality data collected from a plurality of point of presence servers transferring test patterns via connections with a plurality of services within the same active network to isolate one or more anomalies, causing the detected degradations of end-to-end service, in the distributed telecommunication network.

85. The method of claim 84 wherein the anomalies are associated with one or more geographical locations.

86. The method of claim 84 wherein the isolated anomalies are associated with one or more of a type of network element in the telecommunication network at the geographic location, the element being selected from a fiber, a router, a server, a TDM carrier, a packet switch, a softswitch, a packet voice gateway, a matrix switch, a Service Control Point, a Signal Transfer Point, a Service Management System, a RF transmitter, a RF receiver, a Mobile switch, an application server, a signaling system, an authentication server, an authorization server, a physical interconnection such as wires, a edge packet grooming system, and a web content caching system.

87. The method of claim 84 wherein the isolated anomalies are associated with one or more sub-networks selected from a access signaling network, access transport network, core signaling network, core transport network, and terminating signaling network, terminating transport network.

88. The method of claim 84 wherein the isolated anomalies are associated with one or more network transport technologies selected from a group consisting of an IP network, a mobile network, a video network, a cable network, a TDM network, an analog network, ATM network, Frame Relay network, satellite network, Ethernet network, fixed wireless network, fiber networks, and microwave distribution and communication networks.

89. The method of claim 74 wherein the rules are optimized to use quality data collected from a plurality of point of presence servers to diagnose the root cause of one or more anomalies, causing the detected degradations of end-to-end service, in the distributed telecommunication network.

90. The method of claim 89 wherein the diagnosed anomalies are associated with one or more of a type of network element in the telecommunication network at the geographic location, the element being selected from a fiber, a router, a server, a TDM carrier, a packet switch, a softswitch, a packet voice gateway, a matrix switch, a Service Control Point, a Signal Transfer Point, a Service Management System, a RF transmitter, a RF receiver, a Mobile switch, an application server, a signaling system, an authentication server, an authorization server, a physical interconnection such as wires, a edge packet grooming system, and a web content caching system.

91. The method of claim 89 wherein the diagnosed anomalies are associated with one or more sub-networks selected from a access signaling network, access transport network, core signaling network, core transport network, terminating signaling network, and terminating transport network.

92. The method of claim 89 wherein the isolated anomalies are associated with one or more network transport technologies selected from a group consisting of an IP network, a mobile network, a video network, a cable network, a TDM network, an analog network, ATM network, Frame Relay network, satellite network, Ethernet network, fixed wireless network, fiber networks, and microwave distribution and communication networks.

93. The method of claim 74 wherein the master controller algorithms are optimized to use quality data collected from a plurality of point of presence servers transferring test patterns via connections with a plurality of services within the same active network to diagnose the root cause of one or more anomalies, causing the detected degradations of end-to-end service, in the distributed telecommunication network.

94. The method of claim 93 wherein the diagnosed anomalies are associated with one or more of a type of network element in the telecommunication network at the geographic location, the element being selected from a fiber, a router, a server, a TDM carrier, a packet switch, a softswitch, a packet voice gateway, a matrix switch, a Service Control Point, a Signal Transfer Point, a Service Management System, a RF transmitter, a RF receiver, a Mobile switch, an application server, a signaling system, an authentication server, an authorization server, a physical interconnection such as wires, a edge packet grooming system, and a web content caching system.

95. The method of claim 36 wherein the master controller associates each of the plurality of test patterns with at least one of three categories, a first category being optimized for rapid detection of quality degradations above a pre-selected threshold value, a second category being optimized for the rapid isolation of one or more anomalies, causing the detected degradations of end-to-end'"'"'service, in the distributed telecommunication network, a third category being optimized for diagnosis of observed degradation for identifying sub-categories of the distributed network associated with anomalies, causing the detected degradations of end-to-end service.

96. The method of claim 95 wherein the third category is further associated with a sub-category optimized for the diagnosis of anomalies associated with one or more of a type of network element in the telecommunication network at the geographic location, the element being selected from a fiber, a router, a server, a TDM carrier, a packet switch, a softswitch, a packet voice gateway, a matrix switch, a Service Control Point, a Signal Transfer Point, a Service Management System, a RF transmitter, a RF receiver, a Mobile switch, an application server, a signaling system, an authentication server, an authorization server, a physical interconnection such as wires, a edge packet grooming system, and a web content caching system.

97. The method of claim 95 wherein the third category is further associated with a sub-category optimized for the diagnosis of anomalies associated with one or more sub-networks selected from a access signaling network, access transport network, core signaling network, core transport network, terminating signaling network, and terminating transport network.

98. The method of claim 95 wherein the third category is further associated with a sub-category optimized for the diagnosis of anomalies associated with one or more network transport technologies selected from a group consisting of an IP network, a mobile network, a video network, a cable network, a TDM network, an analog network, ATM network, Frame Relay network, satellite network, Ethernet network, fixed wireless network, fiber networks, and microwave distribution and communication networks.