MANIPULATION OF STREAMS OF MONITORING DATA

• US 20150295807A1
• Filed: 08/02/2012
• Published: 10/15/2015
• Est. Priority Date: 08/02/2012
• Status: Abandoned Application

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Huang, Yangcheng, Groenendijk, Jan
• Application Number:
  US14/418,420
• Publication Number:
  US 20150295807A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/901 Indexing; Data structures therefor; Storage structures for retrieval from the web G06F16/951
• CPC Class Codes: H04L 41/065 involving logical or physical relationship, e.g. grouping and hierarchies
• CPC Class Codes: H04L 41/0677 Localisation of faults
• CPC Class Codes: H04L 41/0686 Additional information in the notification, e.g. enhancement of specific meta-data
• CPC Class Codes: H04L 41/069 using logs of notifications; Post-processing of notifications
• CPC Class Codes: H04L 43/062 related to network traffic
• CPC Class Codes: H04L 43/10 Active monitoring, e.g. heartbeat, ping or trace-route

Abstract

Streams of monitoring data relating to part of a communications network, are manipulated automatically by looking up a corresponding indexed value in a stored index, and selectively replacing that attribute value with the corresponding indexed value. The selective replacement is based on a characteristic of the stream of monitored data, or the network being monitored. The selection or the indexed values can be adapted dynamically. Such selective replacement at the attribute field level can enable the data to be enriched with embedded information or be compressed more efficiently with less processing overhead by exploiting knowledge of the data format and the network configuration. It is compatible with hardware implementations. The embedded information can enable subsequent processing of the monitored data to be speeded up.

Claims

1. A method of monitoring a part of a communications network, comprising:

receiving a stream of monitoring data relating to the part of the network, the stream of monitoring data having a repeating data format of attribute fields, and

manipulating the stream of monitoring data automatically by;

a) detecting the attribute fields in the stream of monitoring data, and

b) for an attribute value of selected attribute fields, looking up a corresponding indexed value in a stored index, and selectively replacing that attribute value in the data stream with the corresponding indexed value,

wherein the selective replacement is based on a characteristic of at least one of;

the stream of monitored data, and the network being monitored.

2. The method of claim 1, wherein the characteristic is redundancy in the stream of monitored data and the selective replacement is based on at least how many unique attribute values there are for the respective attribute field, and on frequencies of occurrence of the different attribute values.

3. The method of claim 1, the step of replacing at least one of the attribute values comprising replacing it with a corresponding indexed value comprising embedded information concerning the part of the network which is generating the monitoring data.

4. The method of claim 3, the embedded information concerning the part of the network comprising information about relationships between the part and other parts of the network.

5. The method of claim 1, comprising the step of processing the monitoring data using the indexed values.

6. The method of claim 4, comprising the step of processing the monitoring data using the indexed values,

wherein the processing step comprises correlating monitored data from related parts of the network using the embedded information about relationships between the part and other parts of the network.

7. The method of claim 1, comprising the step of dynamically adapting how the stream of monitoring data is manipulated in use by altering any of:

the selection of attribute field, the selection of attribute values to be replaced, and the corresponding indexed values in the stored index.

8. The method of claim 1, wherein the step of replacing at least one of the attribute values comprises replacing variable length attribute values with corresponding indexed values having a fixed length.

9. A method of adapting manipulation of a stream of monitoring data relating to a part of a communications network, by apparatus having a stored index, the stream of monitoring data having a repeating data format of attribute fields, the manipulating involving replacing selected attribute values with indexed values, the stored index having a mapping of indexed values corresponding to attribute values to be replaced, the method comprising:

generating selection information about which of the attribute fields and which of their values are for replacement, and generating corresponding indexed values, based on a characteristic of at least one of;

the stream of monitored data, and the network being monitored, and

sending the selection information and the corresponding indexed values to the apparatus to cause it to adapt its manipulation of the monitoring data according to the selection information and corresponding indexed values.

10. The method of claim 9 comprising:

for each of the attribute fields, identifying how many unique attribute values there are for the respective attribute field, and identifying frequencies of occurrence of the different attribute values, and

deriving characteristics of the stream of monitoring data comprising amounts of redundancy for different ones of the attribute fields, based on the numbers of unique attribute values, and how frequently the different attribute values occur and generating the selection information based on these redundancy characteristics.

11. The method of claim 10, the step of identifying how many unique attribute values there are for the respective attribute field having a step of deriving this from at least one of:

configuration information about the network, and observations of monitoring data over a period of time in use.

12. The method of claim 10 wherein the step of identifying a frequency of occurrence comprises the step of observing frequencies of occurrence of the different attribute values in use over a period of time.

13. The method of claim 9, wherein the step of generating indexed values comprises generating an indexed value having embedded information concerning the part of the network which is generating the monitoring data.

14. The method of claim 13, the embedded information concerning the part of the network comprising information about relationships between the part and other parts of the network.

15. An apparatus for manipulating a stream of monitoring data relating to a part of a communications network, the stream of monitoring data having a repeating data format of attribute fields, the apparatus comprising:

a stored index having a mapping of indexed values corresponding to the selected attribute values to be replaced, characteristic of at least one of;

the stream of monitored data, and the network being monitored;

look up circuitry, configured to detect the attribute fields in the stream of monitoring data, and for selected attribute fields, to use the attribute values to look up corresponding indexed values in the stored index; and

replacing circuitry configured to selectively replace the attribute values in the data stream with corresponding indexed values according to the stored index.

16. The apparatus of claim 15, having a monitoring data processor configured to carry out real time processing on the monitoring data having the indexed values.

17. The apparatus of claim 15 comprising adaptation apparatus coupled to any of the stored index, the look up circuitry and the replacing circuitry for dynamically altering the manipulating in use by altering any of:

the selection of attribute field, the selection of attribute values to be replaced, and the corresponding indexed values in the stored index.

18. The apparatus of claim 17 the adaptation apparatus having a selector configured to determine amounts of redundancy in attribute fields, and to generate selection information for use by the replacing circuitry indicating which of the attribute fields and attribute values should be replaced based on the redundancy amounts, and an indexer configured to selectively create the indexed values for the mapping in the index.

19. An adaptation apparatus for adaptation of a manipulating operation by apparatus having a stored index, to manipulate a stream of monitoring data relating to a part of a communications network, the stream of monitoring data having a repeating data format of attribute fields, the manipulating involving replacing selected attribute values with indexed values, the stored index having a mapping of indexed values corresponding to attribute values to be replaced, the adaptation apparatus comprising:

a processor and memory configured to generate selection information about which of the attribute fields and which of their values are for replacement, and to generate corresponding indexed values, based on a characteristic of at least one of;

the stream of monitored data, and the network being monitored; and

an interface for sending the selection information and the corresponding indexed values to the adaptation apparatus to cause it to adapt its manipulation of the monitoring data according to the selection information and corresponding indexed values.

20. A nontransitory computer readable medium comprising instructions which when executed by a processor, cause the processor to carry out a method of monitoring a part of a communications network, the method comprising:

receiving a stream of monitoring data relating to the part of the network, the stream of monitoring data having a repeating data format of attribute fields, and

manipulating the stream of monitoring data automatically by;

a) detecting the attribute fields in the stream of monitoring data, and

b) for an attribute value of selected attribute fields, looking up a corresponding indexed value in a stored index, and selectively replacing that attribute value in the data stream with the corresponding indexed value,

wherein the selective replacement is based on a characteristic of at least one of;

the stream of monitored data, and the network being monitored.