Transient video anomaly analysis and reporting system

• US 8,339,968 B2
• Filed: 11/04/2008
• Issued: 12/25/2012
• Est. Priority Date: 05/05/2006
• Status: Active Grant

• Current Assignee: Mariner Partners Inc
• Original Assignee: Mariner Partners Inc
• Inventors: Howe, Curtis I., Harris, James Martin G., Petrovic, Aleksandar, Lesbirel, Stephen W.
• Primary Examiner(s): Harper, Kevin C
• Application Number:
  US12/264,687
• Publication Number:
  US 20090122879A1
• Time in Patent Office: 1,512 Days
• Field of Search: None
• US Class Current: 370/242
• CPC Class Codes: H04L 41/0631 using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
• CPC Class Codes: H04L 41/0677 Localisation of faults
• CPC Class Codes: H04L 41/069 using logs of notifications; Post-processing of notifications
• CPC Class Codes: H04L 41/147 for predicting network behaviour
• CPC Class Codes: H04L 43/00 Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/0829 Packet loss
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 17/004 for digital television systems
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/2404 Monitoring of server processing errors or hardware failure error or fault detection G06F11/07; monitoring in general G06F11/30
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4425 Monitoring of client processing errors or hardware failure
• CPC Class Codes: H04N 21/64322 IP

Abstract

A system and method for detecting and analyzing transient video anomalies in AV broadcast networks includes AV signal monitors associated with each decoding device in the network for continuously monitoring AV signals received by their associated video decoding device for detecting signal anomalies which are outside predetermined signal parameter levels during normal operation of the broadcast network.

Claims

1. An Audio/Video (AV) signal monitor, comprising:

a monitor operable in the Transport Layer of a digital broadcast network, implementing the ISO open system interconnect network model, for inferring Audio/Video (AV) quality of AV signals at the Application Layer of said broadcast network;

said monitor continuously performing one or more tests during normal operation of said broadcast network to detect anomalies which exceed predetermined parameters in AV signals transmitted in a transport stream on said broadcast network and received by said monitor, said monitor further continuously performing;

examining a picture type field of each picture in said transport stream and, when lost or corrupted data is detected, determining the relative importance of the lost or corrupted data based on the picture type of the picture at which lost or corrupt data is detected;

examining a display order field of each picture header in said transport stream to determine whether lost or corrupt data involves multiple pictures within a group of pictures; and

examining time code fields in Group Of Pictures (GOP) headers in said transport stream to determine whether lost or corrupted data involves more pictures than the number of pictures associated with a group of pictures header.

2. An AV signal monitor as defined in claim 1, said determining the relative importance of the lost or corrupted data based on the picture type of the picture at which lost or corrupt data is detected,

including assigning a highest importance value for an Intra-coded picture type, a lower importance value for a Predictive-coded picture type and a lowest importance value for a Bidirectionally-predictive-coded picture type.

3. An AV signal monitor as defined in claim 1, said determining the relative importance of the lost or corrupted data by examining the picture type field, comprising:

parsing said transport stream to locate each picture header and each Group Of Pictures (GOP) header;

reading a current picture header to extract a picture start code field, the display order field, and the picture type field; and

lost or corrupted data associating the picture type with which the loss or corruption is detected and associating the data loss or corruption with more than a single picture when the display order field or the time code field reveals more than a single picture.

4. An AV signal monitor as defined in claim 1, said determining whether detected lost or corrupted data involves multiple pictures contained within a Group Of Pictures (GOP) including examining the picture display order field in the picture header to determine whether the display order field is within the time code fields of the GOP header.

5. An AV signal monitor as defined in claim 1, said determining whether detected lost or corrupted data involves more than one Group Of Pictures (GOP) by examining time code fields in the GOP header, determining the display order field for each picture and whether the display order for a current picture exceeds the time codes for the last picture of the GOP.

6. An AV signal monitor as defined in claim 3,

said locating each picture header including parsing a transport stream header having a payload unit start indicator field with a value of one and a packet identification field with a value of one, indicating the start of a new picture.

7. An AV signal monitor as defined in claim 1, said monitor being operable to detect faults in one or more of a set top box, a home network, middleware, a distribution network, and a head-end of said broadcast network.

8. An AV signal monitor as defined in claim 7, said monitor being responsive to a control signal to cause said monitor to repeat one or more selected ones of said tests, and modify a parameter associated with each said tests.

10. An AV signal monitor as defined in claim 1 wherein at least one of said tests includes a continuity test comprising monitoring arriving data for loss of both audio and video data.

9. An Audio/Video (AV) signal monitor, comprising:

a monitor operable in the Transport Layer of a digital broadcast network, implementing the ISO open system interconnect network model, for inferring Audio/Video (AV) quality of AV signals at the Application Layer of said broadcast network;

said monitor continuously performing one or more tests during normal operation of said broadcast network to detect anomalies which exceed predetermined parameters in AV signals transmitted in a transport stream on said broadcast network and received by said monitor wherein at least one of said tests includes a service information test comprising determining, before audio and video data contained within the bitstream is decoded, whether a decoder is initialized to understand the properties of the audio and video data contained within the bitstream.

11. An Audio/Video (AV) signal monitor, comprising:

a monitor operable in the Transport Layer of a digital broadcast network, implementing the ISO open system interconnect network model, for inferring Audio/Video (AV) quality of AV signals at the Application Layer of said broadcast network;

said monitor continuously performing one or more tests during normal operation of said broadcast network to detect anomalies which exceed predetermined parameters in AV signals transmitted in a transport stream on said broadcast network and received by said monitor, wherein at least one of said tests includes a loss of service test that includes, after a decoder has successfully joined a digital AV bitstream, determining that the decoder continually receives audio and video data and passes this information on to the appropriate audio or video decoder.

12. A transient video anomaly analysis and reporting system for detecting, analyzing and reporting anomalies in a digital Audio/Video (AV) broadcast network implementing the ISO open system interconnect network model and having a head-end which transmits encoded AV signals over a distribution infrastructure and destination video decoding devices for receiving and decoding said AV signals and outputting an audio signal and a video signal, comprising:

an AV signal monitor associated with each said decoding each said AV signal monitor being operable in the Transport Layer of the broadcast network for inferring AV quality of AV signals of the broadcast network, said monitor continuously performing one or more tests during normal operation of said broadcast network to detect anomalies which exceed predetermined parameters in AV signals transmitted in a transport stream on said broadcast network and received by said monitor, and outputting a report of each detected anomaly;

a database for storing report data; and

a management server connected to said monitors over said broadcast network for receiving reports output from said monitors and for storing report data in said database, said management server having a logic inference engine for analyzing data stored in said database to isolate faults responsible for detected anomalies and a module for generating and transmitting control signals to one or more of said monitors to cause said one or more of said monitors to monitor predetermined parameters of said AV signals.

19. A system as defined in claim 12, said AV signal monitors being located proximate the edge or periphery of said broadcast network.

20. A system as defined in claim 12, said inference engine providing scalable aggregation and correlation of digital AV QoS reception information using aggregated and correlated QoS information to provide diagnostic and fault location information to components and/or sections of a service provider'"'"'s infrastructure.

21. A system as defined in claim 20, said scalable aggregation and correlation of digital AV QoS reception information enabling direct correlation and isolation of any given fault to a desired level and from a subscriber'"'"'s home back through distribution infrastructure to the Head-End.

22. A system as defined in claim 12, said inference engine providing server logs of end-to-end performance trends and proactively gathering information which precede failures and using the information to determine the general location of failures and performance bottlenecks.

13. A method of analyzing the effect of lost or corrupted data in an Audio/Video (AV) transport stream, comprising:

testing said AV transport stream for lost or corrupted data;

examining the picture type field of each picture in said transport stream and, when lost or corrupted data is detected, determining the relative importance of the lost or corrupted data based on the picture type of the picture at which lost or corrupt data is detected;

examining the display order field of each picture header in said transport stream to determine whether lost or corrupt data involves multiple pictures within a group of pictures; and

examining time code fields in Group Of Pictures (GOP) headers in said transport stream to determine whether lost or corrupted data involves more pictures than the number of pictures associated with a group of pictures header.

14. A method as defined in claim 13, said determining the relative importance of the lost or corrupted data based on the picture type of the picture at which lost or corrupt data is detected,

including assigning a highest importance value for an Intra-coded picture type, a lower importance value for a Predictive-coded picture type and a lowest importance value for a Bidirectionally-predictive-coded picture type.

15. A method as defined in claim 13, said determining the relative importance of the lost or corrupted data by examining the picture type field, comprising:

parsing said transport stream to locate each picture header and each Group Of Pictures(GOP) header;

reading a current picture header to extract a picture start code field, a display order field, and a picture type field;

lost or corrupted data associating the picture type with which the loss or corruption is detected and associating the data loss or corruption with more than a single picture when a display order field or a time code field reveals more than a single picture.

16. A method as defined in claim 13, said determining whether detected lost or corrupted data involves multiple pictures contained within a Group Of Pictures (GOP) including examining the picture display order field in the picture header to determine whether the display order field is within the time code fields of the GOP header.

17. A method as defined in claim 13, said determining whether detected lost or corrupted data involves more than one Group Of Pictures (GOP) by examining time code fields in the GOP header, determining the display order field for each picture and whether the display order for a current picture exceeds the time codes for the last picture of the GOP.

18. A method as defined in claim 15,

said locating each picture header including parsing a transport stream header having a payload unit start indicator field with a value of one and a packet identification field with a value of one, indicating the start of a new picture.

23. A method for supporting and quality monitoring digital Audio/Video (AV) services in an AV broadcast network implementing the ISO open system interconnect network model and having video decoding devices capable of decoding digital AV bitstreams, comprising:

during normal operation of said digital broadcast network, continuously performing one or more tests of said broadcast network on AV signals received by each video decoding device to detect anomalies which exceed predetermined parameters in AV signals transmitted in a transport stream on said broadcast network and received by said monitor, and producing a report of each detected anomaly;

constantly monitoring said reports and storing report data in a database;

analyzing report data to isolate faults responsible for detected anomalies; and

generating a report identifying the cause of detected anomalies;

wherein analyzing report data to isolate faults responsible for detected anomalies includes providing scalable aggregation and correlation of digital AV QoS reception information using aggregated and correlated QoS information to provide diagnostic and fault location information to components and/or sections of a service provider'"'"'s infrastructure.