Method for monitoring and automatically correcting digital video quality by reverse frame prediction

• US 20030023910A1
• Filed: 07/25/2001
• Published: 01/30/2003
• Est. Priority Date: 07/25/2001
• Status: Abandoned Application

• Current Assignee: Teranex, Inc. (Blackmagic Design Pty Limited), University of Central Florida (State University System of Florida)
• Original Assignee: Teranex, Inc. (Blackmagic Design Pty Limited), University of Central Florida (State University System of Florida)
• Inventors: Myler, Harley R., Dyke-Lewis, Michele Van
• Application Number:
  US09/911,575
• Publication Number:
  US 20030023910A1
• Time in Patent Office: Days
• US Class Current: 714/704
• CPC Class Codes: H04N 17/004 for digital television systems
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

A real-time video processing method for monitoring and correcting digital video quality by reverse frame prediction. Video frames within intercut sequences, defined by correlation analysis, are used for determining quality in real-time data streams by predicting whether a frame is of acceptable quality versus one or more of a set of frames of consistent quality. When quality anomalies are encountered, such as via comparison of each correlation coefficient to a range, and identification of the specific frame containing the degradation causing the coefficient correlation to fall within the identified range, such errors in frames are corrected by replacing, regenerating, or dropping the erroneous frames or portions thereof. The repaired video data stream is then sent onward to a receiving destination.

Claims

1. A method for correcting errors in digital video for a received video stream without reference to a source video stream, the method comprising:

receiving a plurality of digital video frames, the plurality of digital video frames comprising a portion of the received video stream and having at least one intercut sequence; and

within one of the at least one intercut sequence(s),

applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality metric;

determining whether each video quality metric indicates presence of a degraded frame; and

for each video quality metric indicating the presence of a degraded frame, identifying the degraded frame.

2. The method of claim 1, further comprising:

identifying each of the at least one intercut sequence(s) in the received plurality of digital video frames.

3. The method of claim 1, wherein applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality measurement includes:

determining a peak signal to noise ratio.

4. The method of claim 1, wherein applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality measurement includes:

applying a Gabor transform to the at least two of the plurality of digital video frames.

5. The method of claim 1, wherein applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality measurement includes:

applying Marr-Hildreth and Canny operators to the at least two of the plurality of digital video frames.

6. The method of claim 1, wherein applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality measurement includes:

applying fractal decomposition to the at least two of the plurality of digital video frames.

7. The method of claim 1, wherein applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality measurement includes:

applying Mean Absolute Difference analysis to the at least two of the plurality of digital video frames.

8. The method of claim 1, wherein applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality measurement includes:

determining a correlation coefficient for at least one pair of the at least two of the plurality of video frames.

9. The method of claim 1, wherein identifying the degraded frame includes:

applying a quality analysis technique to at least one of the at least two of the plurality of digital video frames and to at least a third one of the plurality of digital video frames.

10. The method of claim 1, further comprising:

correcting the degraded frame.

11. The method of claim 10, wherein correcting the degraded frame includes:

removing each of the degraded frame.

12. The method of claim 10, wherein correcting the degraded frame includes:

obtaining a replacement frame for the degraded frame.

13. The method of claim 12, wherein the replacement frame is obtained from the source video stream.

14. The method of claim 10, wherein correcting the degraded frame includes:

identifying a degraded portion of the degraded frame;

identifying at least one from the plurality of the digital video frames containing an undegraded portion corresponding to the degraded portion of the degraded frame; and

replacing the degraded portion of the degraded frame with the undegraded portion.

15. The method of claim 10, wherein correcting the degraded frame includes:

identifying a predetermined degradation in the degraded frame; and

correcting the predetermined degradation.

16. The method of claim 15, wherein the predetermined degradation includes one selected from a group consisting of a blocking effect, mosquito noise, and motion compensation noise.

17. The method of claim 2, wherein identifying the at least one intercut sequence includes:

identifying at least one cut in the received plurality of digital video frames.

18. The method of claim 17, wherein identifying at least one cut in the received plurality of digital video frames includes:

comparing at least a first one of the plurality of digital video frames to at least a second one of the plurality of digital video frames to produce at least one correlation coefficient;

comparing each of the at least one correlation coefficient to a predetermined range; and

for each of the at least one compared correlation coefficient falling outside the predetermined range, identifying at least one frame corresponding to a cut in the received plurality of digital video frames.

19. The method of claim 18, wherein each of the at least one correlation coefficient is normalized.

20. The method of claim 19, wherein each of the at least one correlation coefficient is normalized on a scale of 0 to 1.

21. The method of claim 20, wherein the predetermined range is approximately 0 to 0.9.

22. The method of claim 17, wherein the received video stream includes metadata stream information, and wherein identifying at least one cut in the received plurality of digital video frames includes:

analyzing the metadata stream information.

23. The method of claim 1, wherein the source video stream is processed to produce the received video stream.

24. The method of claim 23, wherein the source video stream is processed to produce the received video stream by passing the source video stream through a channel.

25. The method of claim 23, wherein the source video stream is processed to produce the receive video stream by applying a hypothetical reference circuit to the source video stream.

26. A system for correcting errors in digital video, the system comprising:

a source video stream;

a channel for operating on the source video stream to produce a received video stream;

a repository for storing information from the received video stream; and

a processor for analyzing the received video stream;

wherein a plurality of digital video frames are received by the processor, the plurality of digital video frames comprising a portion of the received video stream and having at least one intercut sequence;

wherein, within one of the at least one intercut video sequence(s), the processor applies a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality metric;

wherein the processor determines whether each video quality metric indicates presence of a degraded frame; and

wherein, for each video quality metric indicating the presence of a degraded frame, the processor identifies at least one degraded frame.

27. The system of claim 26, wherein the channel comprises a circuit.

28. The system of claim 26, wherein the repository comprises a database.

29. A system for correcting errors in digital video for a received video stream without reference to a source video stream, the system comprising:

means for receiving a plurality of digital video frames, the plurality of digital video frames comprising a portion of the received video stream and having at least one intercut sequence; and

within one of the at least one intercut sequence(s),

means for applying a quality analysis technique to at least two of the plurality of digital video frames to produce at least one video quality metric;

means for determining whether each video quality metric indicates presence of a degraded frame; and

for each video quality metric indicating the presence of a degraded frame, means for identifying the degraded frame.