Error concealment apparatus for HDTV receivers

• US 5,247,363 A
• Filed: 03/02/1992
• Issued: 09/21/1993
• Est. Priority Date: 03/02/1992
• Status: Expired due to Term

• Current Assignee: RCA Thomson Licensing Corporation
• Original Assignee: RCA Thomson Licensing Corporation
• Inventors: Sun, Huifang, Zdepski, Joel W.
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/844,322
• Time in Patent Office: 568 Days
• Field of Search: 358/105, 358/336, 358/167
• US Class Current: 348/616
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002

Abstract

Image reproduction is improved in an MPEG-like television receiver by inclusion of post-processing adaptive error concealment. Compressed video signal is examined to determine blocks of video signal containing errors, and error tokens are generated for identifying corresponding blocks of decompressed pixel values. Pixel values adjacent the decompressed blocks of pixel values containing errors are examined to generate estimates of the relative image motion and image detail in the area of such blocks. The block of pixel values is replaced with temporally displaced co-located blocks of pixel values or interpolated data depending upon whether the estimate of image motion is lesser or greater than the estimate of image detail.

Claims

1. Adaptive error concealment apparatus, for concealing errors in video signal decoded as blocks of pixels, comprising:

a source of video signal occurring in blocks of coded data representing respective image areas, each area being represented by a plurality of pixels;

means coupled to said source for detecting errors in said blocks of coded data, generating error tokens indicating blocks of coded data containing errors, discarding blocks of coded data with errors, and passing error free blocks of coded data;

means for decoding said error free blocks of coded data on a block-by block basis, and generating corresponding blocks of pixel values representing said image areas;

means, responsive to said error tokens and pixel values, for generating a first indicia related to the amount of image detail in at least one block of pixel values adjacent to a discarded block of pixel values;

means, responsive to said error tokens and pixel values, for generating a second indicia related to image movement in said at least one block of pixel values adjacent to said discarded block of pixel values, with respect to an image in a previously decoded frame;

means for comparing said first and second indicia, and providing first and second types of pixel data for said discarded block of pixel values, if the amount of image detail is greater and lesser then said image movement respectively.

2. The apparatus set forth in claim 1 wherein said means for providing first and second types of pixel data comprises:

means for selecting pixel values from blocks of pixel values adjacent said discarded block of pixel values, for generating a block of interpolated pixel values therefrom, said block of interpolated pixel values corresponding to said second type of pixel data; and

means for selecting a block of pixel values from a frame of previously decoded video signal, said selected block corresponding to said first type of pixel data.

3. The apparatus set forth in claim 1 wherein said first and second types of pixel data correspond to blocks of temporally displaced pixel values and blocks of interpolated pixel values respectively.

4. The apparatus set forth in claim 1 wherein said means for generating a first indicia comprises, means for calculating the difference between the square of the average value of pixel values in said at least one block and the expected value of the square pixel values in said at least one block.

5. The apparatus set forth in claim 1 wherein said means for generating a second indicia comprises, means for calculating the expected value of the square of the difference between corresponding pixel values in said at least one block and pixel values from a co-located block in a temporally displaced frame.

6. In a system for decoding video signal arranged in blocks of coded data to produce corresponding blocks of pixel values representing respective image areas, apparatus for concealing errors in blocks of pixel values, comprising:

means responsive to said coded data for generating error tokens identifying blocks of coded data containing errors;

means responsive to said error tokens for identifying blocks of pixel values (designated errored blocks), corresponding to blocks of coded data containing errors;

means responsive to decoded pixel values for estimating the relative amount of image motion, and relative amount of image detail in said errored blocks of pixel values; and

means for replacing respective errored blocks of pixel values with blocks of interpolated data if the estimate of relative motion for a respective block is greater than the estimate of relative image detail, and replacing respective errored blocks of pixel values with blocks of temporally displaced pixel values if the relative image detail for said respective blocks is greater than the estimate of relative motion.

7. The system set forth in claim 6 wherein said means for substituting respective blocks of pixel values substitutes said blocks of temporally displaced pixel values before substituting said blocks of interpolated data.

8. The system set forth in claim 6 wherein said means responsive to decoded pixel values for estimating the relative amount of image motion, and relative amount of image detail in said errored blocks of pixel values, comprises:

means for generating a first indicia related to the amount of image detail in at least one block of pixel values adjacent to said errored block of pixel values;

means for generating a second indicia related to image movement in said at least one block of pixel values adjacent to said errored block of pixel values, with respect to an image in a previously decoded frame; and

means for comparing said first and second indicia.

9. The system set forth in claim 6 wherein said means for substituting respective errored blocks of pixel values with blocks of interpolated data comprises:

means for selecting pixel values from blocks of pixel values adjacent said errored block of pixel values, and generating therefrom said interpolated data.

10. The system set forth in claim 6 wherein said coded data includes motion vectors associated with respective blocks and said means for substituting blocks of temporally displaced pixel values includes:

means for storing motion vectors;

means responsive to said error tokens for selecting motion vectors associated with blocks adjacent to said errored block; and

means responsive to said selected motion vectors for determining a temporally displaced block of pixel values for substitution.