Digital advanced television systems

• US 5,485,210 A
• Filed: 06/07/1993
• Issued: 01/16/1996
• Est. Priority Date: 02/20/1991
• Status: Expired due to Term

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Monta, Peter A., Lim, Jae S.
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): LEE, MICHAEL
• Application Number:
  US08/072,738
• Time in Patent Office: 953 Days
• Field of Search: 358/133, 358/136, 358/135, 358/138, 358/12, 358/13, 358/105, 358/140, 358/141, 382/56, 382/41, 382/43, 382/28
• US Class Current: 375/240.16
• CPC Class Codes: H04N 11/24 High-definition television systems
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/619 the transform being operated outside the prediction loop
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression

Abstract

Television images are decoded by forming a predicted current image frame, receiving and decoding a quantized subband-represented residual frame, and reconstructing a current frame by combining the decoded residual frame and a fraction of the predicted current image frame in a plurality of frequency subbands. A television signal also may be decoded to determine the state of an indicator that specifies for an entire received frame whether the received frame is an actual image frame. If the indicator specifies that the frame is an actual image frame, the frame is decoded to reconstruct the actual image and the decoded frame is used without motion compensation. If the indicator specifies that the frame is not an actual image frame, motion compensation is used to reconstruct the entire frame.

Claims

1. A method of encoding television images comprising the steps of:

forming a predicted current image frame by motion compensating a prior reconstructed image frame;

coding a residual frame using subband representation, the subbands being formed by scaling the predicted current image frame relative to an actual current image frame so that a fraction of the current image is injected into the residual frame, the amount of the current image injected varying between subbands; and

quantizing the subband-represented residual frame.

2. The method of claim 1 wherein the fraction of the current image injected into the subbands of the residual frame is lower for higher frequency subbands.

3. The method of claim 2 wherein the fraction of the current image injected into the subbands of the residual frame is lowest for the highest frequency subband and highest for the lowest frequency subband.

4. The method of claim 1, 2, or 3 wherein the subband representation is multi-scale representation in which the subband filtering is performed with filter bandwidths that vary with frequency (the bandwidth being generally narrower at lower frequencies), and in which the total number of resulting coefficients in the multi-scale-represented frame is substantially equal to the number of values in the residual frame.

5. The method of claim 4 wherein the subband representation includes block transform representation such as the DCT.

6. A method of decoding television images comprising the steps of:

forming a predicted current image frame;

receiving and decoding a quantized subband-represented residual frame; and

reconstructing a current frame by combining the decoded residual frame and a fraction of said predicted current image frame in each of a plurality of frequency subbands.

7. The method of claim 6 wherein the fraction used is not the same for all frequency subbands.

8. The method of claim 7 wherein the fraction is higher for higher frequency subbands.

9. The method of claim 8 wherein the fraction is highest for the highest frequency band and lowest for the lowest frequency band.

10. A method of decoding television images comprising the steps of:

forming a predicted current image frame;

receiving and decoding a quantized subband-represented residual frame; and

reconstructing a current frame by combining the decoded residual frame and a fraction of said predicted current image frame in each of a plurality of frequency subbands;

wherein the subband representation is multi-scale representation in which the subband filtering is performed with filter bandwidths that vary with frequency (the bandwidth being generally narrower at lower frequencies), and in which the total number of resulting coefficients in the multi-scale-represented frame is substantially equal to the number of values in the residual frame.

11. The method of claim 10 wherein the subband representation includes block transform representation such as the DCT.

15. The method of claim 10 wherein the fraction used is not the same for all frequencies subbands.

16. The method of claim 10 wherein the fraction is higher for higher frequency subbands.

17. The method of claim 10 wherein the fraction is highest for the highest frequency band and lowest for the lowest frequency band.

12. A method of decoding a television signal comprising the steps of:

decoding the television signal to determine the state of an indicator that specifies for an entire received frame whether the received frame is an actual image frame; and

if the indicator specifies that the frame is an actual image frame, decoding the frame to form the actual image frame and using the decoded frame without motion compensation.

13. A method of decoding television images, comprising the steps of:

decoding a television signal to determine the state of indicators that indicate whether individual blocks of a received frame represent blocks of the image or blocks of a residual;

for those blocks that represent a residual, forming that block of the image by motion compensating a corresponding block from a prior image and adding the decoded residual to the motion-compensated block;

for those blocks that represent the actual image, using the decoded block without motion compensation; and

relying for initialization, or reduction of the effect of bit errors, on those blocks that represent the actual image.

14. A method of encoding television images, comprising the steps of:

forming a predicted current image frame by motion compensating a prior image frame using a frame of motion vectors;

forming a residual frame by determining the difference between an actual current image frame and a fraction of the predicted current image frame, so that the residual frame comprises fractions of the current image for assisting a decoder in initialization or in reducing the effect of bit errors;

estimating the motion in the image on a block-by-block basis and using the estimate to form the frame of motion vectors, one vector for each block;

deciding on a block-by-block basis whether, for a particular frame, in light of a motion estimate consistent with a scene change or with motion too fast to compensate, it is better to code the actual current image for a particular block instead of the residual frame;

coding indicators, for use in decoding, that specify on a block-by-block basis whether the residual or the actual image has been encoded; and

quantizing the encoded image for each block in the particular frame.