Predictive sub-band video coding and decoding using motion compensation

• US 5,777,678 A
• Filed: 10/24/1996
• Issued: 07/07/1998
• Est. Priority Date: 10/26/1995
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ogata, Masami, Suzuki, Teruhiko, Tong, Tak Yen
• Primary Examiner(s): LIN, BRYAN T
• Application Number:
  US08/740,205
• Time in Patent Office: 621 Days
• Field of Search: 348/398, 348/397, 348/416, 348/415, 348/409, 348/407, 348/402, 348/401, 348/400, 348/390, 348/384, 382/240, 382/248, 382/238, 382/236, 382/233, 382/232
• US Class Current: 375/240.11
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets

Abstract

A method and apparatus for sub-band encoding an input signal in which ringing may be diminished. When performing a number of wavelet transform operations by sub-band encoding, filtering the of signals is done with a small number of taps with increased number of times of spectrum splitting so far made on the signals. That is, filters with a larger number of taps are used for initial-stage frequency spectrum splitting for avoiding step-like patterns from being produced due to deterioration of low-frequency components. With increased number of times of frequency spectrum splitting, filters with a smaller number of taps are used for preventing the relative number of taps from being increased due to downsampling for suppressing picture ringing to a minimum.

Claims

1. Apparatus for encoding a picture signal defining a picture, comprising:

motion vector detection means for detecting a motion vector from said picture signal;

sub-band transform means for spectrum dividing said picture signal using a sub-band transform to generate a number of sub-band coefficients;

coefficient difference calculating means for calculating a difference value between the sub-band coefficients and respective predicted sub-band coefficients;

encoding means for encoding said difference value and for generating an encoded signal based on the encoded difference value;

decoding means for locally decoding the generated encoded signal to generate a decoded difference value;

motion compensation means for generating the predicted sub-band coefficients based on said motion vector and a picture that has been previously restored, said motion compensation means including means for determining on said picture a position corresponding to one of the predicted sub-band coefficients, means for obtaining on said picture a number of positions neighboring the determined position, means for determining a picture value corresponding to each of the obtained positions, means for calculating a sub-band coefficient corresponding to each of the determined picture values, and means for calculating a predicted sub-band coefficient as a function of the calculated sub-band coefficients;

addition means for adding the predicted sub-band coefficients and the decoded difference value to generate respectively restored sub-band coefficients; and

inverse sub-band transform means for inverse sub-band transforming the restored sub-band coefficients and for generating the restored picture.

2. The apparatus as claimed in claim 1 wherein the sub-band coefficients are wavelet coefficients.

3. The apparatus as claimed in claim 1 wherein said motion compensation means is adapted to filter the restored picture in accordance with a frequency band corresponding to said one predicted sub-band coefficient.

4. Apparatus for decoding a picture signal defining a picture, comprising:

receiving means for receiving said picture signal including at least a motion vector and an encoded difference value between a number of sub-band coefficients and respective predicted sub-band coefficients;

separation means for separating said motion vector from the encoded difference value;

decoding means for decoding the encoded difference value to generate a decoded difference value;

motion compensation means for generating the predicted sub-band coefficients based on said motion vector and a picture that has been previously restored, said motion compensation means including means for determining on said picture a position corresponding to one of the predicted sub-band coefficients, means for obtaining on said picture a number of positions neighboring the determined position, means for determining a picture value corresponding to each of the obtained positions, means for calculating a sub-band coefficient corresponding to each of the determined picture values, and means for calculating a predicted sub-band coefficient as a function of the calculated sub-band coefficients;

coefficient addition means for adding the decoded difference value and the generated predicted sub-band coefficients; and

inverse sub-band transform means for inverse sub-band transforming the sub-band coefficients received from said coefficient addition means and for generating the restored picture.

5. The apparatus as claimed in claim 4 wherein said sub-band coefficients are wavelet coefficients.

6. The apparatus as claimed in claim 4 wherein said motion compensation means is adapted to filter the restored picture in accordance with a frequency band corresponding to said one predicted sub-band coefficient.

7. A method for encoding a picture said defining a picture, comprising the steps of:

detecting a motion vector from said picture signal;

spectrum dividing said picture signal using a sub-band transform to generate a number of sub-band coefficients;

calculating a difference value between the sub-band coefficients and respective predicted sub-band coefficients;

encoding said difference value and generating an encoded signal based on the encoded difference value;

locally decoding the generated encoded signal to generate a decoded difference value;

generating the predicted sub-band coefficients based on said motion vector and a picture that has been previously restored, said step of generating the predicted sub-band coefficients including determining on said picture a position corresponding to one of the predicted sub-band coefficients, obtaining on said picture a number of positions neighboring the determined position, determining a picture value corresponding to each of the obtained positions, calculating a sub-band coefficient corresponding to each of the determined picture values, and calculating a predicted sub-band coefficient as a function of the calculated sub-band coefficients;

adding the predicted sub-band coefficients and the decoded difference value to generate respectively restored sub-band coefficients; and

inverse sub-band transforming the restored sub-band coefficients and generating the restored picture.

8. The method as claimed in claim 7 wherein the sub-band coefficients are wavelet coefficients.

9. The method as claimed in claim 7 wherein said step of generating the predicted sub-band coefficients includes filtering the restored picture in accordance with a frequency band corresponding to said one predicted sub-band coefficient.

10. A method for decoding a picture signal defining a picture, comprising the steps of:

receiving said picture signal including at least a motion vector and an encoded difference value between a number of sub-band coefficients and respective predicted sub-band coefficients;

separating said motion vector from the encoded difference value;

decoding the encoded difference value to generate a decoded difference value;

generating the predicted sub-band coefficients based on said motion vector and a picture that has been previously restored, said step of generating the predicted sub-band coefficients including determining on said picture a position corresponding to one of the predicted sub-band coefficients, obtaining on said picture a number of positions neighboring the determined position, determining a picture value corresponding to each of the obtained positions, calculating a sub-band coefficient corresponding to each of the determined picture values, and calculating a predicted sub-band coefficient as a function of the calculated sub-band coefficients;

adding the decoded difference value and the generated predicted sub-band coefficients; and

inverse sub-band transforming the sub-band coefficients resulting from said adding step to generate the restored picture.

11. The method as claimed in claim 10 wherein the sub-band coefficients are wavelet coefficients.

12. The method as claimed in claim 10 wherein said step of generating the predicted sub-band coefficients includes filtering the restored picture in accordance with a frequency band corresponding to said one predicted sub-band coefficient.

13. A method for transmitting a picture signal defining a picture, comprising the steps of:

detecting a motion vector from said picture signal;

spectrum dividing said picture signal using a sub-band transform to generate a number of sub-band coefficients;

calculating a difference value between the sub-band coefficients and respective predicted sub-band coefficients;

encoding said difference value and generating an encoded signal based on the encoded difference value;

locally decoding the generated encoded signal to generate a decoded difference value;

generating the predicted sub-band coefficients based on said motion vector and a picture that has been previously restored, said step of generating the predicted sub-band coefficients including determining on said picture a position corresponding to one of the predicted sub-band coefficients, obtaining on said picture a number of positions neighboring the determined position, determining a picture value corresponding to each of the obtained positions, calculating a sub-band coefficient corresponding to each of the determined picture values, and calculating a predicted sub-band coefficient as a function of the calculated sub-band coefficients;

adding the predicted sub-band coefficients and the decoded difference value to generate respectively restored sub-band coefficients;

inverse sub-band transforming the restored sub-band coefficients and generating the restored picture; and

transmitting a bitstream comprised of said motion vector and the encoded difference value.

14. The method as claimed in claim 13 wherein said bitstream includes a header that is added to the generated encoded signal.

15. A recording medium adapted to be decoded by decoding apparatus wherein said recording medium has a signal recorded thereon, said signal including a motion vector value detected from a picture signal and an encoded differential sub-band coefficient value calculated between a sub-band coefficient obtained by frequency spectrum dividing said picture signal using a sub-band transform and a respective predicted sub-band coefficient;

said each predicted sub-band coefficient being generated on the basis of said motion vector and a picture that has been previously restored, said generating including determining on said picture a position corresponding to one of the predicted sub-band coefficients, obtaining on said picture a number of positions neighboring the determined position, determining a picture value corresponding to each of the obtained positions, calculating a sub-band coefficient corresponding to each of the determined picture values, and calculating a predicted sub-band coefficient as a function of the calculated sub-band coefficients; and

wherein the restored picture is obtained by inverse sub-band transforming respectively restored sub-band coefficients obtained by adding the predicted sub-band coefficient and a decoded differential sub-band coefficient generated by decoding said encoded sub-band coefficient.