Prediction mode selecting device in moving image coder

• US 5,859,668 A
• Filed: 11/27/1996
• Issued: 01/12/1999
• Est. Priority Date: 12/13/1993
• Status: Expired due to Fees

• Current Assignee: Sharp Electronics Corporation (Hon Hai Precision Industry Co., Ltd.), Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Katata, Hiroyuki, Miyake, Toshiyuki, Fujiwara, Yoichi, Aono, Tomoko, Kusao, Hiroshi
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): RAO, ANAND SHASHIKANT
• Application Number:
  US08/757,905
• Time in Patent Office: 776 Days
• Field of Search: 348/413, 348/412, 348/411, 348/410, 348/409, 348/416, 348/699, 348/700
• US Class Current: 375/240.15
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/112 according to a given display mode, e.g. for interlaced or progressive display mode
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A moving image coder has a forward predicting motion vector/prediction error amount detecting section for detecting an optimum motion vector from a past frame, making a predicted image and calculating a prediction error amount from the present frame. The coder also has a backward predicting motion vector/prediction error amount detecting section for detecting an optimum motion vector from a future frame, making a predicted image and calculating a prediction error amount from the present frame. The coder further has a comparator/mode selecting section for inputting the prediction error amounts from the forward predicting motion vector/prediction error amount detecting section and the backward prediction motion vector/prediction error amount detecting section, making a comparative calculation of the input prediction error amounts, and selecting one of a forward prediction mode, a backward prediction mode and a bidirectional prediction mode.

Claims

1. A moving image coder in which each of frames in a moving image sequence is divided into frame blocks and a data amount of the moving image is compressed by selecting one of a forward prediction mode, a backward prediction mode and a bidirectional prediction mode by using a motion vector for every frame block;

the moving image coder comprising;

a forward predicting motion vector/prediction error amount detecting section for detecting an optimum motion vector from a past frame, making a predicted image and calculating a first prediction error amount from a present frame;

a backward prediction motion vector/prediction error amount detecting section for detecting an optimum motion vector from a future frame, making a predicted image arid calculating a second prediction error amount from the present frame; and

a comparator/mode selecting section for receiving the first prediction error amount from said forward predicting motion vector/prediction error amount detecting section and the second prediction error amount from said backward predicting motion vector/prediction error amount detecting section, calculating a parameter as a function of difference between and/or ratio of the first and second prediction error amounts and selecting one of said forward prediction mode, said backward prediction mode and said bidirectional prediction mode, by comparing a value of said parameter with predetermined thresholds, so that the selecting operation is performed without calculating bidirectional prediction error amount based on the forward prediction motion vector and the backward prediction motion vector.

2. A moving image coder as claimed in claim 1, wherein the prediction error amounts from the forward predicting motion vector/prediction error amount detecting section and the backward predicting motion vector/prediction error amount detecting section are compared with each other in the comparator/mode selecting section by a differential value between these prediction error amounts.

3. A moving image coder as claimed in claim 1, wherein the prediction error amounts from the forward predicting motion vector/prediction error amount detecting section and the backward predicting motion vector/prediction error amount detecting section are compared with each other in the comparator/mode selecting section by a ratio of these prediction error amounts.

4. A moving image coder as claimed in claim 1, wherein the prediction error amounts from the forward predicting motion vector/prediction error amount detecting section and the backward predicting motion vector/prediction error amount detecting section are compared with each other in the comparator/mode selecting section by combining a differential value between these prediction error amounts with a ratio of these prediction error amounts.

5. A moving image coder as claimed in claim 1, wherein the moving image coder further comprises:

an odd/even field separating section for separating odd and even fields from each other;

a forward field predicting motion vector/prediction error amount detecting section for detecting a forward field predicting motion vector and a prediction error amount every each of the separated odd and even fields;

a backward field predicting motion vector/prediction error amount detecting section for detecting a backward field predicting motion vector and a prediction error amount; and

a comparator/mode selecting section.

6. A moving image coder as claimed in claim 1, wherein the moving image coder is arranged in a frame/field adaptive predicted moving image coder having six kinds of prediction modes obtained by combining three prediction modes composed of said forward prediction mode, said backward prediction mode and said bidirectional prediction mode with two prediction modes composed of a frame prediction mode and a field prediction mode;

the frame/field adaptive predicted moving image coder comprises;

said forward frame predicting motion vector/prediction error amount detecting section;

said backward frame predicting motion vector/prediction error amount detecting section;

said odd/even field separating section;

said forward field predicting motion vector/prediction error amount detecting section;

said backward field predicting motion vector/prediction error amount detecting section; and

said comparator/mode selecting section, and

this comparator/mode selecting section determines selection of any one of the forward prediction mode, the backward prediction mode and the bidirectional prediction mode after the frame prediction mode or the field prediction mode is determined in use.

7. A moving image coder as claimed in claim 6, wherein each of the frame prediction mode and the field prediction mode in the comparator/mode selecting section is selectively set to a frame/field mode in a prediction system for providing a minimum prediction error amount among a forward frame prediction error amount, a forward field prediction error amount, a backward frame prediction error amount and a backward field prediction error amount;

the forward field prediction error amount is set to a sum of a forward directional odd field prediction error amount and a forward directional even field prediction error amount with respect to the same block as an object block of said forward frame prediction; and

the backward field prediction error amount is set to a sum of a backward directional odd field prediction error amount and a backward directional even field prediction error amount with respect to the same block as an object block of said backward frame prediction.

8. A moving image coder as claimed in claim 6, wherein a sum of said forward frame prediction error amount and said backward frame prediction error amount is compared with a sum of said forward directional odd field prediction error amount, said forward directional even field prediction error amount, said backward directional odd field prediction error amount and said backward directional even field prediction error amount;

and

each of the frame prediction mode and the field prediction mode in the comparator/mode selecting section is selectively set to a frame/field mode in a prediction system for providing a smaller prediction error amount among said two sums.

9. A moving image coder as claimed in claim 1, wherein the moving image coder is arranged in a frame/field adaptive predicted moving image coder having six kinds of prediction modes obtained by combining three prediction modes composed of said forward prediction mode, said backward prediction mode and said bidirectional prediction mode with two prediction modes composed of a frame prediction mode and a field prediction mode;

the frame/field adaptive predicted moving image coder comprises;

said forward frame predicting motion vector/prediction error amount detecting section;

said backward frame predicting motion vector/prediction error amount detecting section;

said odd/even field separating section;

said forward field predicting motion vector/prediction error amount detecting section;

said backward field predicting motion vector/prediction error amount detecting section; and

said comparator/mode selecting section, and

a sum of said forward frame prediction error amount, said forward directional odd field prediction error amount and said forward directional even field prediction error amount, and a sum of said backward frame prediction error amount, said backward directional odd field prediction error amount and said backward directional even field prediction error amount are input to said comparator/mode selecting section; and

selection of the frame prediction mode or the field prediction mode is determined by selecting a smaller one of said frame prediction error amount and the field prediction error amount as a sum of said odd field prediction error amount and said even field prediction error amount after one of the forward prediction mode, the backward prediction mode and the bidirectional prediction mode is determined in use.

10. A method for selecting one of a forward prediction mode, a backward prediction mode and a bidirectional prediction mode to be used for compressing a moving image sequence divided into frame blocks, comprising the steps of:

detecting an optimum motion vector from a past frame, making a prediction image, and calculating a first prediction error amount from a present frame;

detecting an optimum motion vector from a future frame, making a predicted image, and calculating a second prediction error amount from the present frame;

calculating a parameter as a function of difference between and/or ratio of said first and second prediction error amounts; and

selecting one of said forward prediction mode, said backward prediction mode and said bidirectional prediction mode by comparing a value of said parameter with predetermined thresholds, so that the selecting operation is performed without calculating bidirectional prediction error amount based on the forward prediction motion vector and the backward prediction motion vector.

11. A method as claimed in claim 10, wherein said step of calculating said parameter includes setting said parameter equal to a differential value between said first and said second prediction error amounts.

12. A method as claimed in claim 10, wherein said step of calculating said parameter includes setting said parameter equal to a ratio of said first and said second prediction error amounts.

13. A method as claimed in claim 10, wherein said step of calculating said parameter includes setting a first parameter equal to a difference between said first and said second prediction error amounts and setting a second parameter equal to a ratio of said first and said second prediction error amounts, and said selecting step is performed in accordance with a value of said first parameter and a value of said second parameter.

14. A method as claimed in claim 10 further comprising:

separating odd and even fields from each other;

detecting a forward field prediction motion vector and a prediction error amount every each of the separated odd and even fields; and

a backward field prediction motion vector and a prediction error amount.

15. A method as claimed in claim 14, wherein modes to be selected include six kinds of prediction modes obtained by combining three prediction modes composed of said forward prediction mode, said backward prediction mode and said bidirectional prediction mode with two prediction modes composed of a frame prediction mode and a field prediction mode, wherein said selecting step includes selecting of any one of the forward prediction mode, the backward prediction mode and the bidirectional prediction mode after determining whether the frame prediction mode or the field prediction mode is used.

16. A method as claimed in claim 15 further comprising:

setting said forward field prediction error amount equal to a sum of a forward directional odd field prediction error amount and a forward directional even field prediction error amount with respect to the same block as an object block of said step of detecting from said past frame; and

setting said backward field prediction error amount equal to a sum of a backward directional odd field prediction error amount and a backward directional even field prediction error amount with respect to the same block as an object block of said step of detecting from said future frame.

17. A method as claimed in claim 15, further comprising:

comparing a sum of said forward frame prediction error amount and said backward frame prediction error amount with a sum of said forward directional odd field prediction error amount, said forward directional even field prediction error amount, said backward directional odd field prediction error amount and said backward directional even field prediction error amount; and

selectively setting each of the frame prediction mode and the field prediction mode to a frame/field mode in a prediction system for providing a smaller prediction error amount among said two sums.

18. A method as claimed in claim 15, wherein modes to be selected include six kinds of prediction modes obtained by combining three prediction modes composed of said forward prediction mode, said backward prediction mode and said bidirectional prediction mode with two prediction modes composed of a frame prediction mode and a field prediction mode, further comprising:

computing a sum of said forward frame prediction error amount, said forward directional odd field prediction error amount and said forward directional even field prediction error amount, and a sum of said backward frame prediction error amount, said backward directional odd field prediction error amount and said backward directional even field prediction error amount; and

selecting the frame prediction mode or the field prediction mode by selecting a smaller one of said frame prediction error amount and said field prediction error amount as a sum of said odd field prediction error amount as a sum of said odd field prediction error amount and said even field prediction error amount after determining which one of the forward prediction mode, the backward prediction mode and the bidirectional prediction mode is in use.