Method and apparatus for filtering and coding images based on characteristics of an input image signal

• US 5,543,848 A
• Filed: 12/14/1994
• Issued: 08/06/1996
• Est. Priority Date: 12/25/1992
• Status: Expired due to Term

• Current Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Murakami, Tokumichi, Kato, Yoshiaki, Shimada, Toshiaki
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): LEE, RICHARD J
• Application Number:
  US08/355,987
• Time in Patent Office: 601 Days
• Field of Search: 348/384, 348/390, 348/400, 348/401, 348/402, 348/409, 348/412, 348/415, 348/416, 348/405, 348/419, 348/420
• US Class Current: 348/416.1
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/112 according to a given display mode, e.g. for interlaced or progressive display mode
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

An interframe coding system which eliminates higher frequency components contained in an image signal effectively and adaptively with an adaptive filter provided in a coding loop. The adaptive filter eliminates the higher frequency components with the optimal filtering intensity for an image signal specified with a filtering coefficient which is decided by a filter controller. The filtering coefficient is decided by normalization of the difference between an input image signal and a predictive signal from a frame memory by the "Activity" of the input image signal or the predictive signal. The "Activity" can be based upon the sum of the absolute or squared difference values based upon the mean value of luminance intensity of pixels of the image signal.

Claims

1. An interframe coding system for frame-to-frame coding of an input signal, comprising:

a subtractor having inputs to receive the input signal and a predictive signal and an output to provide a predictive error signal corresponding to a difference between the input signal and the predictive signal;

an encoder having an input coupled to the output of the subtractor to receive the predictive error signal, having an output that provides a coded predictive error signal, and having a control input that receives a coding control signal for controlling a quantization step size of the encoder;

decoding means for producing a decoded signal having an input coupled to the output of the encoder to receive the coded predictive error signal, having an input to receive the predictive signal, and having an output that provides the decoded signal;

a frame memory having an input that receives the decoded signal and having an output that provides the predictive signal;

a controller having inputs that receive the input signal and the predictive signal, that calculates a difference between the input signal and the predictive signal and generates the coding control signal based on the difference, and having an output coupled to the control input of the encoder that provides the coding control signal for controlling the encoder.

2. The interframe coding system of claim 1, wherein the controller includes:

a difference calculator that receives the input signal and the predictive signal that calculates a difference between the input signal and the predictive signal and that outputs a difference signal;

a pixel difference calculator that receives the difference signal, that calculates an average value of the difference per each pixel, and that outputs the difference value per each pixel as the coding control signal, to the encoder; and

wherein the encoder includes means for quantizing the input signal with a step size and for changing the step size of quantization in response to the coding control signal so that coding error becomes smaller than the average value of the difference per each pixel.

3. The interframe coding system of claim 1, further including a motion vector detector which receives the input signal and a previous input signal, output by the frame memory, and outputs a motion vector signal and wherein the frame memory receives the motion vector signal and the decoded signal and outputs the predictive signal.

4. The interframe coding system of claim 1, wherein the interframe coding system further includes a filter, having inputs that receive a filter control signal and the predictive signal and having an output that provides the predictive signal, the filter setting characteristics of the filter in response to the filter control signal;

and

the controller further includes a difference calculator that receives the input signal and the predictive signal, that calculates a difference between the input signal and the predictive signal and that outputs a difference signal, and means for generating the filter control signal responsive to the input signal and the predictive signal, said means having an output coupled to the filter.

5. The interframe coding system of claim 4, wherein the filter is any one of a one dimensional filter, a two dimensional filter and a three dimensional filter.

6. The interframe coding system of claim 5, wherein the one of the one-dimensional filter and the two-dimensional filter is achieved by intra-block filtering using only filtering coefficients, within a corresponding matrix of pixels, of the input signal.

7. The interframe coding system of claim 5, wherein the one of the one-dimensional filter and the two-dimensional filter is achieved by inter-block filtering using filtering coefficients, corresponding to pixels within an adjacent matrix of pixels of the input signal.

8. The interframe coding system of claim 4, wherein the controller further comprises a decision unit that receives the difference signal and the input signal, that calculates an activity value of the input signal and that outputs the filter control signal;

and

wherein the filter includes a plurality of patterns of filtering coefficients and a means for selecting one of the plurality of patterns of filtering coefficients in response to the filter control signal.

9. The interframe coding system of claim 8, wherein the decision unit includes means for normalizing the difference signal by the activity value to provide the filter control signal.

10. The interframe coding system of claim 8, wherein the decision unit includes means for calculating a characteristic of the input signal, for comparing the characteristic with a predefined threshold value and for issuing the filter control signal in response to a comparison result.

11. The interframe coding system of claim 8, wherein the difference signal is a summation, for each pixel, of an absolute value of a difference between the input signal and the predictive signal.

12. The interframe coding system of claim 8, wherein the difference signal is a summation, for each pixel, of a squared value of a difference between the input signal and the predictive signal.

13. The interframe coding system of claim 8, wherein the activity value is a difference between a maximum intensity of the input signal and a minimum intensity of the input signal.

14. The interframe coding system of claim 8, wherein the activity value is a summation of an absolute value of a difference between a mean value of a luminance intensity of the input signal and a luminance intensity of each pixel of the input signal.

15. The interframe coding system of claim 8, wherein the activity value is a summation of a squared value of a difference between a mean value of a luminance intensity of the input signal and a luminance intensity of each pixel of the input signal.

16. The interframe coding system of claim 4, wherein the controller further comprises:

a decision unit that receives the difference signal and the predictive signal, that calculates an activity value of the predictive signal and that normalizes the difference signal by the activity value to produce the filter control signal; and

wherein the filter includes a plurality of patterns of filtering coefficients and a means for selecting one of the plurality of patterns of filtering coefficients in response to the filter control signal.

17. The interframe coding system of claim 16, wherein the difference signal is a summation, for each pixel, of an absolute value of a difference between the input signal and the predictive signal.

18. The interframe coding system of claim 16, wherein the difference signal is a summation, for each pixel, of a squared value of a difference between the input signal and the predictive signal.

19. The interframe coding system of claim 16, wherein the activity value is a difference between a maximum intensity of the predictive signal and a minimum intensity of the predictive signal.

20. The interframe coding system of claim 16, wherein the activity value is a summation of an absolute value of a difference between a mean value of a luminance intensity of the predictive signal and a luminance intensity of each pixel of the predictive signal.

21. The interframe coding system of claim 16, wherein the activity value is a summation of a squared value of a difference between a mean value of a luminance intensity of the predictive signal and a luminance intensity of each pixel of the predictive signal.

22. The interframe coding system of claims 8 or 16, wherein the decision unit includes means for comparing the difference signal and a predefined threshold value and for issuing the filter control signal in response to a comparison result.

23. The interframe coding system of claim 22, wherein if the difference signal is greater than the predefined threshold value, the filter control signal is issued so as to turn on the filter to filter out any high frequency components of the predictive signal.

24. The interframe coding system of claim 22, wherein if the difference signal is less than the predefined threshold value, the filter control signal is issued so as to bias off the filter.

25. The interframe coding system of claims 8 or 16, wherein the decision unit includes means for comparing the activity value and a predefined threshold value and for issuing the filter control signal, and wherein if the activity value is less than the predefined threshold value, the filter control signal is issued so as to bias on the filter and so as to filter out any high frequency components from the predictive signal.

26. The interframe coding system of claims 8 or 16, wherein the decision unit includes means for comparing the activity value and a predefined threshold value and for issuing the filter control signal, and wherein if the activity value is greater than the predefined threshold value, the filter control signal is issued so as to bias off the filter.

27. The interframe coding system of claims 8 or 16, wherein the decision unit further includes:

means for dividing the difference signal by the activity value and for outputting a division result; and

means for comparing the division result and a predefined threshold value and for issuing the filter control signal, wherein if the division result is less than the predefined threshold value, the filter control signal is issued to bias off the filter.

28. The interframe coding system of claims 8 or 16, wherein the decision unit further comprises:

means for dividing the difference signal by the activity value and for outputting a division result; and

means for comparing the division result and a predefined threshold value and for issuing the filter control signal, wherein if the division result is greater than the predefined threshold value, the filter control signal is issued so as to bias on the filter so as to filter out any high frequency components from the predictive signal.

29. An interframe coding system for frame-to-frame coding of an input signal, comprising:

a subtractor having inputs to receive the input signal and a predictive signal and an output to provide a predictive error signal corresponding to a difference between the input signal and the predictive signal;

an encoder having an input coupled to the output of the subtractor to receive the predictive error signal, having an output that provides a coded predictive error signal, and having a control input that receives a coding control signal for controlling a quantization step size of the encoder;

decoding means for producing a decoded signal having an input coupled to the output of the encoder to receive the coded predictive error signal, having an input to receive the predictive signal, and having an output that provides the decoded signal;

a frame memory having an input that receives the decoded signal, and having an output that provides the predictive signal;

a controller that receives the input signal and the predictive signal, that calculates an activity value from at least one of the input signal and the predictive signal and that outputs the coding control signal based on the activity value to the encoder to control the quantization step size of the encoder.

30. An interframe coding method for frame-to-frame coding of an input signal in a coding system, wherein the coding system includes a local decoding loop including an encoder for interframe coding a predictive error signal, a subtractor that receives the input signal and a predictive signal and provides the predictive error signal corresponding to a difference between the predictive signal and the input signal, decoding means for producing a decoded signal, a frame memory for receiving the decoded signal and outputting the predictive signal, and a controller that receives the input signal and the predictive signal and provides a coding control signal to the encoder, the interframe coding method comprising the steps of:

(a) calculating a difference, with the controller, between the input signal and the predictive signal and generating the coding control signal based on the difference;

(b) selecting a step size of quantization, in the encoder, responsive to the coding control signal; and

(c) coding the predictive error signal based on the selected step size of quantization.

31. An interframe coding method for frame-to-frame coding of an input signal in a coding system, wherein the coding system includes a local decoding loop including an encoder for interframe coding a predictive error signal, a subtractor that receives the input signal and a predictive signal and provides the predictive error signal corresponding to a difference between the predictive signal and the input signal, decoding means for producing a decoded signal, a frame memory for receiving the decoded signal and outputting the predictive signal, and a controller that receives the input signal and the predictive signal and provides a control signal to the encoder, the interframe coding method comprising the steps of:

(a) providing a characteristic signal from the controller indicating a relative characteristic of one of the input signal and the predictive signal;

(b) selecting a step size of quantization, in the encoder, based on the characteristic signal; and

,

(c) coding the predictive error signal based on the selected step size of quantization.

32. An interframe coding system for frame-to-frame coding of an input signal including a local decoding loop, comprising:

a subtractor, responsive to the input signal and a predictive signal that provides a predictive error signal corresponding to a difference between the input signal and the predictive error signal;

an encoder, responsive to the predictive error signal and a coding control signal, for interframe coding of the predictive error signal and for outputting an encoded signal, the encoder selecting a step size of quantization in response to the coding control signal;

a decoder, responsive to the encoded signal, that decodes the encoded signal and outputs a decoded signal;

a frame memory, responsive to the decoded signal, that calculates the predictive signal, corresponding to a motion compensation prediction of the input signal based on a previous image signal, and that outputs the predictive signal; and

a controller having inputs that receive the input signal and the predictive signal, that calculates a difference between the input signal and the predictive signal and that generates the coding control signal based on the difference.

33. An interframe coding system for frame-to-frame coding of an input signal, comprising:

a subtractor, responsive to the input signal and a predictive signal that provides a predictive error signal corresponding to a difference between the input signal and the predictive error signal;

an encoder, responsive to the predictive error signal and a coding control signal, for interframe coding of the predictive error signal and for outputting an encoded signal, the encoder selecting a step size of quantization in response to the coding control signal;

a decoder, responsive to the encoded signal, that decodes the encoded signal and outputs a decoded signal;

a frame memory, responsive to the decoded signal, that calculates the predictive signal, corresponding to a difference between the input signal and a previous input signal, and that outputs the predictive signal; and

a controller, responsive to the input signal and the predictive signal, that calculates an activity value from at least one of the input signal and the predictive signal and that outputs the coding control signal based on the activity value.