Signal processing device, control method for signal processing device, control program, and computer-readable storage medium having the control program recorded therein

• US 8,655,101 B2
• Filed: 01/20/2010
• Issued: 02/18/2014
• Est. Priority Date: 06/04/2009
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Gohshi, Seiichi
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US13/375,251
• Publication Number:
  US 20120070098A1
• Time in Patent Office: 1,490 Days
• Field of Search: 382/260, 382/263, 382/274, 382/275, 358/3.26, 358/3.27, 358/463
• US Class Current: 382/275
• CPC Class Codes: G06T 5/003 Deblurring; Sharpening vibration or motion blur correction for cameras comprising an electronic image sensor H04N23/682
• CPC Class Codes: G06T 5/10 using non-spatial domain filtering
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement
• CPC Class Codes: H04N 5/142 Edging; Contouring
• CPC Class Codes: H04N 5/208 for compensating for attenuation of high frequency components, e.g. crispening, aperture distortion correction

Abstract

A signal processing device first decomposes an input signal into a plurality of frequency components in different frequency ranges, then causes a higher harmonic wave generating section to generate a higher harmonic for each of a part or all of frequency components obtained by removing a frequency component in the lowest frequency range from frequency components obtained by the decomposition, and finally composes (i) the higher harmonic thus generated and (ii) a frequency component for which no higher harmonic has been generated. The higher harmonic wave generating section adds the frequency component and a nonlinear process signal (i) in which positive and negative signs of a frequency component for which the higher harmonic is to be generated are retained and (ii) which broadly monotonically increases nonlinearly with respect to the frequency component when the frequency component is located at least in the vicinity of zero.

Claims

1. A signal processing device which carries out a process for sharpening an image with respect to an input signal representing the image, so as to output an output signal representing the image which has been sharpened,

said signal processing device comprising:

frequency component decomposition means for decomposing the input signal into a plurality of frequency components in different frequency ranges;

higher harmonic wave generating means for generating a higher harmonic wave for each of a part or all of frequency components obtained by removing a frequency component in the lowest frequency range from frequency components into which the frequency component decomposition means has decomposed; and

output signal generating means for composing (i) the higher harmonic wave generated by the higher harmonic wave generating means and (ii) a frequency component for which no higher harmonic wave has been generated by the higher harmonic wave generating means of the frequency components into which the frequency component decomposition means has decomposed, so as to generate the output signal,

the higher harmonic wave generating means including;

nonlinear process means for generating a nonlinear process signal (i) in which positive and negative signs of a frequency component for which the higher harmonic wave is to be generated are retained and (ii) which broadly monotonically increases nonlinearly with respect to the frequency component when the frequency component is located at least in the vicinity of 0 (zero); and

addition means for adding the nonlinear process signal to the frequency component, so as to generate the higher harmonic wave.

2. The signal processing device as set forth in claim 1, wherein:

the nonlinear process means includes;

even exponentiation operation means for generating an even exponentiation signal by raising, to an even exponent not less than 2, the frequency component for which the higher harmonic wave is to be generated; and

sign changing means for generating the nonlinear process signal by reversing positive and negative signs of a part of the even exponentiation signal which part is different in sign from the frequency component which has not been raised.

3. The signal processing device as set forth in claim 1, wherein:

the nonlinear process means includes;

even exponentiation operation means for generating an even exponentiation signal by raising, to an even exponent not less than 2, the frequency component for which the higher harmonic wave is to be generated;

differentiation means for generating a differential signal by differentiating the even exponentiation signal; and

sign changing means for generating the nonlinear process signal by reversing positive and negative signs of a part of the differential signal which part is different in sign from the frequency component which has not been raised.

4. The signal processing device as set forth in claim 1, wherein the nonlinear process means includes odd exponentiation operation means for generating the nonlinear process signal by raising, to an odd exponent not less than 3, the frequency component for which the higher harmonic wave is to be generated.

5. The signal processing device as set forth in claim 1, wherein the higher harmonic wave generating means further includes noise removing means for removing noise contained in the frequency component for which the higher harmonic wave is to be generated by the nonlinear process means.

6. The signal processing device as set forth in claim 1, wherein the nonlinear process means further includes amplitude adjustment means for adjusting an amplitude of the nonlinear process signal by multiplying the amplitude by a specific multiplying factor.

7. The signal processing device as set forth in claim 6, wherein the amplitude adjustment means further removes a signal of the nonlinear process signal, the signal having an absolute value which is greater than an upper limit value.

8. The signal processing device as set forth in claim 6, wherein the specific multiplying factor is set for each frequency component for which the higher harmonic wave is to be generated.

9. The signal processing device as set forth in claim 1, wherein:

the input signal represents a pixel group of pixels which are provided so as to be adjacent to each other in a horizontal direction of the image represented by the input signal; and

the frequency component decomposition means decomposes the input signal into a plurality of frequency components in different frequency ranges.

10. The signal processing device as set forth in claim 1, wherein the frequency component decomposition means decomposes, into a plurality of frequency components in different frequency ranges, a signal representing a pixel group of pixels which are provided so as to be adjacent to each other in a vertical direction of the image represented by the input signal.

11. The signal processing device as set forth in claim 1, wherein:

the input signal represents a moving image; and

the frequency component decomposition means decomposes, into a plurality of frequency components in different frequency ranges, a signal representing a pixel group of pixels which are provided so as to be adjacent to each other in a time direction of the moving image represented by the input signal.

12. The signal processing device as set forth in claim 1, wherein:

the frequency component decomposition means uses a Laplacian pyramid algorithm to decompose the input signal into a plurality of frequency components in different frequency ranges; and

the output signal generating means uses the Laplacian pyramid algorithm to generate the output signal.

13. The signal processing device as set forth in claim 1, wherein:

the frequency component decomposition means uses a wavelet transform to decompose the input signal into a plurality of frequency components in different frequency ranges; and

the output signal generating means uses a wavelet inverse transform to generate the output signal.

14. The signal processing device as set forth in claim 13, wherein Quadrature Mirror Filters have frequency characteristics which are in asymmetry, the Quadrature Mirror Filters being used in pairs in the wavelet transform and the wavelet inverse transform.

16. A control program for causing a computer included in a signal processing device recited in claim 1 to operate, the control program causing the computer to function as each means of the signal processing device.

17. A computer-readable storage medium in which the control program recited in claim 16 is recorded.

15. A method for controlling a signal processing device which carries out a process for sharpening an image with respect to an input signal representing the image, so as to output an output signal representing the image which has been sharpened,

said method comprising the steps of:

(a) decomposing the input signal into a plurality of frequency components in different frequency ranges;

(b) generating a higher harmonic wave for each of a part or all of frequency components obtained by removing a frequency component in the lowest frequency range from frequency components into which the step (a) has decomposed; and

(c) composing (i) the higher harmonic wave generated by the step (b) and (ii) a frequency component for which no higher harmonic wave has been generated by the step (b) of the frequency components into which the step (a) has decomposed, so as to generate the output signal,

the step (b) including the steps of;

(d) generating a nonlinear process signal (i) in which positive and negative signs of a frequency component for which the higher harmonic wave is to be generated are retained and (ii) which broadly monotonically increases nonlinearly with respect to the frequency component when the frequency component is located at least in the vicinity of 0 (zero); and

(e) adding the nonlinear process signal to the frequency component, so as to generate the higher harmonic wave.