Image processing method, image processing apparatus, and computer-readable recording medium storing image processing program

• US 20070070440A1
• Filed: 09/27/2006
• Published: 03/29/2007
• Est. Priority Date: 09/27/2005
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Ito, Wataru, Li, Yuanzhong
• Granted Patent: US 7,751,640 B2
• Time in Patent Office: Days
• US Class Current: 358/448
• CPC Class Codes: G06V 10/7557 based on appearance, e.g. active appearance models [AAM]
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement

Abstract

Sharpness is adjusted for more appropriately representing a predetermined structure in an image. A parameter acquisition unit obtains a weighting parameter for a principal component representing a degree of sharpness in a face region detected by a face detection unit as an example of the predetermined structure in the image, by fitting to the face region a mathematical model generated by a statistical method such as AAM based on a plurality of sample images representing human faces in different degrees of sharpness. Based on a value of the parameter, sharpness is adjusted in at least a part of the image. For example, a parameter changing unit changes the value of the parameter to a preset optimal face sharpness value, and an image reconstruction unit reconstructs the image based on the parameter having been changed and outputs the image having been subjected to the sharpness adjustment processing.

Claims

1. An image processing method comprising the steps of:

obtaining a weighting parameter for a statistical characteristic quantity representing a degree of sharpness in a predetermined structure in an input image by fitting a model representing the structure to the structure in the input image, the model obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different degrees of sharpness, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the degree of sharpness and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure; and

adjusting sharpness in at least a part of in the input image according to a value of the obtained weighting parameter.

2. An image processing apparatus comprising:

parameter acquisition means for obtaining a weighting parameter for a statistical characteristic quantity representing a degree of sharpness in a predetermined structure in an input image by fitting a model representing the structure to the structure in the input image, the model obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different degrees of sharpness, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the degree of sharpness and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure; and

sharpness adjustment means for carrying out sharpness adjustment in at least a part of the input image according to a value of the weighting parameter obtained by the parameter acquisition means.

3. The image processing apparatus according to claim 2, wherein the sharpness adjustment means carries out the sharpness adjustment in a region of the predetermined structure by changing the value of the weighting parameter for the characteristic quantity representing the degree of sharpness.

4. The image processing apparatus according to claim 2, wherein the sharpness adjustment means carries out the sharpness adjustment at processing strength based on the degree of sharpness of the structure corresponding to the value of the weighting parameter for the statistical characteristic quantity representing the degree of sharpness.

5. The image processing apparatus according to claim 2, wherein the sharpness adjustment means carries out as the sharpness adjustment at least either sharpness enhancement processing on a region of the predetermined structure in the input image or sharpness reduction processing on a region other than the region of the predetermined structure.

6. The image processing apparatus according to claim 2, wherein the sharpness adjustment means carries out the sharpness adjustment in the predetermined structure and in a region neighboring the predetermined structure and having the same color as the predetermined structure.

7. The image processing apparatus according to claim 2, wherein the sharpness adjustment means carries out the sharpness adjustment in a region where the sharpness adjustment is carried out, in such a manner that a degree of the adjustment becomes progressively smaller toward a region where the adjustment is not carried out.

8. The image processing apparatus according to claim 2 further comprising detection means for detecting the structure in the input image, wherein

the parameter acquisition means obtains the weighting parameter by fitting the model to the structure having been detected.

9. The image processing apparatus according to claim 2 further comprising selection means for obtaining at least one property of the structure in the input image and for selecting the model corresponding to the obtained property from a plurality of the models representing the structure for respective properties of the predetermined structure, wherein

the parameter acquisition means obtains the weighting parameter by fitting the selected model to the structure in the input image.

10. The image processing apparatus according to claim 2, wherein the predetermined structure is a human face.

11. The image processing apparatus according to claim 2, wherein the model and the fitting of the model are realized by a method of Active Appearance Model.

12. A computer-readable recording medium storing an image processing program causing a computer to function as:

parameter acquisition means for obtaining a weighting parameter for a statistical characteristic quantity representing a degree of sharpness in a predetermined structure in an input image by fitting a model representing the structure to the structure in the input image, the model obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different degrees of sharpness, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the degree of sharpness and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure; and

sharpness adjustment means for adjusting sharpness in at least a part of the input image according to a value of the weighting parameter obtained by the parameter acquisition means.