Image processing method and apparatus

• US 6,628,842 B1
• Filed: 06/22/2000
• Issued: 09/30/2003
• Est. Priority Date: 06/22/1999
• Status: Expired due to Term

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Nagao, Kimitoshi
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Kassa, Yosef
• Application Number:
  US09/598,762
• Time in Patent Office: 1,195 Days
• Field of Search: 382/165, 382/167, 382/190, 382/199, 382/219, 382/220, 382/250, 382/251, 382/252, 382/255, 382/256, 382/260, 382/261, 382/262, 382/263, 382/264, 382/265, 382/266, 382/269, 382/272, 382/274, 382/275, 382/278, 382/282, 382/286, 382/287, 382/295, 382/298, 382/299, 382/300, 382/309, 348/607, 348/610, 348/615, 348/622, 348/625, 348/627, 358/3.26, 358/3.27, 358/532, 358/537, 358/540, 358/463, 358/464
• US Class Current: 382/266
• CPC Class Codes: G06T 5/75 Unsharp masking
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement

Abstract

The image processing method and apparatus enhance the sharpness of photographic images recorded by a silver halide photographic system or a digital still camera. The method and apparatus determine a blur retaining but sharpness enhancing coefficient for enhancing sharpness of an edge region of an object but retaining blur of the image in the other region of the edge region of the object based on an edge intensity data obtained by performing edge detection on an original image data, subtract the original image data from sharpness enhanced image data obtained by applying sharpness enhancement, multiply the subtracting result by the blur retaining but sharpness enhancing coefficient and add the resulting product to the original image data to generate processed image data. In the method and apparatus, the principal object is enhanced in sharpness while, at the same time, the blur caused by the taking lens system is the background not including the principal object is recognized and kept as it is, so that a natural image retaining the photograph-like blur, that is, blurring quality can be produced.

Claims

1. An image processing method comprising the steps of:

applying sharpness enhancement to original image data to generate sharpness enhanced image data for a wholly sharpened image;

performing edge detection on said original image data to determine edge intensity data for distinguishing an edge region of an object and the other region in an image;

determining a blur retaining but sharpness enhancing coefficient for enhancing sharpness of the edge region of the object but retaining blur of the image in the other region of the edge region of the object based on the edge intensity data;

subtracting said original image data from said sharpness enhanced image data to generate a sharpness enhancing component;

multiplying the sharpness enhancing component by said blur retaining but sharpness enhancing coefficient to give a blur retaining but sharpness enhancing component; and

adding the blur retaining but sharpness enhancing component to said original image data to generate processed image data for an image enhanced in the sharpness while retaining the blur.

2. The method according to claim 1, wherein said other region of the edge region of the object includes a blurred image region in which the blur of the image is to be retained.

3. The method according to claim 2, wherein said blur retaining but sharpness enhancing coefficient has a value equal or nearly equal to 1.0 in said edge region of the object, slowly decreases with the increasing distance from said edge region of the object and has a preset value of from 0.0 to less than 1.0 in the blurred image region.

4. The method according to claim 2, wherein said blur retaining but sharpness enhancing coefficient is expressed by the following equation (1):

5. The method according to claim 1, further comprising the steps of:

smoothing said original image data to generate smoothed image data;

subtracting said smoothed image data from said sharpness enhanced image data to generate an edge/noise component including both a sharpness enhanced edge component of an object image and a sharpness enhanced noise component;

determining a noise region weighting coefficient from said edge intensity data, identifying a noise component based on said noise region weighting coefficient and said noise/edge component and producing a noise suppressing component that introduces small variations in the noise component; and

scaling said blur retaining but sharpness enhancing component to generate a first scaled component, adding the first scaled component to said original image data, scaling said noise suppressing component to generate a second scaled component and subtracting the second scaled component from said original image data, thereby creating the processed image data for the image that retains the blur but which is enhanced in sharpness and has the noise component suppressed.

6. An image processing apparatus comprising:

a sharpness enhancing unit for applying sharpness enhancement to original image data to generate sharpness enhanced image data for a wholly sharpened image;

an edge detecting and computing unit for performing edge detection on said original image data and determining edge enhancement data for distinguishing between an edge region of an object and the other region in an image;

a blur retaining coefficient computing unit by which a blur retaining but sharpness enhancing coefficient for retaining blur of the image in the other region of the edge region of the object is determined from said edge intensity data;

a blur retaining but sharpness enhancing component computing unit for producing a blur retaining but sharpness enhancing component from said original image data, the sharpness enhanced image data generated in said sharpness enhancing unit, and the blur retaining but sharpness enhancing coefficient determined in said blur retaining coefficient computing unit; and

a blur retaining and sharpness enhancing unit for adding said blur retaining but sharpness enhancing component produced by said blur retaining but sharpness enhancing component computing unit to said original image data, thereby creating processed image data for an image that retains the blur but which is enhanced in the sharpness.

7. The apparatus according to claim 6, wherein said other region of the edge region of the object includes a blurred image region in which the blur of the image is to be retained.

8. The apparatus according to claim 7, wherein said blur retaining but sharpness enhancing coefficient has a value equal or nearly equal to 1.0 in said edge region of the object, slowly decreases with the increasing distance from said edge region of the object and has a preset value of from 0.0 to less than 1.0 in the blurred image region.

9. The apparatus according to claim 7, wherein said blur retaining but sharpness enhancing coefficient is expressed by the following equation (1):

10. The apparatus according to claim 6, further comprising:

a smoothing unit for smoothing said original image data to generate smoothed image data;

a noise region weighting coefficient computing unit for determining a noise region weighting coefficient from said edge intensity data;

an edge/noise component extracting unit for subtracting said smoothed image data from said sharpness enhanced image data to generate an edge/noise component including both a sharpness enhanced edge component of an object image and a sharpness enhanced noise component;

a noise suppressing component computing section for identifying a noise component based on said edge/noise component and said noise region weighting coefficient and producing a noise suppressing component that introduces small variations in the noise component; and

a blur retaining, sharpness enhancing and noise suppressing section for scaling said blur retaining but sharpness enhancing component to generate a first scaled component, adding the first scaled component to said original image data, scaling said noise suppressing component to generate a second scaled component and subtracting the second scaled component from said original image data, thereby creating the processed image data for the image that retains the blur but which is enhanced in the sharpness and has the noise component suppressed.