Method and apparatus for digital image manipulation to remove image blemishes

• US 7,545,994 B2
• Filed: 09/07/2007
• Issued: 06/09/2009
• Est. Priority Date: 01/06/2003
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Reid, Russell
• Primary Examiner(s): Hung; Yubin
• Application Number:
  US11/852,270
• Publication Number:
  US 20070297691A1
• Time in Patent Office: 641 Days
• Field of Search: 382/162, 382/167, 382/254, 382/274, 382/275, 345/586, 345/594, 345/606, 358/452, 358/463, 358/531, 358/537
• US Class Current: 382/275
• CPC Class Codes: G06V 10/46 Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features colour feature extraction G06V10/56
• CPC Class Codes: G06V 10/471 using approximation functions
• CPC Class Codes: H04N 1/4097 Removing errors due external factors, e.g. dust, scratches

Abstract

To better realize the great potential of amateur digital photography, the present invention introduces an intuitive system for digital manipulation. The system of the present invention allows a user to simply fix small blemishes in digital images. In one embodiment, the user merely places a cursor on the image blemish and activates a cursor control device such as a mouse button. In one embodiment, the blemish repair system is implemented using one of Dirichlet'"'"'s theorems. The theorem provides a method of creating a smooth surface within a circle by using the values of points around the circle. To prevent the result from appearing too smooth, some pixelization may be added.

Claims

1. A method of editing a digital image, the method comprising:

receiving an identification of a blemish in the digital image;

interpolating a smooth function defined by a first set of pixels that define a border around the blemish;

filling an area within the border with a second set of pixels the values of which are defined by the function;

reducing smoothness of the second set of pixels of said area, after the removal of the blemish, by pixelization of the area, wherein the pixelization is a function of a brightness variance around the area; and

wherein the receiving, the interpolating, the filling and the reducing steps are performed by a computer.

2. A method of editing a digital image, the method comprising:

receiving an identification of a blemish in the digital image;

interpolating a smooth function defined by a first set of pixels that define a border around the blemish;

filling an area within the border with a second set of pixels the values of which are defined by the function, wherein a size of the area is a function of a size of the digital image;

reducing smoothness of the second set of pixels of said area, after the removal of the blemish, by pixelization of the area; and

wherein the receiving, the interpolating, the filling and the reducing steps are performed by a computer.

3. The method of claim 2, wherein the interpolating a smooth function is performed using Dirichiet'"'"'s Theorem.

4. The method of claim 2 further comprising reducing smoothness of the second set of pixels of said area, after the removal of the blemish, by adding Gaussian noise.

5. The method of claim 2, wherein interpolating a smooth function comprises performing a discrete integral around the area.

6. A method of editing a digital image, the method comprising:

activating a blemish removal control to display a blemish removal tool;

moving the blemish removal tool to identify an area that contains or comprises a blemish in the digital image;

performing a cursor control operation with the blemish removal tool to automatically remove the blemish from said area;

causing pixelization in the identified area to reduce smoothness of said area after the removal of the blemish, wherein said pixelization is a function of a brightness variance around the area around said blemish; and

wherein at least the activating and the causing steps are performed by a computer.

7. The method of claim 6, wherein the blemish removal tool comprises a visible boundary of a shape.

8. The method of claim 7, wherein identifying the blemish comprises surrounding the blemish with the visible boundary of the shape.

9. The method of claim 6, wherein identifying the blemish and automatically removing the blemish comprises a cursor control operation of the blemish removal tool.

10. The method of claim 6, wherein a cursor control device operates on the blemish removal tool.

11. A computer readable storage medium storing a computer program which when executed by one or more processors repairs a blemish in a digital image, the computer program comprising sets of instructions for:

receiving an identification of a blemish;

interpolating a smooth function defined by a first set of pixels that define a border around the blemish;

filling an area around the blemish with a second set of pixels created by the function; and

reducing smoothness of the second set of pixels of said area, after the removal of the blemish, by pixelization of the area around the blemish, wherein the pixelization is a function of a brightness variance around the area around the blemish.

12. The computer readable storage medium of claim 11, wherein the set of instructions for interpolating a smooth function comprises instructions to use Dirichlet'"'"'s Theorem.

13. The computer readable storage medium of claim 11, wherein the set of instructions for pixelization further comprises instructions for adding Gaussian noise to said area.

14. A computer readable storage medium storing a computer program, executable by one or more processors, said computer program comprising sets of instructions for a graphical user interface (“

GUI”

), the GUI comprising;

a display area for displaying an image;

a blemish removal tool for (i) identifying a region containing a blemish in the image, and (ii) initiating an automated removal of the blemish from the image, wherein the automated removal comprises pixelization of the image to reduce smoothness of said region after the removal of the blemish, wherein said pixelization is a function of brightness variance around said region; and

a blemish removal control for causing the GUI to display the blemish removal tool.

15. The computer readable storage medium of claim 14, wherein said pixelization is modulated with Gaussian noise.