Method and apparatus for digital image manipulation to remove image blemishes

• US 7,277,595 B1
• Filed: 01/06/2003
• Issued: 10/02/2007
• Est. Priority Date: 01/06/2003
• Status: Expired due to Fees

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Reid, Russell
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): Hung; Yubin
• Application Number:
  US10/338,786
• Time in Patent Office: 1,730 Days
• Field of Search: 382/162, 382/254, 382/274, 382/275, 382/167, 345/441, 345/442, 358/452, 358/453, 358/531, 358518-523
• US Class Current: 382/275
• CPC Class Codes: G06V 10/46 Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features colour feature extraction G06V10/56
• CPC Class Codes: G06V 10/471 using approximation functions
• CPC Class Codes: H04N 1/4097 Removing errors due external factors, e.g. dust, scratches

Abstract

To better realize the great potential of amateur digital photography, the present invention introduces an intuitive system for digital manipulation. The system of the present invention allows a user to simply fix small blemishes in digital images. In one embodiment, the user merely places a cursor on the image blemish and activates a cursor control device such as a mouse button. In one embodiment, the blemish repair system is implemented using one of Dirichlet'"'"'s theorems. The theorem provides a method of creating a smooth surface within a circle by using the values of points around the circle. To prevent the result from appearing too smooth, some pixelization may be added.

Claims

1. A method of repairing a blemish in a digital image, said method comprising:

identifying a circle about said blemish;

interpolating a smooth function defined by a first set of pixels that define a border of said circle around said blemish;

filling said circle with a second set of pixels created by said function;

reducing a smoothness of the second set of pixels within said circle; and

causing pixelization in said circle to reduce said smoothness, wherein said pixelization is a function of a brightness variance around said circle.

2. The method as claimed in claim 1 wherein interpolating a smooth function is performed using Dirichlet'"'"'s Theorem.

3. The method as claimed in claim 1 wherein said pixelization includes Gaussian noise.

4. The method as claimed in claim 1 wherein interpolating a smooth function is performed by performing a discrete integral around said circle.

5. A method of repairing a blemish in a digital image, said method comprising:

identifying a circle about said blemish;

interpolating a smooth function defined by a first set of pixels that define a border of said circle around said blemish;

filling said circle with a second set of pixels created by said function; and

reducing a smoothness of the second set of pixels within said circle, wherein a radius of said circle is a function of a size of said digital image.

6. A method of repairing a blemish in a digital image, the method comprising:

activating a blemish removal control to display a blemish removal tool;

moving said blemish removal tool to identify a circle with the blemish;

performing a cursor control operation with said blemish removal tool to automatically remove a blemish; and

causing pixelization in said circle to reduce a smoothness, wherein said pixelization is a function of a brightness variance around said circle.

7. The method of claim 6, wherein the blemish removal tool comprises a visible boundary of a circle.

8. The method of claim 7, wherein identifying said circle comprises surrounding the blemish with said visible boundary of the circle.

9. The method of claim 6, wherein identifying the circle and automatically removing the blemish comprises a cursor control operation of the blemish removal tool.

10. The method of claim 6, wherein a cursor control device operates on the blemish removal tool.

11. The method of claim 6, wherein the cursor control operation is a click.

12. A computer readable medium comprising a computer program for repairing a blemish in a digital image said computer program comprising sets of instructions for:

identifying a circle about said blemish, wherein a radius of said circle is a function of a size of said digital image;

interpolating a smooth function defined by a first set of pixels that define a border of said circle around said blemish;

filling said circle with a second set of pixels created by said function; and

reducing a smoothness of the second set of pixels within said circle.

13. The computer readable medium as claimed in claim 12 wherein said instructions for interpolating a smooth function comprise instructions for using Dirichlet'"'"'s Theorem.

14. The computer readable medium claimed in claim 12, said computer program further comprising a set of instructions for:

causing pixelization in said circle to reduce said smoothness.

15. The computer readable medium as claimed in claim 14 wherein said pixelization comprises Gaussian noise.

16. The computer readable medium as claimed in claim 12 wherein said set of instructions for interpolating a smooth function comprises instructions for performing a discrete integral around said circle.

17. The computer readable medium of claim 12, wherein said set of instructions for reducing a smoothness comprises instructions for adding Gaussian noise.

18. A computer readable medium comprising a computer program for repairing a blemish in a digital image, said computer program comprising sets of instructions for:

identifying a circle about said blemish;

interpolating a smooth function defined by a first set of pixels that define a border of said circle around said blemish;

filling said circle with a second set of pixels created by said function;

reducing a smoothness of the second set of pixels within said circle; and

causing pixelization in said circle to reduce said smoothness, wherein said pixelization is a function of a brightness variance around said circle.

19. A graphical user interface (“

GUI”

) for an application, the GUI comprising;

a display area for displaying an image;

a blemish removal tool; and

a blemish removal control for causing the GUI to display the blemish removal tool, wherein the blemish removal tool is for identifying a circle with a blemish in the image and for activating to cause the automated removal of a blemish from the image, wherein a radius of said circle is a function of a size of said image.

20. The GUI of claim 19, wherein the blemish removal tool is movable using a cursor control device.

21. The GUI of claim 19, wherein the blemish removal tool activates through an operation of the cursor control device.

22. The GUI of claim 19, wherein the automated removal of the blemish is achieved by filling in a selected circle with pixels based on the pixels around the selected circle.

23. The GUI of claim 22, wherein the automated removal of the blemish is further achieved by adding noise to the selected circle.

24. The GUI of claim 23, wherein the noise is Gaussian noise.

25. The GUI of claim 19, wherein the blemish removal tool for identifying the circle is movable to surround the circle.

26. The GUI of claim 25, wherein the blemish removal tool is activated by a switch on the cursor control device.

27. The GUI of claim 19, wherein the blemish removal tool acts as a cursor, moves via a cursor control device movement action, and activates by a cursor control device click.