Method and apparatus for the removal of flash artifacts

• US 20050094895A1
• Filed: 12/13/2004
• Published: 05/05/2005
• Est. Priority Date: 04/11/2001
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Baron, John M.
• Granted Patent: US 7,027,662 B2
• Time in Patent Office: Days
• US Class Current: 382/275
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

An image without use of a flash is taken, along with an image using a flash. A difference image is generated by subtracting the flash-less image from the flash image. A threshold is applied to the difference image such that only large differences in intensity remain in the difference image. This artifact image is then subtracted from the flash image, thereby removing flash artifacts such as specular reflections and red-eye. The threshold used may be automatically calculated or may be set by the user. For some applications it may be desirable to set separate thresholds for each dimension of the color space (such as red, green, and blue) used. Once again these separate thresholds may be automatically calculated or may be set by the user.

Claims

1. A method for removing flash artifacts comprising the steps of:

a) capturing a first digital image of a subject;

b) capturing a second digital image of said subject with the use of a flash;

c) selecting an intensity threshold; and

d) for each pixel to be processed performing the sub-steps of;

i) subtracting intensity of current pixel in said first digital image from intensity of current pixel in said second digital image resulting in a pixel difference; and

ii) replacing current pixel in said second digital image with current pixel from said first digital image when said pixel difference is greater than said intensity threshold.

2. A method for removing flash artifacts as recited in claim 1, wherein said intensity threshold is set by a user.

3. A method for removing flash artifacts as recited in claim 1, further comprising the step of:

e) after all of said pixels to be processed have been processed, saving said second digital image in a memory device as a final digital image.

4. A method for removing flash artifacts comprising the steps of:

a) capturing a first digital image of a subject;

b) capturing a second digital image of said subject with the use of a flash;

c) selecting an intensity threshold; and

d) for each pixel to be processed performing the sub-steps of;

i) subtracting intensity of current pixel in said first digital image from intensity of current pixel in said second digital image resulting in a pixel difference; and

ii) replacing current pixel in said second digital image with current pixel from said first digital image when said pixel difference is greater than or equal to said intensity threshold.

5. A method for removing flash artifacts as recited in claim 4, wherein said threshold is set by a user.

6. A method for removing flash artifacts as recited in claim 4, further comprising the step of:

e) after all of said pixels to be processed have been processed, saving said second digital image in a memory device as a final digital image.

7. A method for removing flash artifacts comprising the steps of:

a) capturing a first digital image of a subject;

b) capturing a second digital image of said subject with the use of a flash;

c) selecting at least three primary color thresholds; and

d) for each primary color of each pixel to be processed performing the sub-steps of;

i) subtracting primary color value of current pixel in said first digital image from primary color value of current pixel in said second digital image resulting in a primary color pixel difference for the current primary color of the current pixel; and

ii) replacing primary color value of current pixel in said second digital image with primary color value of current pixel from said first digital image when said primary color pixel difference for the current primary color of the current pixel is greater than said primary color threshold for said current primary color.

8. A method for removing flash artifacts as recited in claim 7;

wherein said primary colors include red, green, and blue.

9. A method for removing flash artifacts as recited in claim 7;

wherein said primary colors include yellow, cyan, and magenta.

10. A method for removing flash artifacts as recited in claim 7;

wherein said primary color thresholds are set by a user.

11. A method for removing flash artifacts as recited in claim 7, further comprising the step of:

e) after all of said pixels to be processed have been processed, saving said second digital image in a memory device as a final digital image.

12. A method for removing flash artifacts comprising the steps of:

a) capturing a first digital image of a subject;

b) capturing a second digital image of said subject with the use of a flash;

c) selecting at least three primary color thresholds; and

d) for each primary color of each pixel to be processed performing the sub-steps of;

i) subtracting primary color value of current pixel in said first digital image from primary color value of current pixel in said second digital image resulting in a primary color pixel difference for the current primary color of the current pixel; and

ii) replacing primary color value of current pixel in said second digital image with primary color value of current pixel from said first digital image when said primary color pixel difference for the current primary color of the current pixel is greater than or equal to said primary color threshold for said current primary color.

13. A method for removing flash artifacts as recited in claim 12;

wherein said primary colors include red, green, and blue.

14. A method for removing flash artifacts as recited in claim 12;

wherein said primary colors include yellow, cyan, and magenta.

15. A method for removing flash artifacts as recited in claim 12;

wherein said primary color thresholds are set by a user.

16. A method for removing flash artifacts as recited in claim 12, further comprising the step of:

e) after all of said pixels to be processed have been processed, saving said second digital image in a memory device as a final digital image.

17. A method for removing flash artifacts comprising the steps of:

a) capturing a first digital image of a subject;

b) capturing a second digital image of said subject with the use of a flash;

c) selecting at least three primary color thresholds; and

d) for each primary color of each pixel to be processed performing the sub-steps of;

i) subtracting primary color value of current pixel in said first digital image from primary color value of current pixel in said second digital image resulting in a primary color pixel difference for the current primary color of the current pixel; and

ii) replacing primary color value of current pixel in said second digital image with a color value calculated from said primary color value of current pixel in said first digital image, and said primary color value of current pixel in said second digital image, when said primary color pixel difference for the current primary color of the current pixel is greater than said primary color threshold for said current primary color.

18. A method for removing flash artifacts as recited in claim 17;

wherein said primary colors include red, green, and blue.

19. A method for removing flash artifacts as recited in claim 17;

wherein said primary colors include yellow, cyan, and magenta.

20. A method for removing flash artifacts as recited in claim 17;

wherein said primary color thresholds are set by a user.

21. A method for removing flash artifacts as recited in claim 17, further comprising the step of:

j) after all of said pixels to be processed have been processed, saving said second digital image in a memory device as a final digital image.

22. A method for removing flash artifacts comprising the steps of:

a) capturing a first digital image of a subject;

b) capturing a second digital image of said subject with the use of a flash;

c) selecting at least three primary color thresholds; and

d) for each primary color of each pixel to be processed performing the sub-steps of;

i) subtracting primary color value of current pixel in said first digital image from primary color value of current pixel in said second digital image resulting in a primary color pixel difference for the current primary color of the current pixel; and

ii) replacing primary color value of current pixel in said second digital image with a color value calculated from said primary color value of current pixel in said first digital image, and said primary color value of current pixel in said second digital image, when said primary color pixel difference for the current primary color of the current pixel is greater than or equal to said primary color threshold for said current primary color.

23. A method for removing flash artifacts as recited in claim 22;

wherein said primary colors include red, green, and blue.

24. A method for removing flash artifacts as recited in claim 22;

wherein said primary colors include yellow, cyan, and magenta.

25. A method for removing flash artifacts as recited in claim 22;

wherein said primary color thresholds are set by a user.

26. A method for removing flash artifacts as recited in claim 22, further comprising the step of:

e) after all of said pixels to be processed have been processed, saving said second digital image in a memory device as a final digital image.