Digital image processing using face detection information

• US 8,224,108 B2
• Filed: 12/04/2010
• Issued: 07/17/2012
• Est. Priority Date: 06/26/2003
• Status: Expired due to Term

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Corcoran, Peter, Bigioi, Petronel
• Primary Examiner(s): Seth, Manav
• Application Number:
  US12/960,479
• Publication Number:
  US 20110096187A1
• Time in Patent Office: 591 Days
• Field of Search: None
• US Class Current: 382/255
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A method of processing a digital image using face detection within the image achieves one or more desired image processing parameters. A group of pixels is identified that correspond to an image of a face within the digital image. Default values are determined of one or more parameters of at least some portion of the digital image. Values are adjusted of the one or more parameters within the digitally-detected image based upon an analysis of the digital image including the image of the face and the default values.

Claims

1. A method of digital image processing using face detection, comprising:

identifying a first group of pixels that include a face within a digital image including determining a degree of focus of said first group of pixels;

identifying a second group of pixels that include another feature within the digital image and determining a further degree of focus of said second group of pixels;

estimating an importance of each of the first and second groups of pixels, including analyzing size, location within the digital image, or relative exposure of the face and other feature, or combinations thereof;

calculating a weighted average on individual objects of the first and second groups of pixels based at least in part on the estimating; and

perfecting an auto-focus process based at least in part on the weighted average.

2. The method of claim 1, wherein the identifying of the first or second groups of pixels respectively comprises applying face detection to the acquired scene and identifying the first or second features as corresponding to first or second faces.

3. The method of claim 2, further comprising applying face tracking to the first or second group of pixels, or both, for respectively continuing to identify in one or more subsequent images the first or second groups of pixels as corresponding to the first or second face.

4. The method of claim 3, further comprising automatically adjusting focus position based upon detecting that the focus position of the face has changed based on movement between two or more of the digital image and the one or more subsequent images.

5. The method of claim 1, determining auto focus distance based on determining a size of the face in the digital image.

6. The method of claim 1, determining auto focus distance based on determining a location of the face in the digital image.

7. The method of claim 1, determining an exposure for the digital image based on determining a size of the face in the digital image.

8. The method of claim 1, determining an exposure for the digital image based on determining a location of the face in the digital image.

9. The method of claim 1, further comprising enhancing the digital image or a subsequent image based upon meta-data information regarding the face.

10. The method of claim 1, wherein the perfecting of the auto focus process is further based on performing auto focus on both the first and second groups of pixels.

11. The method of claim 1, wherein the calculating a weighted average comprises receiving a manual indication to remove a group of pixels as being indicated as a face.

12. The method of claim 1, further comprising estimating a detection assurance of each of the first and second groups of pixels, and wherein the calculating is further based at least in part on the estimating a detection assurance.

13. One or more non-transitory computer readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of digital image processing using face detection, wherein the method comprises:

identifying a first group of pixels that include a face within a digital image including determining a degree of focus of said first group of pixels;

identifying a second group of pixels that include another feature within the digital image and determining a further degree of focus of said second group of pixels;

estimating an importance of each of the first and second groups of pixels, including analyzing size, location within the digital image, or relative exposure of the face and other feature, or combinations thereof;

calculating a weighted average on individual objects of the first and second groups of pixels based at least in part on the estimating; and

perfecting an auto-focus process based at least in part on the weighted average.

14. The one or more non-transitory computer readable storage devices of claim 13, wherein the identifying of the first or second groups of pixels respectively comprises applying face detection to the acquired scene and identifying the first or second features as corresponding to first or second faces.

15. The one or more non-transitory computer readable storage devices of claim 14, wherein the method further comprises applying face tracking to the first or second group of pixels, or both, for respectively continuing to identify in one or more subsequent images the first or second groups of pixels as corresponding to the first or second face.

16. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises automatically adjusting focus position based upon detecting that the focus position of the face has changed based on movement between two or more of the digital image and the one or more subsequent images.

17. The one or more non-transitory computer readable storage devices of claim 13, wherein the method further comprises determining auto focus distance based on determining a size of the face in the digital image.

18. The one or more non-transitory computer readable storage devices of claim 13, wherein the method further comprises determining auto focus distance based on determining a location of the face in the digital image.

19. The one or more non-transitory computer readable storage devices of claim 13, wherein the method further comprises determining an exposure for the digital image based on determining a size of the face in the digital image.

20. The one or more non-transitory computer readable storage devices of claim 13, wherein the method further comprises determining an exposure for the digital image based on determining a location of the face in the digital image.

21. The one or more non-transitory computer readable storage devices of claim 13, wherein the method further comprises enhancing the digital image or a subsequent image based upon meta-data information regarding the face.

22. The one or more non-transitory computer readable storage devices of claim 13, wherein the perfecting of the auto focus process is further based on performing auto focus on both the first and second groups of pixels.

23. The one or more non-transitory computer readable storage devices of claim 13, wherein the calculating a weighted average comprises receiving a manual indication to remove a group of pixels as being indicated as a face.

24. The one or more non-transitory computer readable storage devices of claim 13, wherein the method further comprises estimating a detection assurance of each of the first and second groups of pixels, and wherein the calculating is further based at least in part on the estimating a detection assurance.

25. A portable digital image acquisition device including a lens and an image sensor for acquiring a digital image, and a processor for performing image processing on the digital image, and one or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming the processor to perform a method of digital image processing using face detection, comprising:

identifying a first group of pixels that include a face within a digital image including determining a degree of focus of said first group of pixels;

identifying a second group of pixels that include another feature within the digital image and determining a further degree of focus of said second group of pixels;

estimating an importance of each of the first and second groups of pixels, including analyzing size, location within the digital image, or relative exposure of the face and other feature, or combinations thereof;

calculating a weighted average on individual objects of the first and second groups of pixels based at least in part on the estimating; and

perfecting an auto-focus process based at least in part on the weighted average.

26. The portable digital image acquisition device of claim 25, wherein the identifying of the first or second groups of pixels respectively comprises applying face detection to the acquired scene and identifying the first or second features as corresponding to first or second faces.

27. The portable digital image acquisition device of claim 26, wherein the method further comprises applying face tracking to the first or second group of pixels, or both, for respectively continuing to identify in one or more subsequent images the first or second groups of pixels as corresponding to the first or second face.

28. The portable digital image acquisition device of claim 27, wherein the method further comprises automatically adjusting focus position based upon detecting that the focus position of the face has changed based on movement between two or more of the digital image and the one or more subsequent images.

29. The portable digital image acquisition device of claim 25, wherein the method further comprises determining auto focus distance based on determining a size of the face in the digital image.

30. The portable digital image acquisition device of claim 25, wherein the method further comprises determining auto focus distance based on determining a location of the face in the digital image.

31. The portable digital image acquisition device of claim 25, wherein the method further comprises determining an exposure for the digital image based on determining a size of the face in the digital image.

32. The portable digital image acquisition device of claim 25, wherein the method further comprises determining an exposure for the digital image based on determining a location of the face in the digital image.

33. The portable digital image acquisition device of claim 25, wherein the method further comprises enhancing the digital image or a subsequent image based upon meta-data information regarding the face.

34. The portable digital image acquisition device of claim 25, wherein the perfecting of the auto focus process is further based on performing auto focus on both the first and second groups of pixels.

35. The portable digital image acquisition device of claim 25, wherein the calculating a weighted average comprises receiving a manual indication to remove a group of pixels as being indicated as a face.

36. The portable digital image acquisition device of claim 25, wherein the method further comprises estimating a detection assurance of each of the first and second groups of pixels, and wherein the calculating is further based at least in part on the estimating a detection assurance.