Digital image processing using face detection information

• US 8,055,090 B2
• Filed: 09/14/2010
• Issued: 11/08/2011
• Est. Priority Date: 06/26/2003
• Status: Expired due to Term

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Bigioi, Petronel, Corcoran, Peter
• Primary Examiner(s): Seth; Manav
• Application Number:
  US12/881,182
• Publication Number:
  US 20110002545A1
• Time in Patent Office: 420 Days
• Field of Search: 382100-127, 382181-231, 382254-273
• US Class Current: 382/255
• CPC Class Codes: G06V 40/162 using pixel segmentation or colour matching
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A method of processing a digital image using face detection within the image achieves one or more desired image processing parameters. A group of pixels is identified that correspond to an image of a face within the digital image. Default values are determined of one or more parameters of at least some portion of the digital image. Values are adjusted of the one or more parameters within the digitally-detected image based upon an analysis of the digital image including the image of the face and the default values.

Claims

1. A method of digital image processing using face detection, comprising:

identifying a first group of pixels that correspond to a face within a digital image including determining a degree of focus of said first group of pixels;

identifying a second group of pixels that correspond to another feature within the digital image and determining a further degree of focus of said second group of pixels;

determining relative adjusted values of degree of focus for the first and second groups of pixels; and

generating a re-compositioned image including a new group of pixels for each of the face and the other feature, wherein each new group of pixels is determined based on said relative adjusted values of degree of focus of the first and second groups of pixels.

2. The method of claim 1, wherein the identifying of the first or second groups of pixels respectively comprises applying face detection to the acquired scene and identifying the first or second features as corresponding to first or second faces.

3. The method of claim 2, further comprising applying face tracking to the first or second group of pixels, or both, for respectively continuing to identify in one or more subsequent images the first or second groups of pixels as corresponding to the first or second face.

4. The method of claim 3, further comprising automatically adjusting focus position based upon detecting that the focus position of the face has changed based on movement between two or more of the digital image and the one or more subsequent images.

5. The method of claim 1, determining auto focus distance based on determining a size of the face in the digital image.

6. The method of claim 1, determining auto focus distance based on determining a location of the face in the digital image.

7. The method of claim 1, determining an exposure for the digital image based on determining a size of the face in the digital image.

8. The method of claim 1, determining an exposure for the digital image based on determining a location of the face in the digital image.

9. The method of claim 1, further comprising enhancing the digital image or a subsequent image based upon meta-data information regarding the face.

10. The method of claim 1, further comprising perfecting an auto focus within the digital image based on performing auto focus on both the first and second groups of pixels.

11. The method of claim 10, wherein the perfecting the auto-focus comprises computing a weighted average of faces detected within the first and second groups of pixels.

12. The method of claim 11, wherein the computing a weighted average comprises assigning a relative value of detection assurance to each of the faces.

13. The method of claim 11, wherein the computing a weighted average comprises receiving a manual indication to remove a group of pixels as being indicated as a face.

14. The method of claim 11, wherein the computing a weighted average comprises assigning an estimated importance of the faces based on size, location or relative exposure within the digital image, or combinations thereof.

15. One or more non-transitory computer readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of digital image processing using face detection, comprising:

identifying a first group of pixels that correspond to a face within a digital image including determining a degree of focus of said first group of pixels;

identifying a second group of pixels that correspond to another feature within the digital image and determining a further degree of focus of said second group of pixels;

determining relative adjusted values of degree of focus for the first and second groups of pixels; and

generating a re-compositioned image including a new group of pixels for each of the face and the other feature, wherein each new group of pixels is determined based on said relative adjusted values of degree of focus of the first and second groups of pixels.

16. The one or more non-transitory computer readable storage devices of claim 15, wherein the identifying of the first or second groups of pixels respectively comprises applying face detection to the acquired scene and identifying the first or second features as corresponding to first or second faces.

17. The one or more non-transitory computer readable storage devices of claim 16, wherein the method further comprises applying face tracking to the first or second group of pixels, or both, for respectively continuing to identify in one or more subsequent images the first or second groups of pixels as corresponding to the first or second face.

18. The one or more non-transitory computer readable storage devices of claim 17, wherein the method further comprises automatically adjusting focus position based upon detecting that the focus position of the face has changed based on movement between two or more of the digital image and the one or more subsequent images.

19. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises determining auto focus distance based on determining a size of the face in the digital image.

20. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises determining auto focus distance based on determining a location of the face in the digital image.

21. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises determining an exposure for the digital image based on determining a size of the face in the digital image.

22. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises determining an exposure for the digital image based on determining a location of the face in the digital image.

23. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises enhancing the digital image or a subsequent image based upon meta-data information regarding the face.

24. The one or more non-transitory computer readable storage devices of claim 15, wherein the method further comprises perfecting an auto focus within the digital image based on performing auto focus on both the first and second groups of pixels.

25. The one or more non-transitory computer readable storage devices of claim 24, wherein the perfecting the auto-focus comprises computing a weighted average of faces detected within the first and second groups of pixels.

26. The one or more non-transitory computer readable storage devices of claim 25, wherein the computing a weighted average comprises assigning a relative value of detection assurance to each of the faces.

27. The one or more non-transitory computer readable storage devices of claim 25, wherein the computing a weighted average comprises receiving a manual indication to remove a group of pixels as being indicated as a face.

28. The one or more non-transitory computer readable storage devices of claim 25, wherein the computing a weighted average comprises assigning an estimated importance of the faces based on size, location or relative exposure within the digital image, or combinations thereof.

29. A portable digital image acquisition device including a lens and an image sensor for acquiring a digital image, and a processor for performing image processing on the digital image, and one or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming the processor to perform a method of digital image processing using face detection, comprising:

identifying a first group of pixels that correspond to a face within a digital image including determining a degree of focus of said first group of pixels;

identifying a second group of pixels that correspond to another feature within the digital image and determining a further degree of focus of said second group of pixels;

determining relative adjusted values of degree of focus for the first and second groups of pixels; and

generating a re-compositioned image including a new group of pixels for each of the face and the other feature, wherein each new group of pixels is determined based on said relative adjusted values of degree of focus of the first and second groups of pixels.

30. The device of claim 29, wherein the identifying of the first or second groups of pixels respectively comprises applying face detection to the acquired scene and identifying the first or second features as corresponding to first or second faces.

31. The device of claim 30, wherein the method further comprises applying face tracking to the first or second group of pixels, or both, for respectively continuing to identify in one or more subsequent images the first or second groups of pixels as corresponding to the first or second face.

32. The device of claim 31, wherein the method further comprises automatically adjusting focus position based upon detecting that the focus position of the face has changed based on movement between two or more of the digital image and the one or more subsequent images.

33. The device of claim 29, wherein the method further comprises determining auto focus distance based on determining a size of the face in the digital image.

34. The device of claim 29, wherein the method further comprises determining auto focus distance based on determining a location of the face in the digital image.

35. The device of claim 29, wherein the method further comprises determining an exposure for the digital image based on determining a size of the face in the digital image.

36. The device of claim 29, wherein the method further comprises determining an exposure for the digital image based on determining a location of the face in the digital image.

37. The device of claim 29, wherein the method further comprises enhancing the digital image or a subsequent image based upon meta-data information regarding the face.

38. The device of claim 29, wherein the method further comprises perfecting an auto focus within the digital image based on performing auto focus on both the first and second groups of pixels.

39. The device of claim 38, wherein the perfecting the auto-focus comprises computing a weighted average of faces detected within the first and second groups of pixels.

40. The device of claim 39, wherein the computing a weighted average comprises assigning a relative value of detection assurance to each of the faces.

41. The device of claim 39, wherein the computing a weighted average comprises receiving a manual indication to remove a group of pixels as being indicated as a face.

42. The device of claim 39, wherein the computing a weighted average comprises assigning an estimated importance of the faces based on size, location or relative exposure within the digital image, or combinations thereof.