Digital image processing using face detection information

• US 7,848,549 B2
• Filed: 10/30/2008
• Issued: 12/07/2010
• Est. Priority Date: 06/26/2003
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Bigioi, Petronel, Corcoran, Peter
• Primary Examiner(s): Seth; Manav
• Application Number:
  US12/262,061
• Publication Number:
  US 20090052749A1
• Time in Patent Office: 768 Days
• Field of Search: 382/103, 382115-118, 382/254, 382/274, 24 68 R-7115
• US Class Current: 382/118
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A method of processing a digital image using face detection within the image achieves one or more desired image processing parameters. A group of pixels is identified that correspond to an image of a face within the digital image. Default values are determined of one or more parameters of at least some portion of the digital image. Values are adjusted of the one or more parameters within the digitally-detected image based upon an analysis of the digital image including the image of the face and the default values.

Claims

1. A method of processing a digital image using face detection within said image to achieve one or more desired image processing parameters, comprising:

on an apparatus including a processor configured for image processing, automatically identifying a group of pixels that correspond to an image of a face within the digital image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of low resolution images including said face;

tracking said face within said collection of low resolution images;

determining default values of one or more parameters of at least some portion of said digital image; and

adjusting values of the one or more parameters within the digitally-detected image based upon an analysis of said digital image including said image of said face and said default values,

wherein the one or more parameters include an orientation of said face.

2. The method of claim 1, the one or more parameters comprise of a mask that defines one or more regions where the one or more parameters are valid.

3. The method of claim 2, the mask further comprising a continuous presentation of varying strength within different sub-regions of said one or more regions.

4. The method of claim 2, said one or more parameters comprising identical parameters that differ in value based on said mask.

5. The method of claim 1, at least two parameters being concatenated into a single parameter.

6. The method of claim 1, further comprising a selection of one or more parameters, the selection being manually performed.

7. The method of claim 1, further comprising transforming said digital image based on said values of said one or more parameters.

8. The method of claim 1, further comprising creating an operation list for said digital image based on said values of said one or more parameters.

9. The method of claim 8, wherein said operation list is embedded within said digital image.

10. The method of claim 8, wherein said operation list is external to said digital image.

11. The method of claim 1, wherein said adjusting the values of said orientation comprises determining a rotation value of the digital image.

12. The method of claim 1, further comprising receiving and executing a manual command to remove a false indication of another face within the image based on a manual indication that the apparatus has automatically falsely identified another group of pixels as being a face.

13. The method of claim 1, further comprising automatically providing a fill flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

14. The method of claim 1, further comprising automatically providing an option for providing a suggested fill-flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

15. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of processing a digital image using face detection in said image to achieve a desired image processing parameter, the method comprising:

on an apparatus including a processor configured for image processing, automatically identifying a group of pixels that correspond to an image of a face within the digital image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of low resolution images including said face;

tracking said face within said collection of low resolution images;

determining default values of one or more parameters of at least some portion of said digital image;

adjusting values of the one or more parameters within the digitally-detected image based upon an analysis of said digital image including said image of said face and said default values,

wherein the one or more parameters include an orientation of said face.

16. The one or more storage devices of claim 15, the one or more parameters comprising of a mask that defines regions where the parameters are valid.

17. The one or more storage devices of claim 16, where the mask further comprises a continuous presentation of varying strength within different sub-regions of said region.

18. The one or more storage devices of claim 16, said one or more parameters comprising same parameters differing in value based on said mask.

19. The one or more storage devices of claim 15, at least two parameters being concatenated into a single parameter.

20. The one or more storage devices of claim 15, the method further comprising manually selecting one or more parameters.

21. The one or more storage devices of claim 15, the method further comprising transforming said digital image based on said values of said one or more parameters.

22. The one or more storage devices of claim 15, the method further comprising creating an operation list for said digital image based on said values of said one or more parameters.

23. The one or more storage devices of claim 22, wherein said operation list is embedded in said digital image.

24. The one or more storage devices of claim 22, wherein said operation list is external to said digital image.

25. The one or more storage devices of claim 15, said adjusting the values of said orientation comprising determining a rotation value of the digital image.

26. The one or more storage devices of claim 15, wherein the method further comprises receiving and executing a manual command to remove a false indication of another face within the image based on a manual indication that the apparatus has automatically falsely identified another group of pixels as being a face.

27. The one or more storage devices of claim 15, wherein the method further comprises automatically providing a fill flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

28. The one or more storage devices of claim 15, wherein the method further comprises automatically providing an option for providing a suggested fill-flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

29. A portable digital image acquisition device, including a lens and an image sensor for acquiring a digital image, a processor, and one or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming the processor to perform a method of processing a digital image using face detection in said image to achieve a desired image processing parameter, the method comprising:

automatically identifying a group of pixels that correspond to an image of a face within the digital image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of low resolution images including said face;

tracking said face within said collection of low resolution images;

determining default values of one or more parameters of at least some portion of said digital image;

adjusting values of the one or more parameters within the digitally-detected image based upon an analysis of said digital image including said image of said face and said default values,

wherein the one or more parameters include an orientation of said face.

30. The device of claim 29, the one or more parameters comprising of a mask that defines regions where the parameters are valid.

31. The device of claim 30, where the mask further comprises a continuous presentation of varying strength within different sub-regions of said region.

32. The device of claim 30, said one or more parameters comprising same parameters differing in value based on said mask.

33. The device of claim 29, at least two parameters being concatenated into a single parameter.

34. The device of claim 29, the method further comprising manually selecting one or more parameters.

35. The device of claim 29, the method further comprising transforming said digital image based on said values of said one or more parameters.

36. The device of claim 29, the method further comprising creating an operation list for said digital image based on said values of said one or more parameters.

37. The device of claim 34, wherein said operation list is embedded in said digital image.

38. The device of claim 34, wherein said operation list is external to said digital image.

39. The device of claim 29, said adjusting the values of said orientation comprising determining a rotation value of the digital image.

40. The device of claim 29, wherein the method further comprises receiving and executing a manual command to remove a false indication of another face within the image based on a manual indication that the apparatus has automatically falsely identified another group of pixels as being a face.

41. The device of claim 29, wherein the method further comprises automatically providing a fill flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

42. The device of claim 29, wherein the method further comprises automatically providing an option for providing a suggested fill-flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.