Digital image processing using face detection information

• US 8,131,016 B2
• Filed: 12/03/2010
• Issued: 03/06/2012
• Est. Priority Date: 06/26/2003
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Corcoran, Peter, Bigioi, Petronel
• Primary Examiner(s): Seth, Manav
• Application Number:
  US12/959,368
• Publication Number:
  US 20110075894A1
• Time in Patent Office: 459 Days
• Field of Search: 382/103, 382115-118, 382/254, 382/274
• US Class Current: 382/103
• CPC Class Codes: G06V 40/162 using pixel segmentation or colour matching
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A method of processing a digital image using face detection within the image achieves one or more desired image processing parameters. A group of pixels is identified that correspond to an image of a face within the digital image. Default values are determined of one or more parameters of at least some portion of the digital image. Values are adjusted of the one or more parameters within the digitally-detected image based upon an analysis of the digital image including the image of the face and the default values.

Claims

1. A method of processing a digital image using face detection within said image to achieve one or more desired image processing parameters, comprising:

on an apparatus including a processor configured for image processing, automatically identifying a group of pixels that correspond to an image of a face within the digital image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of one or more low resolution images including said face;

tracking said face within said collection of low resolution images;

adjusting values of color balance or tone reproduction, or both, within the digitally-detected image based upon an analysis of said collection of low resolution images and said digital image including said image of said face; and

automatically providing a fill flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face.

2. The method of claim 1, further comprising applying a mask that defines one or more regions where the one or more parameters are valid.

3. The method of claim 2, the mask comprising a continuous presentation of varying strength within different sub-regions of said one or more regions.

4. The method of claim 1, further comprising transforming said digital image based on said values of said color balance or tone reproduction, or both.

5. The method of claim 1, further comprising creating an operation list for said digital image based on said values of said color balance or tone, or both.

6. The method of claim 5, wherein said operation list is embedded within said digital image.

7. The method of claim 5, wherein said operation list is external to said digital image.

8. The method of claim 1, wherein said adjusting the values of said color balance or tone reproduction, or both, comprises determining a color or tone, or both, of one or more pixels of the digital image.

9. The method of claim 1, further comprising automatically providing an option for providing a suggested fill-flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

10. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of processing a digital image using face detection in said image to achieve a desired image processing parameter, the method comprising:

on an apparatus including a processor configured for image processing, automatically identifying a group of pixels that correspond to an image of a face within the digital image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of one or more low resolution images including said face;

tracking said face within said collection of low resolution images;

adjusting values of color balance or tone reproduction, or both, within the digitally-detected image based upon an analysis of said collection of low resolution images and said digital image including said image of said face; and

automatically providing a fill flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face.

11. The one or more storage devices of claim 10, wherein the method comprises applying a mask that defines one or more regions where the parameters are valid.

12. The one or more storage devices of claim 11, wherein the mask comprises a continuous presentation of varying strength within different sub-regions of at least one of said one or more regions.

13. The one or more storage devices of claim 10, wherein the method comprises transforming said digital image based on said values of said color balance or tone reproduction, or both.

14. The one or more storage devices of claim 10, the method further comprising creating an operation list for said digital image based on said values of said color balance or tone reproduction, or both.

15. The one or more storage devices of claim 14, wherein said operation list is embedded in said digital image.

16. The one or more storage devices of claim 14, wherein said operation list is external to said digital image.

17. The one or more storage devices of claim 10, wherein said adjusting the values of said color balance or tone reproduction, or both, comprises determining a color or tone, or both, of one or more pixels within the digital image.

18. The one or more storage devices of claim 10, wherein the method further comprises automatically providing an option for providing a suggested fill-flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.

19. A portable digital image acquisition device, including a lens and an image sensor for acquiring a digital image, a processor, and one or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming the processor to perform a method of processing a digital image using face detection in said image to achieve a desired image processing parameter, the method comprising:

on an apparatus including a processor configured for image processing, automatically identifying a group of pixels that correspond to an image of a face within the digital image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of one or more low resolution images including said face;

tracking said face within said collection of low resolution images;

adjusting values of color balance or tone reproduction, or both, within the digitally-detected image based upon an analysis of said collection of low resolution images and said digital image including said image of said face; and

automatically providing a fill flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face.

20. The device of claim 19, wherein the method further comprises applying a mask that defines regions where the parameters are valid.

21. The device of claim 20, wherein the mask further comprises a continuous presentation of varying strength within different sub-regions of said region.

22. The device of claim 19, wherein the method comprises transforming said digital image based on said values of said color balance or tone reproduction, or both.

23. The device of claim 19, wherein the method comprises creating an operation list for said digital image based on said values of said color balance or tone reproduction, or both.

24. The device of claim 23, wherein said operation list is embedded in said digital image.

25. The device of claim 23, wherein said operation list is external to said digital image.

26. The device of claim 19, wherein said adjusting the values of said color balance or tone reproduction, or both, comprises determining a color or tone, or both, of one or more pixels within the digital image.

27. The device of claim 19, wherein the method further comprises automatically providing an option for providing a suggested fill-flash to digitally add exposure to brighten the group of pixels that correspond to said image of said face while not digitally adding exposure to nor otherwise brightening one or more other pixels within the digital image.