Digital image processing using face detection information

• US 8,005,265 B2
• Filed: 09/08/2008
• Issued: 08/23/2011
• Est. Priority Date: 06/26/2003
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: Tessera Technologies Ireland Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Bigioi, Petronel, Corcoran, Peter
• Primary Examiner(s): Seth; Manav
• Application Number:
  US12/206,617
• Publication Number:
  US 20090002514A1
• Time in Patent Office: 1,079 Days
• Field of Search: 382/103, 382115-118, 382/254, 382/274, 348/61, 348/68, 348 77- 78, 348/143, 348/152, 348/155, 348/158, 348/169, 348/207.99, 3482201-2291
• US Class Current: 382/103
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A method of processing a digital image using face detection within the image achieves one or more desired image processing parameters. A group of pixels is identified that correspond to an image of a face within the digital image. Default values are determined of one or more parameters of at least some portion of the digital image. Values are adjusted of the one or more parameters within the digitally-detected image based upon an analysis of the digital image including the image of the face and the default values.

Claims

1. A method of digital image processing using face detection and tracking to achieve a desired image rendering parameter, comprising:

using a processor-based, handheld device;

identifying a group of pixels that correspond to an image of a face within a digitally-detected image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of low resolution images including said face;

tracking said face within said collection of low resolution images;

based on the tracking, determining initial values of one or more parameters of at least some of the pixels;

determining an initial rendering parameter of the digitally-detected image based on the initial values;

automatically adjusting values of the one or more parameters of pixels within the digitally-detected image based upon comparison of the initial rendering parameter with the desired rendering parameter to generate a modified image, and

storing, rendering, printing, displaying, transmitting, or communicating the detected image, the modified image, or one or more further processed versions of the detected image or the modified image, or combinations thereof.

2. The method of claim 1, further comprising performing the method within a digital inkjet digital-rendering-device, a digital laser digital-rendering-device, a thermal digital-rendering-device, a digital display, a liquid crystal display, or a digital copier, or combinations thereof.

3. The method of claim 2, wherein the one or more parameters include overall exposure, relative exposure, orientation, color balance, color gamut, white point, tone reproduction, size, or sharpness, or combinations thereof.

4. The method of claim 2, wherein the method comprises identifying face pixels automatically with an image processing apparatus, and manually removing a false indication of another face within the image.

5. The method of claim 2, wherein the method comprises identifying pace pixels automatically with an image processing apparatus, and manually adding an indication of another face within the image.

6. The method of claim 1, wherein the one or more parameters including overall exposure, relative exposure, orientation, color balance, color gamut white point, tone reproduction, size, or sharpness, or combinations thereof.

7. The method of claim 1, wherein the method comprises identifying face pixels with an image processing apparatus, and manually removing a false indication of another face within the image.

8. The method of claim 1, wherein the method comprises identifying face pixels with an image processing apparatus, and manually adding an indication of another face within the image.

9. One or more processor readable storage media having processor readable code embodied thereon for programming one or more processors to perform a method of digital image processing using face detection and tracking to achieve one or more desired image rendering parameters, wherein the method comprises:

identifying a group of pixels that correspond to an image of a face within a digitally-detected image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of low resolution images including said face;

tracking said face within said collection of low resolution images;

based on the tracking, determining initial values of one or more parameters of at least some of the pixels;

determining an initial rendering parameter of the digitally-detected image based on the initial values; and

automatically adjusting values of the one or more parameters of pixels within the digitally-detected image based upon comparison of the initial rendering parameter with the desired rendering parameter to generate a modified image.

10. The one or more storage media of claim 9, wherein the method is performed within a digital rendering device.

11. The one or more storage media of claim 10, wherein the one or more rendering parameters comprise overall exposure, relative exposure, orientation, color balance, color gamut, white point, tone reproduction, size, or sharpness, or combinations thereof.

12. The one or more storage media of claim 10, wherein the method comprises identifying face pixels automatically with an image processing apparatus, and manually removing a false indication of another face within the image.

13. The one or more storage media of claim 10, wherein the method comprises identifying face pixels automatically with an image processing apparatus, and manually adding an indication of another face within the image.

14. The one or more storage media of claim 9, wherein the one or more rendering parameters comprise overall exposure, relative exposure, orientation, color balance, color gamut, white point, tone reproduction, size, or sharpness, or combinations thereof.

15. The one or more storage media of claim 9, wherein the method comprises identifying face pixels automatically with an image processing apparatus, and manually removing a false indication of another face within the image.

16. The one or more storage media of claim 9, wherein the method comprises identifying face pixels automatically with an image processing apparatus, and manually adding an indication of another face within the image.

17. A handheld digital image acquisition and processing apparatus, comprising one or more optics and a sensor for acquiring digital images, a processor, and one or more processor readable storage media having processor readable code embodied thereon for programming the processor to perform a method of digital image processing using face detection and tracking to achieve one or more desired image rendering parameters, wherein the method comprises:

identifying a group of pixels that correspond to an image of a face within a digitally-detected image;

generating in-camera, capturing or otherwise obtaining in-camera a collection of low resolution images including said face;

tracking said face within said collection of low resolution images;

based on the tracking, determining initial values of one or more parameters of at least some of the pixels;

determining an initial rendering parameter of the digitally-detected image based on the initial values;

automatically adjusting values of the one or more parameters of pixels within the digitally-detected image based upon comparison of the initial rendering parameter with the desired rendering parameter to generate a modified image.

18. The apparatus of claim 17, wherein the one or more rendering parameters comprise overall exposure, relative exposure, orientation, color balance, color gamut, white point, tone reproduction, size, or sharpness, or combinations thereof.

19. The apparatus of claim 17, wherein the method automatically comprises automatically identifying face pixels within the apparatus.

20. The apparatus of claim 19, wherein the method comprises manually removing a false indication of another face within the image.

21. The apparatus of claim 19, wherein the method comprises manually adding an indication of another face within the image.