Separating directional lighting variability in statistical face modelling based on texture space decomposition

• US 8,565,550 B2
• Filed: 03/07/2013
• Issued: 10/22/2013
• Est. Priority Date: 02/28/2007
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.), National University of Ireland Galway
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.), National University of Ireland Galway
• Inventors: Ionita, Mircea, Bacivarov, Ioana, Cocoran, Peter
• Primary Examiner(s): Bhatnagar, Anand
• Assistant Examiner(s): PARK, SOO JIN
• Application Number:
  US13/789,627
• Publication Number:
  US 20130182148A1
• Time in Patent Office: 229 Days
• Field of Search: 382/118, 382155-160, 382/224, 382/227, 382/274
• US Class Current: 382/274
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06V 10/60 relating to illumination properties, e.g. using a reflectance or lighting model
• CPC Class Codes: G06V 10/7557 based on appearance, e.g. active appearance models [AAM]
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A technique for determining a characteristic of a face or certain other object within a scene captured in a digital image including acquiring an image and applying a linear texture model that is constructed based on a training data set and that includes a class of objects including a first subset of model components that exhibit a dependency on directional lighting variations and a second subset of model components which are independent of directional lighting variations. A fit of the model to the face or certain other object is obtained including adjusting one or more individual values of one or more of the model components of the linear texture model. Based on the obtained fit of the model to the face or certain other object in the scene, a characteristic of the face or certain other object is determined.

Claims

1. A face illumination normalization method, comprising:

(a) acquiring a digital image including data corresponding to a face that appears to be illuminated unevenly;

(b) applying separate sets of directional and uniform illumination classifier programs to the face data;

(c) identifying the face data as corresponding to a projection of said face within the digital image on one or a combination of the directional illumination classifier programs plus a constant vector representing said face according to one or a combination of the uniform illumination classifier programs, thereby decomposing the face data into orthogonal subspaces for directional and uniform illumination;

(d) normalizing an illumination condition for the face including setting one or more illumination parameters of the directional illumination projection to zero;

(e) electronically storing, transmitting, applying a face recognition program to, editing, or displaying the corrected face image, or combinations thereof.

2. The method of claim 1, wherein the applying comprises projecting the face data onto the uniform lighting classifier program set, and then applying residual data of the face data to the directional lighting classifier program set.

3. The method of claim 1, further comprising applying a face recognition program to the normalized face image.

4. The method of claim 1, further comprising applying a set of feature detector programs to reject non-face data from being identified as face data.

5. The method of claim 1, further comprising determining an illumination condition based on acceptance of the face data by one or a combination of the directional illumination classifier programs.

6. The method of claim 1, wherein the digital image is one of multiple images in a series that include said face, and wherein said normalizing is applied to a different image in the series than said digital image within which the face data is identified.

7. A non-transitory digital memory having stored therein processor-readable code for programming a processor to perform a face illumination normalization method, wherein the method comprises:

(a) acquiring a digital image including data corresponding to a face that appears to be illuminated unevenly;

(b) applying separate sets of directional and uniform illumination classifier programs to the face data;

(c) identifying the face data as corresponding to a projection of said face within the digital image on one or a combination of the directional illumination classifier programs plus a constant vector representing said face according to one or a combination of the uniform illumination classifier programs, thereby decomposing the face data into orthogonal subspaces for directional and uniform illumination;

(d) normalizing an illumination condition for the face including setting one or more illumination parameters of the directional illumination projection to zero;

(e) electronically storing, transmitting, applying a face recognition program to, editing, or displaying the corrected face image, or combinations thereof.

8. The one or more non-transitory processor-readable media of claim 7, wherein the applying comprises projecting the face data onto the uniform lighting classifier program set, and then applying residual data of the face data to the directional lighting classifier program set.

9. The one or more non-transitory processor-readable media of claim 7, wherein the method further comprises applying a face recognition program to the normalized face image.

10. The one or more non-transitory processor-readable media of claim 7, wherein the method further comprises applying a set of feature detector programs to reject non-face data from being identified as face data.

11. The one or more non-transitory processor-readable media of claim 7, wherein the method further comprises determining an illumination condition based on acceptance of the face data by one or a combination of the directional illumination classifier programs.

12. The one or more non-transitory processor-readable media of claim 7, wherein the digital image is one of multiple images in a series that include said face, and wherein said normalizing is applied to a different image in the series than said digital image within which the face data is identified.

13. A digital image acquisition device including an optoelectronic system for acquiring a digital image, and a digital memory having stored therein processor-readable code for programming the processor to perform a face illumination normalization method, wherein the method comprises:

(a) acquiring a digital image including data corresponding to a face that appears to be illuminated unevenly;

(b) applying separate sets of directional and uniform illumination classifier programs to the face data;

(c) identifying the face data as corresponding to a projection of said face within the digital image on one or a combination of the directional illumination classifier programs plus a constant vector representing said face according to one or a combination of the uniform illumination classifier programs, thereby decomposing the face data into orthogonal subspaces for directional and uniform illumination;

(d) normalizing an illumination condition for the face including setting one or more illumination parameters of the directional illumination projection to zero;

(e) electronically storing, transmitting, applying a face recognition program to, editing, or displaying the corrected face image, or combinations thereof.

14. The device of claim 13, wherein the applying comprises projecting the face data onto the uniform lighting classifier program set, and then applying residual data of the face data to the directional lighting classifier program set.

15. The device of claim 13, wherein the method further comprises applying a face recognition program to the normalized face image.

16. The device of claim 13, wherein the method further comprises applying a set of feature detector programs to reject non-face data from being identified as face data.

17. The device of claim 13, wherein the method further comprises determining an illumination condition based on acceptance of the face data by one or a combination of the directional illumination classifier programs.

18. The device of claim 13, wherein the digital image is one of multiple images in a series that include said face, and wherein said normalizing is applied to a different image in the series than said digital image within which the face data is identified.