Facial recognition and the open mouth problem

• US 8,155,400 B2
• Filed: 03/24/2008
• Issued: 04/10/2012
• Est. Priority Date: 10/07/2002
• Status: Active Grant

• Current Assignee: Intel Benelux B. V.
• Original Assignee: UAB Research Foundation (University of Alabama System)
• Inventors: Bronstein, Michael, Bronstein, Alexander, Kimmel, Ron
• Primary Examiner(s): Desire, Gregory M
• Application Number:
  US12/076,830
• Publication Number:
  US 20080292147A1
• Time in Patent Office: 1,478 Days
• Field of Search: 345/419, 345/473, 345/621, 382/118, 382/154, 382/165
• US Class Current: 382/118
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

A method of cropping a representation of a face for electronic processing, said method comprising: selecting a first geodesic contour about an invariant reference point on said face, setting a region within said first geodesic contour as a first mask, selecting a second geodesic contour about a boundary of said identified first region, setting a region within said second geodesic contour as a second mask, and forming a final mask from a union of said first mask and said second mask.

Claims

1. A computerized method of cropping a three dimensional representation of a face for electronic processing wherein said method is available on and implemented on an appropriate computer readable medium or firmware and executed on a computer using an operating system, said method comprising:

a. selecting a first geodesic contour about an invariant reference point on said three dimensional representation of said face,

b. setting a region within said first geodesic contour as a first mask,

c. selecting a second geodesic contour about a boundary of said identified first region,

d. setting a region within said second geodesic contour as a second mask, and

e. forming a final mask from a union of said first mask and said second mask, said final mask thus providing a cropped portion of said representation of said face as a union of regions defined by at least two geodesic contours; and

f. exporting said representation of said face on to an appropriate computer readable medium or firmware executable by a computer using an operating system.

2. The method of claim 1, wherein said identifying comprises texture processing.

3. The method of claim 1, further comprising cropping said face by:

forming a final mask from a union of said first mask and said second mask; and

wherein said final mask is exported onto an appropriate computer readable medium or firmware executable by a computer using an operating system.

4. The method of claim 1 further comprising obtaining three-dimensional topographical data of said face with a three dimensional scanner, connected to a computer.

5. Apparatus comprising a three dimensional scanner operable with a computer for cropping a representation of a face for electronic processing said face having differential mouth opening states including an open mouth state, a closed mouth state and at least one intermediate state therebetween, the apparatus comprising:

a. a first geodesic contour masking unit operative to select a first geodesic contour about an invariant reference point on said face, and setting a region within said first geodesic contour as a first mask, provided with said computer and wherein said first geodesic contour and said first mask are stored on an appropriate computer readable medium or firmware on said computer; and

b. a second, geodesic contour, masking unit operative to select a second geodesic contour about a boundary of said identified mouth region, and setting a region within said second geodesic contour as a second mask, provided with said computer and wherein said second geodesic contour and said second mask are stored on an appropriate computer readable medium or firmware on said computer; and

c. a third masking unit operative to form a final mask from a union of said first mask and said second mask, thereby to provide cropping of said face such as to obtain a fill facial region and negligible background within said cropping for any of said mouth opening states, provided with said computer and wherein said final mask is stored on an appropriate computer readable medium or firmware on said computer.

6. The apparatus of claim 5 wherein a plurality of three dimensional representation of said face including a plurality of different mouth opening states including an open mouth state, a closed mouth state and at least one intermediate state therebetween is obtained with said three dimensional scanner.