Face recognition method, face recognition apparatus, face extraction method, and image pickup apparatus

• US 20040119851A1
• Filed: 12/10/2003
• Published: 06/24/2004
• Est. Priority Date: 12/12/2002
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Kaku, Toshihiko
• Application Number:
  US10/730,944
• Publication Number:
  US 20040119851A1
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/40 Spoof detection, e.g. liveness detection

Abstract

To provide a face recognition method and apparatus for more accurately recognizing face portions contained in an image, face extraction method for extracting the recognized faces, and image pickup apparatus. A subject is photographed with a camera whose incidence of defects such as red-eye or other eye color change has been increased intentionally by designing the flash unit and lens to be extremely close to each other, and so on. Discolored eye portions are detected in a photographic image and the faces of people contained in the photographic image are recognized based on the discolored eye portions. The discolored eye portions in the photographic image are corrected and the recognized face portions are extracted from the corrected photographic image. This makes it possible to generate corrected facial images more accurately.

Claims

1. A face recognition method for recognizing face portions in an image based on image data of the image, comprising:

a detection step of detecting, in the image, eye portions which have undergone a predetermined color change, based on the image data; and

a recognition step of recognizing face portions in the image based on the eye portions detected in the detection step.

2. The face recognition method according to claim 1, wherein the detection step detects red-eye portions in the image.

3. A face recognition apparatus which recognizes face portions in an image based on image data of the image, comprising:

a detection section which detects, in the image, eyes which have undergone a predetermined color change, based on the image data; and

a recognition section which recognizes face portions in the image based on the eyes detected by the detection section.

4. A face extraction method for extracting face portions from an image and generating facial images based on image data of the image, comprising:

a detection step of detecting, in the image, eye portions which have undergone a predetermined color change, based on the image data;

a recognition step of recognizing face portions in the photographic image based on the eye portions detected in the detection step;

a correction step of correcting the color change in the eye portions detected in the detection step; and

a face image generating step of generating facial images by extracting, from the image, the face portions which have been recognized in the recognition step and whose color change has been corrected in the correction step.

5. A face extraction method for extracting face portions from an image and generating facial images based on image data of the image, comprising:

a detection step of detecting red-eye portions in the image, based on the image data;

a recognition step of recognizing face portions in the image based on the red-eye portions detected in the detection step;

a correction step of correcting the red-eye portions detected in the detection step; and

a face image generating step of generating facial images by extracting, from the image, the face portions which have been recognized in the recognition step and whose red-eye portions have been corrected in the correction step.

6. An image pickup apparatus which photographs a subject and generates photographic image data of a photographic image, comprising:

a detection section that detects, in the photographic image, eye portions which have undergone a predetermined color change, based on the image data;

a recognition section that recognizes face portions in the photographic image based on the eye portions detected by the detection section;

a correction section that corrects the color change in the eye portions detected by the detection section; and

a face image generating section that generates facial images by extracting, from the photographic image, the face portions which have been recognized by the recognition section and whose color change has been corrected by the correction section.

7. The image pickup apparatus according to claim 6, wherein the detection section detects red-eye portions in the image and the correction section corrects the red-eye portions detected by the detection section.