Image processing apparatus and method

• US 7,127,086 B2
• Filed: 08/27/2003
• Issued: 10/24/2006
• Est. Priority Date: 03/11/1999
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Yuasa, Mayumi, Suzuki, Kaoru, Wakasugi, Tomokazu, Yamaguchi, Osamu, Fukui, Kazuhiro
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US10/648,323
• Publication Number:
  US 20040042644A1
• Time in Patent Office: 1,154 Days
• Field of Search: 382/103, 382/115, 382/117, 382/118, 382/154, 382/190, 382/209, 382/218, 382/312, 382/318, 348/14.01, 348/47, 348/50, 348/159, 348/169, 351/206, 434/155, 902 3- 6, 902 25- 29
• US Class Current: 382/118
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

An image processing apparatus. A camera inputs an image of a face of a person to be recognized. A recognition area detection section generates a difference image between the input image and a predetermined pattern, and detects a recognition area whose value is above a threshold from the input image. An input data generation section converts the recognition area to a predetermined input data. A similarity calculation section calculates a similarity by comparing the predetermined input data with a predetermined dictionary data. A view position of the camera is located lower than a position of the face of the person. A direction of the optical axis of the camera represents an angle of elevation from a horizontal direction.

Claims

1. An image processing apparatus, comprising:

a first camera for inputting a first image of a face of a person to be recognized;

a second camera for inputting a second image of the face of the person;

face detection means for detecting a face area from the first image;

frontal face decision means for deciding whether the second image is a frontal face of the person by referring to the face area;

open eyes detection means for detecting a state of open eyes from the face area; and

image output means for outputting the second image inputted while the second image is decided to be the frontal face and the state of open eyes is detected;

wherein a direction from a view position of the second camera to a center position of the face of the person is a facial front direction, and

wherein a view position of the first camera is located lower than a position of the face of the person, and a direction of the optical axis of the first camera represents an angle of elevation from a horizontal direction.

2. The image processing apparatus according to claim 1, wherein the angle of elevation of the first camera is 20°

˜

60°

so that the first camera inputs the image including both pupils and both nostrils of the face of the person, and

wherein the second camera includes a target object to lead the person'"'"'s gaze direction.

3. The image processing apparatus according to claim 2,

wherein said open eyes detection means supplies an open eyes state detection signal to said image output means if said open eyes detection means detects two pupils from the face area.

4. The image processing apparatus according to claim 3,

wherein said frontal face detection means calculates a similarity between the face area and a dictionary pattern of a frontal face as the first image, and supplies a frontal face detection signal to said image output means if the similarity is above a threshold.

5. The image processing apparatus according to claim 4,

wherein said image output means outputs the second image whose input timing is equal to the first image from which the state detection signal and the frontal face detection signal are supplied.

6. A method for processing an image, comprising the steps of:

inputting a first image of a face of a person to be recognized using a first camera;

inputting a second image of the face of the person using a second camera;

detecting a face area from the first image;

deciding whether the second image is a frontal face of the person by referring to the face area;

detecting a state of open eyes from the face area; and

outputting the second image inputted while the second image is decided to be the frontal face and the state of open eyes is detected;

wherein a direction from a view position of the second camera to a center position of the face of the person is a facial front direction, and

wherein a view position of the first camera is located lower than a position of the face of the person, and a direction of the optical axis of the first camera represents an angle of elevation from a horizontal direction.

7. A computer readable medium that stores a computer program comprising:

instruction means for causing a computer to input a first image of a face of a person to be recognized using a first camera;

instruction means for causing a computer to input a second image of the face of the person using a second camera;

instruction means for causing a computer to detect a face area from the first image;

instruction means for causing a computer to decide whether the second image is a frontal face of the person by referring to the face area;

instruction means for causing a computer to detect a state of open eyes from the face area; and

instruction means for causing a computer to output the second image inputted while the second image is decided to be the frontal face and the state of open eyes is detected;

wherein a direction from a view position of the second camera to a center position of the face of the person is a facial front direction, and

wherein a view position of the first camera is located lower than a position of the face of the person, and a direction of the optical axis of the first camera represents an angle of elevation from a horizontal direction.