Face orientation detection apparatus, face orientation detection method, and computer memory product

• US 7,502,494 B2
• Filed: 01/26/2004
• Issued: 03/10/2009
• Est. Priority Date: 01/30/2003
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Ito, Hisao, Tafuku, Akiyoshi, Baba, Kozo
• Primary Examiner(s): SHERALI, ISHRAT I
• Application Number:
  US10/763,185
• Publication Number:
  US 20040151350A1
• Time in Patent Office: 1,870 Days
• Field of Search: 382/117, 382/118, 382/216, 382/115, 382/289, 382/190, 382/291
• US Class Current: 382/118
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

The CPU of a face orientation detection apparatus which acquires an image frame photographed by a camera through a cable detects the face region in the horizontal direction of the acquired image frame by executing computer programs stored on a hard disk. Moreover, the CPU detects the eye position in the vertical direction from the image frame, and detects the nose position in the horizontal direction based on the detected eye position. Furthermore, the CPU detects the orientation of the face included in the image frame, based on the detected nose position and face region.

Claims

1. An apparatus for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

a horizontal adding section for adding the respective pixel data in the horizontal direction of the image data;

an eye detecting section for detecting an eye position in the vertical direction based on a plurality of sum values calculated by said horizontal adding section;

an eye vicinity adding section for adding the respective pixel data in the vertical direction in a vicinity region of the eye position detected by said eye detecting section; and

an orientation detecting section for detecting a face orientation based on a plurality of sum values calculated by said eye vicinity adding section.

2. The face orientation detection apparatus of claim 1, further comprising:

a vertical adding section for deriving a graph showing values of summation of the pixel data, which are calculated by adding the respective pixel data in the vertical direction of the image data, along the horizontal direction;

an extracting section for extracting characteristic data of a plurality of sum values calculated by said vertical adding section; and

a characteristic table storing the characteristic data in association with a plurality of face orientations,

wherein said orientation detecting section selects, from said characteristic table, a face orientation corresponding to the characteristic data extracted by said extracting section.

3. An apparatus for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

a horizontal adding section for adding the respective pixel data in the horizontal direction of the image data;

an eye detecting section for detecting an eye position in the vertical direction based on a plurality of sum values calculated by said horizontal adding section;

an eye vicinity adding section for adding the respective pixel data in the vertical direction in a vicinity region of the eye position detected by said eye detecting section;

an orientation detecting section for detecting a face orientation based on a plurality of sum values calculated by said eye vicinity adding section;

a maximum value specifying section for specifying a maximum value of the sum values calculated by said horizontal adding section;

a local minimum value specifying section for specifying a local minimum value of the sum values calculated by said horizontal adding section; and

a selecting section for selecting a sum value which is located higher in the vertical direction than a sum value specified as the maximum value by said maximum value specifying section and is specified as the local minimum value by said local minimum value specifying section, said eye detecting section detecting that a position in the vertical direction of the sum value selected by said selecting section is the eye position.

4. An apparatus for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

a horizontal adding section for adding the respective pixel data in the horizontal direction of the image data;

an eye detecting section for detecting an eye position in the vertical direction based on a plurality of sum values calculated by said horizontal adding section;

an eye vicinity adding section for adding the respective pixel data in the vertical direction in a vicinity region of the eye position detected by said eye detecting section;

an orientation detecting section for detecting a face orientation based on a plurality of sum values calculated by said eye vicinity adding section;

a local minimum value specifying section for specifying a local minimum value of the sum values calculated by said horizontal adding section; and

a selecting section for selecting a sum value which is specified as the local minimum value by said local minimum value specifying section in second highest position in the vertical direction of the sum values calculated by said horizontal adding section, said eye detecting section detecting that a position in the vertical direction of the sum value selected by said selecting section is the eye position.

5. An apparatus for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

a region detecting section for detecting a face region in the horizontal direction from the image data;

a nose detecting section for detecting a nose position in the horizontal direction from the image data;

an orientation detecting section for detecting a face orientation based on the nose position detected by said nose detecting section and the region detected by said region detecting section

a threshold storing section for storing thresholds;

a vertical adding section for adding the respective pixel data in the vertical direction of the image data;

a comparing section for comparing a sum value calculated by said vertical adding section and a threshold stored in said threshold storing section, and when the sum value is larger than the threshold as a result of comparison in said comparing section, said region detecting section judges that the pixel data calculated into the sum value are within the face region.

8. The face orientation detection apparatus of claim 5, further comprising:

a pixel number storing section for storing a predetermined number of pixels;

a horizontal adding section for adding the respective pixel data in the horizontal direction of the image data;

an eye detecting section for detecting an eye position in the vertical direction based on a plurality of sum values calculated by said horizontal adding section;

an under eye adding section for adding the pixel data in the vertical direction in a region located lower than the eye position detected by said eye detecting section by the number of pixels stored in said pixel number storing section; and

a local minimum value specifying section for specifying a local minimum value of the sum values calculated by said under eye adding section,

wherein said nose detecting section detects that a position in the horizontal direction of the sum value specified as the local minimum value by said local minimum value specifying section is the nose position.

11. The face orientation detection apparatus of claim 8, further comprising:

a distance storing section for storing a predetermined distance;

a distance calculating section for, when a plurality of local minimum values are specified by said local minimum value specifying section, calculating a distance in the horizontal direction between sum values specified as the local minimum values; and

a comparing section for comparing the distance calculated by said distance calculating section and the predetermined distance stored in said distance storing section,

wherein, when the distance calculated by said distance calculating section is shorter than the predetermined distance as a result of comparison in said comparing section, said nose detecting section detects that a center portion in the horizontal direction of the two sum values separated by the distance is the nose position.

6. An apparatus for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

a region detecting section for detecting a face region in the horizontal direction from the image data;

a nose detecting section for detecting a nose position in the horizontal direction from the image data;

an orientation detecting section for detecting a face orientation based on the nose position detected by said nose detecting section and the region detected by said region detecting section;

a vertical adding section for adding the respective pixel data in the vertical direction of the image data;

a variation calculating section for calculating a variation in the horizontal direction of the sum values calculated by said vertical adding section; and

a specifying section for specifying a face outline in the horizontal direction based on the variation calculated by said variation calculating section, said region detecting section detecting the face region based on the face outline specified by said specifying section.

9. The face orientation detection apparatus of claim 6, further comprising:

a pixel number storing section for storing a predetermined number of pixels;

a horizontal adding section for adding the respective pixel data in the horizontal direction of the image data;

an eye detecting section for detecting an eye position in the vertical direction based on a plurality of sum values calculated by said horizontal adding section;

an under eye adding section for adding the pixel data in the vertical direction in a region located lower than the eye position detected by said eye detecting section by the number of pixels stored in said pixel number storing section; and

a local minimum value specifying section for specifying a local minimum value of the sum values calculated by said under eye adding section,

wherein said nose detecting section detects that a position in the horizontal direction of the sum value specified as the local minimum value by said local minimum value specifying section is the nose position.

12. The face orientation detection apparatus of claim 9, further comprising:

a distance storing section for storing a predetermined distance;

a distance calculating section for, when a plurality of local minimum values are specified by said local minimum value specifying section, calculating a distance in the horizontal direction between sum values specified as the local minimum values; and

a comparing section for comparing the distance calculated by said distance calculating section and the predetermined distance stored in said distance storing section,

wherein, when the distance calculated by said distance calculating section is shorter than the predetermined distance as a result of comparison in said comparing section, said nose detecting section detects that a center portion in the horizontal direction of the two sum values separated by the distance is the nose position.

7. An apparatus for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

a region detecting section for detecting a face region in the horizontal direction from the image data;

a nose detecting section for detecting a nose position in the horizontal direction from the image data;

an orientation detecting section for detecting a face orientation based on the nose position detected by said nose detecting section and the region detected by said region detecting section;

a pixel number storing section for storing a predetermined number of pixels;

a horizontal adding section for adding the respective pixel data in the horizontal direction of the image data;

an eye detecting section for detecting an eye position in the vertical direction based on a plurality of sum values calculated by said horizontal adding section;

an under eye adding section for adding the pixel data in the vertical direction in a region located lower than the eye position detected by said eye detecting section by the number of pixels stored in said pixel number storing section; and

a local minimum value specifying section for specifying a local minimum value of the sum values calculated by said under eye adding section, said nose detecting section detecting that a position in the horizontal direction of the sum value specified as the local minimum value by said local minimum value specifying section is the nose position.

10. The face orientation detection apparatus of claim 7, further comprising:

a distance storing section for storing a predetermined distance;

a distance calculating section for, when a plurality of local minimum values are specified by said local minimum value specifying section, calculating a distance in the horizontal direction between sum values specified as the local minimum values; and

a comparing section for comparing the distance calculated by said distance calculating section and the predetermined distance stored in said distance storing section,

wherein, when the distance calculated by said distance calculating section is shorter than the predetermined distance as a result of comparison in said comparing section, said nose detecting section detects that a center portion in the horizontal direction of the two sum values separated by the distance is the nose position.

13. A method for detecting orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, comprising:

adding using a processor, the respective pixel data in the horizontal direction of the image data;

detecting, using a processor, an eye position in the vertical direction based on a plurality of sum values calculated;

adding, using a processor, the respective pixel data in the vertical direction in a vicinity region of the detected eye position; and

detecting, using a processor, a face orientation based on a plurality of sum values calculated for the vicinity region of eyes.

14. A computer readable medium encoded with a computer program that when executed by a computer causes the computer to detect orientation of a face from image data acquired by photographing the face, the image data being composed of a plurality of pixel data aligned in horizontal direction and vertical direction, respectively, by performing a method comprising:

causing the computer to add the respective pixel data in the horizontal direction of the image data;

causing the computer to detect an eye position in the vertical direction based on a plurality of sum values calculated;

causing the computer to add the respective pixel data in the vertical direction in a vicinity region of the detected eye position; and

causing the computer to detect a face orientation based on a plurality of sum values calculated for the vicinity region of eyes.