FACIAL DIRECTION DETECTING APPARATUS

• US 20130076881A1
• Filed: 09/11/2012
• Published: 03/28/2013
• Est. Priority Date: 09/26/2011
• Status: Abandoned Application

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Takahashi, Akio, Ueda, Shinsuke
• Application Number:
  US13/610,013
• Publication Number:
  US 20130076881A1
• Time in Patent Office: Days
• US Class Current: 348/77
• CPC Class Codes: B60K 28/06 responsive to incapacity of driver
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation

Abstract

A facial direction detecting apparatus includes a nostril extracting unit for extracting the nostrils of a person from among multiple characteristic portions that are extracted by a characteristic portion extracting unit. The nostril extracting unit extracts the nostrils as the characteristic portion having a greatest amount of movement from among all of the multiple characteristic portions.

Claims

1. A facial direction detecting apparatus comprising:

a facial end detecting unit for detecting facial ends of a person from an image of the person (hereinafter referred to as a “

personal image”

);

a head rotational axis calculating unit for calculating an axis of rotation of the head of the person based on the ends detected by the facial end detecting unit;

a characteristic portion extracting unit for extracting multiple characteristic portions having a predetermined size from the personal image;

a nostril extracting unit for extracting the nostril of the person from among the multiple characteristic portions extracted by the characteristic portion extracting unit; and

a facial direction detecting unit for detecting a facial direction toward the left or right of the person corresponding to the nostril extracted by the nostril extracting unit and the axis of rotation of the head calculated by the head rotational axis calculating unit,

wherein the nostril extracting unit extracts the nostril as a characteristic portion having a greatest amount of movement from among the multiple characteristic portions.

2. The facial direction detecting apparatus according to claim 1, wherein the characteristic portion extracting unit comprises:

a low luminance area extracting unit for extracting, as the multiple characteristic portions from the personal image, multiple low luminance areas having a predetermined size and for which a luminance thereof is lower than a predetermined luminance,

wherein the nostril extracting unit extracts, as the nostril, a low luminance area for which an amount of movement thereof is greatest from among the multiple low luminance areas extracted by the low luminance area extracting unit.

3. The facial direction detecting apparatus according to claim 2, wherein the low luminance area extracting unit treats an inner side of the facial ends detected by the facial end detecting unit as a nostril candidate extraction area, and extracts multiple low luminance areas having a predetermined size only from within the nostril candidate extraction area.

4. The facial direction detecting apparatus according to claim 1, further comprising:

a plurality of vehicle-mounted devices mounted in a vehicle and which are capable of being operated by a passenger of the vehicle;

an image capturing unit capable of capturing an image of a face of the passenger; and

a vehicle-mounted device identifying unit for identifying any one of the vehicle-mounted devices from among the multiple vehicle-mounted devices based on the facial direction detected by the facial direction detecting unit,

wherein the facial end calculating unit treats the facial image of the passenger, which was captured by the image capturing unit, as the personal image, and detects the facial ends of the passenger, and

wherein the vehicle-mounted device identifying unit identifies the vehicle-mounted device based on the facial direction detected by the facial direction detecting unit.

5. A facial direction detecting apparatus comprising:

an image capturing unit that captures an image of a head of a person;

an edge detector that detects left and right edges of the head from the image of the head (hereinafter referred to as a “

head image”

);

a rotational axis identifier that identifies an axis of rotation of the head in the head image using the left and right edges;

a characteristic area extractor that extracts multiple characteristic areas, which are areas in the head image for which a luminance thereof is lower than a threshold which is lower than a predetermined luminance or for which the luminance thereof is higher than a threshold which is higher than the predetermined luminance;

a displacement amount calculator that calculates, in relation to each of the respective multiple characteristic areas, a displacement amount accompanying rotation of the head;

a maximum displacement area identifier that identifies an area for which the displacement amount thereof is greatest (hereinafter referred to as a “

maximum displacement area”

) from among the multiple characteristic areas;

a central line identifier that identifies, based on the maximum displacement area, a central line in a vertical direction of the head when the head is viewed from a frontal direction thereof; and

a facial direction calculator that calculates as a facial direction an orientation of the head, based on a relative positional relationship between the axis of rotation and the central line in the head image.