HEAD MOVEMENT DETECTION APPARATUS

• US 20130163825A1
• Filed: 12/20/2012
• Published: 06/27/2013
• Est. Priority Date: 12/26/2011
• Status: Abandoned Application

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Shimura, Atsushi
• Application Number:
  US13/721,689
• Publication Number:
  US 20130163825A1
• Time in Patent Office: Days
• US Class Current: 382/107
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A head movement detection apparatus capable of more reliably detecting a head movement of a subject. In the apparatus, an image capture unit captures a facial image of the subject. A trajectory acquisition unit acquires a trajectory of a facial feature point of the subject over time from a sequence of facial mages captured by the image capture unit. A storage unit stores a set of features of a trajectory of the facial feature point during a specific head movement made by the subject. A head movement detection unit detects the specific head movement made by the subject on the basis of a degree of correspondence between the set of features of the trajectory previously stored in the storage unit and a corresponding set of features of a trajectory acquired by the trajectory acquisition unit.

Claims

1. A head movement detection apparatus comprising:

an image capture unit that captures a facial image of a subject;

a trajectory acquisition unit that acquires a trajectory of a facial feature point of the subject over time from a sequence of facial images captured by the image capture unit;

a storage unit that stores a set of features of a trajectory of the facial feature point of the subject during a specific head movement made by the subject, the trajectory being acquired by the trajectory acquisition unit from a sequence of facial images captured by the image capture unit during the specific head movement made by the subject; and

a head movement detection unit that detects the specific head movement made by the subject on the basis of a degree of correspondence between the set of features of the trajectory previously stored in the storage unit and a corresponding set of features of a trajectory acquired by the trajectory acquisition unit.

2. The apparatus of claim 1, further comprising

a setting unit that defines a range of trajectory features specific to the subject for detecting the specific head movement made by the subject as a function of the set of features of the trajectory of the facial feature point of the subject previously stored in the storage unit,

wherein the head movement detection unit determines whether or not a corresponding set of features of a trajectory of the facial feature point of the subject acquired by the trajectory acquisition unit are within the range of trajectory features defined by the setting unit, and when it is determined that the corresponding set of features of the trajectory are within the range of trajectory features defined by the setting unit, then determines that the specific head movement has been made by the subject.

3. The apparatus of claim 1, wherein the facial feature point of the subject is selected from a group consisting of a left eye, a right eye, a left ear, a right ear, a nose, and a mouth of the face of the subject.

4. The apparatus of claim 1, wherein the specific head movement is a reciprocating head movement, and

the set of features of the trajectory of the facial feature point of the subject during the reciprocating head movement made by the subject are at least one of a vertical amplitude, a horizontal amplitude, and a duration of reciprocating movement of the trajectory.

5. The apparatus of claim 4, wherein the specific head movement is a head nodding movement, and

the set of features of the trajectory of the facial feature point during the head nodding movement made by the subject are the vertical amplitude, the horizontal amplitude, and the duration of vertical reciprocating movement of the trajectory.

6. The apparatus of claim 4, wherein the specific head movement is a head shaking movement, and

the set of features of the trajectory of the facial feature point during the head shaking movement made by the subject are the vertical amplitude, the horizontal amplitude, and the duration of horizontal reciprocating movement of the trajectory.

7. The apparatus of claim 1, wherein the apparatus is mounted in a vehicle, the subject is a driver of the vehicle, and the apparatus further comprises:

a vibratory component estimation unit that estimates a vibratory component due to a vehicle'"'"'s behavior included in a trajectory of the facial feature point of the driver acquired by the trajectory acquisition unit; and

a vibratory component removal unit that subtracts the vibratory component estimated by the vibratory component estimation unit from the trajectory of the facial feature point of the driver acquired by the trajectory acquisition unit to acquire a noise-free trajectory of the facial feature point of the driver,

the head movement detection unit detects the specific head movement made by the driver on the basis of a degree of correspondence between the set of features of the trajectory previously stored in the storage unit and a corresponding set of features of the noise-free trajectory of the facial feature point of the driver acquired by the vibratory component removal unit.

8. The apparatus of claim 1, wherein

the storage unit stores, for each of a plurality of subjects, the set of features of the trajectory of the facial feature point of the subject during the specific head movement made by the subject;

and

the head movement detection unit identifies which one of the plurality of subjects, and detects, for each of the plurality of subjects, the specific head movement made by the subject on the basis of a degree of correspondence between the set of features of the trajectory of the facial feature point during the specific head movement made by the same subject that are previously stored in the storage unit and a corresponding set of features of a trajectory of the facial feature point of the subject acquired by the trajectory acquisition unit.

9. The apparatus of claim 1, wherein the specific head movement is a first specific head movement,

the storage unit stores a set of features of a first trajectory of the facial feature point of the subject during the first specific head movement made by the subject and a set of features of a second trajectory of the facial feature point of the subject during a second specific head movement made by the subject, and

the head movement detection unit determines whether the first head movement, the second head movement or neither has been made by the subject on the basis of a degree of correspondence between the set of features of the first trajectory previously stored in the storage unit and a corresponding set of features of a trajectory acquired by the trajectory acquisition unit and a degree of correspondence between the set of features of the second trajectory previously stored in the storage unit and the corresponding set of features of the trajectory acquired by the trajectory acquisition unit.

10. The apparatus of claim 9, wherein the first specific head movement is a head nodding movement, and the second specific head movement is a head shaking movement.

11. The apparatus of claim 1, further comprising a feature point detector that detects the facial feature point of the subject in each facial image captured by the image capture unit.

12. A head movement detection apparatus comprising:

an image capture unit that captures a facial image of a subject;

a trajectory acquisition unit that acquires a trajectory of a facial feature point of the subject over time from a sequence of facial images captured by the image capture unit;

a storage unit that stores a trajectory of the facial feature point of the subject during a specific head movement made by the subject, the trajectory being acquired by the trajectory acquisition unit from a sequence of facial images captured by the image capture unit during the specific head movement made by the subject; and

a head movement detection unit that detects the specific head movement made by the subject on the basis of a degree of correspondence between the trajectory previously stored in the storage unit and a trajectory acquired by the trajectory acquisition unit.

13. The apparatus of claim 12, wherein the facial feature point of the subject is selected from a group consisting of a left eye, a right eye, a left ear, a right ear, a nose, and a mouth of the face of the subject.

14. The apparatus of claim 12, wherein the apparatus is mounted in a vehicle, the subject is a driver of the vehicle, and the apparatus further comprises:

a vibratory component estimation unit that estimates a vibratory component due to a vehicle'"'"'s behavior included in a trajectory of the facial feature point of the driver acquired by the trajectory acquisition unit; and

a vibratory component removal unit that subtracts the vibratory component estimated by the vibratory component estimation unit from the trajectory of the facial feature point of the driver acquired by the trajectory acquisition unit to acquire a noise-free trajectory of the facial feature point of the driver,

the head movement detection unit detects the specific head movement made by the driver on the basis of a degree of correspondence between the trajectory previously stored in the storage unit and the noise-free trajectory of the facial feature point of the driver acquired by the vibratory component removal unit.

15. The apparatus of claim 12, wherein

the storage unit stores, for each of a plurality of subjects, the trajectory of the facial feature point of the subject during the specific head movement made by the subject;

and

the head movement detection unit identifies which one of the plurality of subjects, and detects, for each of the plurality of subjects, the specific head movement made by the subject on the basis of a degree of correspondence between the trajectory of the facial feature point during the specific head movement made by the same subject that is previously stored in the storage unit and a trajectory of the facial feature point of the subject acquired by the trajectory acquisition unit.

16. The apparatus of claim 12, wherein the specific head movement is a first specific head movement,

the storage unit stores a first trajectory of the facial feature point of the subject during the first specific head movement made by the subject and a second trajectory of the facial feature point of the subject during a second specific head movement made by the subject, and

the head movement detection unit determines whether the first head movement, the second head movement or neither has been made by the subject on the basis of a degree of correspondence between the first trajectory previously stored in the storage unit and a trajectory acquired by the trajectory acquisition unit and a degree of correspondence between the second trajectory previously stored in the storage unit and the trajectory acquired by the trajectory acquisition unit.

17. The apparatus of claim 16, wherein the first specific head movement is a head nodding movement, and the second specific head movement is a head shaking movement.

18. The apparatus of claim 12, further comprising a feature point detector that detects the facial feature point of the subject in each facial image captured by the image capture unit.