Alertness level detection apparatus and alertness level detection method

• US 9,390,337 B2
• Filed: 01/16/2014
• Issued: 07/12/2016
• Est. Priority Date: 01/29/2013
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Shigemura, Shusaku
• Primary Examiner(s): Harandi, Siamak
• Application Number:
  US14/763,802
• Publication Number:
  US 20150363657A1
• Time in Patent Office: 908 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

An alertness level detection apparatus, which is equipped to a vehicle and detecting alertness level of a driver, includes a stimulus information acquirer detecting stimulus applied to driver'"'"'s visual sensation within driver'"'"'s visual field under a state in which the driver watches in travel direction of the vehicle and acquiring stimulus information related to occurrence time and occurrence position of the stimulus within the driver'"'"'s visual field, a face image generator generating a face image of the driver, a line-of-sight position detector detecting line-of-sight position of the driver by analyzing the face image, a moving time duration detector detecting moving time duration taken for the driver to move the line of sight to the occurrence position of the stimulus immediately after the occurrence time of the stimulus, and an alertness level determiner determining the alertness level of the driver based on the moving time duration.

Claims

1. An alertness level detection apparatus equipped to a vehicle and detecting an alertness level of a driver, the alertness level detection apparatus comprising:

a stimulus information acquirer detecting a stimulus newly applied to a visual sensation of the driver within a visual field of the driver under a state in which the driver watches in a travel direction of the vehicle and acquiring stimulus information related to an occurrence time of the stimulus and an occurrence position of the stimulus within the visual field of the driver;

a face image generator generating a face image of the driver;

a line-of-sight position detector detecting a position of a line of sight of the driver by analyzing the face image;

a moving time duration detector detecting a moving time duration taken for the driver to move the line of sight to the occurrence position of the stimulus immediately after the occurrence time of the stimulus; and

an alertness level determiner determining the alertness level of the driver based on the moving time duration.

2. The alertness level detection apparatus according to claim 1, further comprising

a front view image generator equipped to the vehicle and generating a front view image taken in the travel direction of the vehicle,

wherein the stimulus information acquirer acquires the stimulus information by analyzing the front view image.

3. The alertness level detection apparatus according to claim 2, wherein

the front view image generator generates a plurality of the front view images at predetermined intervals, and

when the stimulus information detects a moving object as the stimulus in one of the plurality of the front view images, the stimulus information acquirer acquires, as the stimulus information, a generation time of the one of the plurality of the front view images and a position of the moving object in the one of the plurality of the front view images.

4. The alertness level detection apparatus according to claim 1, further comprising

a stimulus display unit performing a stimulus display, as the stimulus applied to the visual sensation of the driver, at a predetermined display position defined within the visual field of the driver,

wherein the stimulus information acquirer acquires, as the stimulus information, an execution time of the stimulus display and the predetermined display position of the stimulus display.

5. The alertness level detection apparatus according to claim 4,

wherein the stimulus display unit displays a predetermined stimulus image as the performing of the stimulus display.

6. The alertness level detection apparatus according to claim 4, further comprising

a stationary state detector detecting a stationary state of the vehicle,

wherein the stimulus display unit performs the stimulus display under a condition that the vehicle is in the stationary state.

7. The alertness level detection apparatus according to claim 1, further comprising

an accumulator accumulating a predetermined number of the moving time durations,

wherein the alertness level determiner determines the alertness level of the driver based on the predetermined number of the moving time durations.

8. The alertness level detection apparatus according to claim 7, wherein

the alertness level determiner includes:

a reaction time duration determiner determining a reaction time duration, which indicates the predetermined number of the moving time durations, based on the predetermined number of the moving time durations every time the predetermined number of the moving time durations are accumulated; and

an updater comparing the reaction time duration determined by the reaction time duration determiner with a reference reaction time duration that is preliminarily set, wherein, when the reaction time duration is shorter than the reference reaction time duration, the updater updates the reference reaction time duration with the reaction time duration, and

the alertness level determiner determines the alertness level of the driver based on a deviation of the reaction time duration from the reference reaction time duration.

9. An alertness level detection method applied to a vehicle for detecting an alertness level of a driver, the alertness level detection method comprising:

detecting a stimulus newly applied to a visual sensation of a driver within a visual field of the driver under a state in which the driver watches in a travel direction of the vehicle;

acquiring stimulus information related to an occurrence time of the stimulus and an occurrence position of the stimulus within the visual field of the driver;

generating a face image of the driver;

detecting a position of a line of sight of the driver by analyzing the face image;

detecting a moving time duration taken for the driver to move the line of sight to the occurrence position of the stimulus immediately after the occurrence time of the stimulus; and

determining the alertness level of the driver based on the moving time duration.