Apparatus and method to determine drowsiness of a driver

• US 10,262,219 B2
• Filed: 10/10/2016
• Issued: 04/16/2019
• Est. Priority Date: 04/21/2016
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Sam Yong, Lee, Byoung Joon, Ryu, Seong Sook, Kim, Jin Kwon, Jung, Ho Choul
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US15/289,824
• Publication Number:
  US 20170308762A1
• Time in Patent Office: 918 Days
• Field of Search: 382104
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: B60R 2300/8006 for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

An apparatus and method for determining drowsiness of a driver are provided. The apparatus includes an imaging device that obtains an image of the driver and a controller that determines (e.g., based on the image of the driver) when the driver is in a fatigue state, when the driver is in an eyelid closure state, and when the driver is in a wake-up state. The controller further determines that the driver is in a drowsiness state when after the fatigue state of the driver continues over a predetermined first time interval, the eyelid closure state and the wake-up state of the driver alternately and repetitively occur within a predetermined second time interval.

Claims

1. An apparatus for determining drowsiness of a driver of a vehicle, comprising:

an imaging device configured to obtain an image of the driver; and

a controller configured to determine a fatigue state of the driver, an eyelid closure state of the driver, and a wake-up state of the driver from the image of the driver,

wherein the controller is configured to determine that the driver is in a drowsiness state when, after the fatigue state of the driver continues over a predetermined first time interval, and the eyelid closure state and the wake-up state of the driver occur alternately and repetitively within a predetermined second time interval, and

wherein the controller is configured to determine the fatigue state of the driver based on at least one of when the vehicle deviates from a driving lane or when the vehicle is driven in a zigzag direction from a driving state of the vehicle.

2. The apparatus according to claim 1, wherein the controller is configured to determine when the driver is in the fatigue state based on at least one of when a percentage of an eye closure of the driver exceeds a preset percentage during a predetermined third time interval and when a face motion of the driver is within a predetermined fourth time interval.

3. The apparatus according to claim 1, wherein the controller is configured to determine when the driver is in the wake-up state based on at least one of an eye blink of the driver that occurs within a predetermined fifth time interval and when a face motion of the driver exceeds a preset degree.

4. A method for determining drowsiness of a driver of a vehicle, comprising:

obtaining, by an imaging device, an image of the driver;

determining, by a controller, a fatigue state of the driver, an eyelid closure state of the driver and a wake-up state of the driver from the image; and

determining, by the controller, that the driver is in a drowsiness state when after the fatigue state of the driver continues over a predetermined first time interval, the eyelid closure state and the wake-up state of the driver occur alternately and repetitively within a predetermined second time interval,

wherein the determining of the fatigue state of the driver comprises determining, by the controller, the fatigue state of the driver based on at least one of when the vehicle deviates from a driving lane or when the vehicle is driven in a zigzag direction from a driving state of the vehicle.

5. The method according to claim 4, wherein when the driver is in the fatigue state is determined based on at least one of when an eyelid closure time of the driver exceeds a predetermined third time interval and when a face motion of the driver is within a predetermined fourth time interval.

6. The method according to claim 4, wherein when the driver is in the wake-up state is determined based on at least one of when an eye blink of the driver occurs within a predetermined fifth time interval or when a face motion of the driver exceeds a preset degree.