APPARATUS AND METHOD TO DETERMINE DROWSINESS OF A DRIVER

• US 20170308762A1
• Filed: 10/10/2016
• Published: 10/26/2017
• Est. Priority Date: 04/21/2016
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Sam Yong, Lee, Byoung Joon, Ryu, Seong Sook, Kim, Jin Kwon, Jung, Ho Choul
• Granted Patent: US 10,262,219 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: B60R 2300/8006 for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

An apparatus and method for determining drowsiness of a driver are provided. The apparatus includes an imaging device that obtains an image of the driver and a controller that determines (e.g., based on the image of the driver) when the driver is in a fatigue state, when the driver is in an eyelid closure state, and when the driver is in a wake-up state. The controller further determines that the driver is in a drowsiness state when after the fatigue state of the driver continues over a predetermined first time interval, the eyelid closure state and the wake-up state of the driver alternately and repetitively occur within a predetermined second time interval.

Claims

1. An apparatus for determining drowsiness of a driver, comprising:

an imaging device configured to obtain an image of the driver; and

a controller configured to determine from the image of the driver when the driver is in a fatigue state, when the driver is in an eyelid closure state, and when the driver is in a wake-up state,

wherein the controller is configured to determine that the driver is in a drowsiness state when, after the fatigue state of the driver continues over a predetermined first time interval, and the eyelid closure state and the wake-up state of the driver occur alternately and repetitively within a predetermined second time interval.

2. The apparatus according to claim 1, wherein the controller is configured to determine when the driver is in the fatigue state based on at least one of when a percentage of an eye closure of the driver exceeds a preset percentage during a predetermined third time interval and when a face motion of the driver is within a predetermined fourth time interval.

3. The apparatus according to claim 2, further comprising:

a vehicle driving state obtainer configured to determine a driving state of a vehicle operated by the driver,

wherein the controller is configured to determine when the driver is in the fatigue state based on at least one of when the deviates from a driving lane or when the vehicle is driven in a zigzag direction from the driving state of the vehicle.

4. The apparatus according to claim 1, wherein the controller is configured to determine when the driver is in the wake-up state based on at least one of an eye blink of the driver that occurs within a predetermined fifth time interval and when a face motion of the driver exceeds a preset degree.

5. A method for determining drowsiness of a driver, comprising:

obtaining, by an image of the driver;

determining, by a controller, from the image when the driver is in a fatigue state, when the driver is in an eyelid closure state, and when the driver is in a wake-up state; and

determining, by the controller, that the driver is in a drowsiness state when after the fatigue state of the driver continues over a predetermined first time interval, the eyelid closure state and the wake-up state of the driver occur alternately and repetitively within a predetermined second time interval.

6. The method according to claim 5, wherein when the driver is in the fatigue state is determined based on at least one of when an eyelid closure time of the driver exceeds a predetermined third time interval and when a face motion of the driver is within a predetermined fourth time interval.

7. The method according to claim 6, further comprising:

determining, by the controller a driving state of a vehicle which is driven by the driver, wherein when the driver is in the fatigue state is determined based on at least one of the vehicle deviates from a driving lane or the vehicle is driven in a zigzag direction from the driving state of the vehicle.

8. The method according to claim 5, wherein when the driver is in the wake-up state is determined based on at least one of when an eye blink of the driver occurs within a predetermined fifth time interval or when a face motion of the driver exceeds a preset degree.