DRIVER STATE SENSING SYSTEM, DRIVER STATE SENSING METHOD, AND VEHICLE INCLUDING THE SAME

• US 20180304806A1
• Filed: 08/17/2017
• Published: 10/25/2018
• Est. Priority Date: 04/25/2017
• Status: Active Grant

• Current Assignee: HL Klemove Corporation
• Original Assignee: Mando-Hella Electronics Corp.
• Inventors: KIM, Shinwook
• Granted Patent: US 10,369,926 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

Disclosed are a driver state sensing system, a driver state sensing method, and a vehicle including the same. The driver state sensing system includes an image photographing unit composed of a single channel to photograph images, a controller that extracts at least one shape point from a driver image sensed in the images and compares a motion vector calculated based on the amount of change of the shape point with at least one drowsiness vector stored in advance to determine whether a driver is in a drowsiness state, and a warning unit to warn when it is determined that the driver is in a drowsiness state.

Claims

1. A driver state sensing system comprising:

an image photographing unit composed of a single channel to photograph images;

a controller that extracts at least one shape point from a driver image sensed in the images and compares a motion vector calculated based on the amount of change of the shape point with at least one drowsiness vector stored in advance to determine whether a driver is in a drowsiness state; and

a warning unit to warn when it is determined that the driver is in a drowsiness state.

2. The driver state sensing system according to claim 1,

wherein the controller calculates a first motion vector based on a first shape point of a first frame and a second shape point of a second frame which have a time difference, in order to calculate the motion vector.

3. The driver state sensing system according to claim 2,

wherein the controller comprises a frame buffer to store the first frame and the second frame which have a time difference.

4. The driver state sensing system according to claim 1,

wherein the controller determines that a driver is in a drowsiness state and learns the calculated motion vector if the difference between the calculated motion vector and at least one drowsiness vector stored in advance has an error smaller than a preset first threshold value.

5. A driver state sensing method comprising steps of :

photographing images based on a single-channel camera sensor;

extracting at least one shape point from a driver image sensed in the images;

calculating a motion vector based on the amount of change of the shape point;

comparing the calculated motion vector with at least one drowsiness vector stored in advance to determine whether a driver is in a drowsiness state; and

warning when it is determined that the driver is in a drowsiness state.

6. The driver state sensing method according to claim 5,

wherein the step of calculating a motion vector based on the amount of change of the shape point further comprises:

storing a first shape point of a first frame;

storing a second shape point of a second frame having a time difference with the first frame; and

calculating the motion vector based on the first shape point and the second shape point.

7. The driver state sensing method according to claim 5,

wherein the step of comparing the calculated motion vector with at least one drowsiness vector stored in advance to determine whether a driver is in a drowsiness state further comprises:

determining that the driver is in a drowsiness state if the difference between the calculated motion vector and at least one drowsiness vector stored in advance has an error smaller than a preset first threshold value.

8. The driver state sensing method according to claim 7, further comprising:

a step of learning the calculated motion vector.

9. A vehicle comprising a driver state sensing system,

wherein the driver state sensing system comprises

an image photographing unit composed of a single channel to photograph images;

a controller that extracts at least one shape point from a driver image sensed in the images and compares a motion vector calculated based on the amount of change of the shape point with at least one drowsiness vector stored in advance to determine whether a driver is in a drowsiness state; and

a warning unit to warn when it is determined that the driver is in a drowsiness state.

10. The vehicle according to claim 9,

wherein the image photographing unit comprises a single channel camera sensor, and

the camera sensor is installed at a position of at least one of a front pillar, a rearview mirror, and a dashboard of the vehicle to photograph the driver.

11. The vehicle according to claim 10,

wherein the controller calculates a first motion vector based on a first shape point of a first frame and a second shape point of a second frame which have a time difference, in order to calculate the motion vector.

12. The vehicle according to claim 11,

wherein the controller determines that a driver is in a drowsiness state and learns the calculated motion vector if the difference between the calculated motion vector and at least one drowsiness vector stored in advance has an error smaller than a preset first threshold value.