Driver attentiveness detection method and device

• US 9,834,221 B2
• Filed: 10/19/2012
• Issued: 12/05/2017
• Est. Priority Date: 10/19/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Sweden AB (SSW Partners LP)
• Original Assignee: Autoliv AB (Autoliv Incorporated)
• Inventors: Nilsson, Benny
• Primary Examiner(s): Casillashernandez, Omar
• Application Number:
  US14/436,658
• Publication Number:
  US 20150258997A1
• Time in Patent Office: 1,873 Days
• Field of Search: 340576
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: B60K 28/06 responsive to incapacity of driver
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

A driver attentiveness detection device and method using at least one digital camera device (2) and a control unit (5). The camera device (2) is arranged to detect eye configurations of a vehicle driver (4). The control unit (5) compares the detected eye configurations with previously stored models of eye configuration samples (13, 14, 15, 16) which are indicative of eyes that look inside or outside a predetermined field of view (6). The control unit (5) further determines whether the detected eye configurations are looking inside or outside the predetermined field of view from the comparison, and is also arranged to indicate when the vehicle driver (4) has been determined to be looking outside the predetermined field of view (6) to a predetermined extent.

Claims

1. A method for detecting decreased attentiveness of a vehicle driver, the method comprising the steps of:

detecting eye configurations of the vehicle driver;

analyzing the detected eye configurations by comparing the detected eye configurations with previously stored models of eye configuration samples, the stored models of eye configuration samples being indicative of eyes that look inside or outside a predetermined field of view;

determining whether the detected eye configurations are looking inside the predetermined field of view or outside the predetermined field of view using the analysis;

indicating when the vehicle driver has been determined to be looking outside the predetermined field of view to a predetermined extent, wherein the field of view extends to an imaginary end surface, positioned at a predetermined distance (L) from the driver, the predetermined distance having a greater value at high vehicle speeds than at low vehicle speeds; and

upon indicating that the driver is looking outside the predetermined field of view to the predetermined extent, generating an output signal activating at least one of a driver alert system or an automatic brake system,

wherein the predetermined extent includes a buffer time of the vehicle driver looking outside the predetermined field of view reaching a buffer threshold,

wherein the buffer time is initiated when it is determined that the vehicle driver has been continuously looking inside the predetermined field of view for an initialization buffer time equaling an initialization buffer threshold, and

wherein the step of generating the output signal is suspended while the vehicle is traveling at a speed below 60 km/h.

2. The method according to claim 1, wherein the step of indicating when the vehicle driver has been determined to be looking outside the predetermined field of view to a predetermined extent comprises producing an output signal which is indicative of vehicle driver inattentiveness.

3. The method according to claim 2, wherein the output signal is configured for triggering an alarm or one or more vehicle safety systems.

4. The method according to claim 1, wherein the predetermined field of view is a volume that extends in a vehicle forward running direction (D).

5. The method according to claim 4, wherein the volume extends to the imaginary end surface, positioned at a certain distance (L) from the driver, where the detected eye configurations are determined to be looking inside the predetermined field of view if they are determined to be looking at the imaginary end surface.

6. The method according to claim 1, wherein the stored models of eye configuration samples are modeled by using Haar features.

7. The method for detecting decreased attentiveness of a vehicle driver according to claim 1, wherein the stored models of eye configuration samples being indicative of eyes that look either inside or outside the predetermined field of view.

8. The method for detecting decreased attentiveness of a vehicle driver according to claim 1, further comprising providing a camera device for use in the detecting of eye configurations of the vehicle driver.

9. The method according to claim 3, wherein the output signal is used for triggering an alarm in the form of at least one of an acoustic signal, an optical signal, and a vibration.

10. A driver attentiveness detection device comprising at least one digital camera device and a control unit, the camera device being arranged to detect eye configurations of a vehicle driver, the control unit is configured to compare the detected eye configurations with stored models of eye configuration samples, wherein the stored models of eye configuration samples are indicative of eyes that look inside or outside a predetermined field of view, the control unit further being configured to determine whether the detected eye configurations are looking inside the predetermined field of view or outside the predetermined field of view, wherein the field of view extends to an imaginary end surface, positioned at a predetermined distance (L) from the driver, the predetermined distance having a greater value at high vehicle speeds than at low vehicle speeds, wherein the control unit furthermore is configured to indicate by generating an output signal when the vehicle driver has been determined to be looking outside the predetermined field of view to a predetermined extent, wherein the predetermined extent includes a buffer time of the vehicle driver looking outside the predetermined field of view reaching a buffer threshold, wherein the control unit is configured to initiate the buffer time when it is determined that the vehicle driver has been continuously looking inside the predetermined field of view for an initialization buffer time equaling an initialization buffer threshold, and wherein the device is configured to suspend the generation of the output signal while the vehicle is traveling at a speed below 60 km/h.

11. The device according to claim 10, wherein an indication by the control unit that the vehicle driver has been determined to be looking outside the predetermined field of view to a predetermined extent comprises the production of an output signal which is indicative of vehicle driver inattentiveness.

12. The device according to claim 11, wherein the output signal is arranged to trigger at least one of an alarm and one or more vehicle safety systems.

13. The device according to claim 10, wherein the predetermined field of view is a volume that extends in a vehicle forward running direction (D).

14. The device according to claim 13, wherein the volume extends to the imaginary end surface, positioned at a certain distance (L) from the driver, wherein the control unit is arranged to determine that detected eye configurations are looking inside the predetermined field of view if the control unit determines the driver is looking at the imaginary end surface.

15. The device according to a claim 10, wherein the camera device is of a near infrared type.

16. The device according to claim 10, wherein the camera device comprises a near infrared flash.

17. The device according to claim 10, wherein the camera device is positioned at one of a steering wheel rim or spokes, at a steering column, at a dashboard, in an inner roof lining, at an airbag cover, at a sun visor, at an inner rear-view mirror assembly, and in a vehicle A-pillar.

18. The device according to claim 10, wherein the stored models of eye configuration samples are indicative of eyes that look inside the predetermined field of view.

19. The device according to claim 12, wherein the output signal is the alarm in the form of at least one of an acoustic signal, an optical signal, and a vibration.

20. The device according to claim 10, wherein the control unit is configured to interrupt the output signal in the event that the vehicle is undergoing a maneuver including at least one of, a turn indicated by one of a steering wheel angle exceed a predetermined value, a turn signal is activated, a turn as indicated by a GPS signal, a turn as indicated by a camera device, and a turn as indicated by an inertia sensor.