Monitoring a degree of attention of a driver of a vehicle

• US 9,619,721 B2
• Filed: 10/14/2015
• Issued: 04/11/2017
• Est. Priority Date: 10/14/2014
• Status: Active Grant

• Current Assignee: Audi AG (Volkswagen AG), Volkswagen AG
• Original Assignee: Audi AG (Volkswagen AG), Volkswagen AG
• Inventors: Bogner, Nico, Grokopf, Gordon, Zachmayer, Andreas, Bthorn, Robert, Franke, Hendrik, Eltaher, Asem, Brosig, Stefan
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): PAIGE, TYLER D
• Application Number:
  US14/882,681
• Publication Number:
  US 20160104050A1
• Time in Patent Office: 545 Days
• Field of Search: 701 70, 382117, 600558
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1103 Detecting eye twinkling
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/6893 Cars
• CPC Class Codes: B60K 28/066 actuating a signalling device B60K28/063 takes precedence
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60T 2220/02 Driver type; Driving style; Driver adaptive features
• CPC Class Codes: B60T 2270/413 Plausibility monitoring, cross check, redundancy
• CPC Class Codes: B60T 7/12 for automatic initiation; for initiation not subject to will of driver or passenger limiting speed of vehicles other than rail vehicles B60K31/00
• CPC Class Codes: B60T 7/14 operated upon collapse of driver deadman's devices for electrically propelled vehicles B60L3/02
• CPC Class Codes: B60T 8/172 Determining control parameters used in the regulation, e.g. by calculations involving measured or detected parameters B60T8/17551 takes precedence
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2520/10 Longitudinal speed
• CPC Class Codes: B60W 2540/10 Accelerator pedal position
• CPC Class Codes: B60W 2540/12 Brake pedal position
• CPC Class Codes: B60W 2540/18 Steering angle
• CPC Class Codes: B60W 2555/20 Ambient conditions, e.g. wind or rain
• CPC Class Codes: B60W 2710/182 Brake pressure, e.g. of fluid or between pad and disc
• CPC Class Codes: B60W 2710/207 Steering angle of wheels
• CPC Class Codes: B60W 40/08 : related to drivers or passengers
• CPC Class Codes: B60W 50/16 : Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
• CPC Class Codes: B62D 15/02 : Steering position indicators ; Steering position determination; Steering aids
• CPC Class Codes: B62D 15/021 : Determination of steering angle
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 20/597 : Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 : Sensors therefor
• CPC Class Codes: G08B 21/06 : indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

To monitor a degree of attentiveness for a driver of a vehicle, a period is determined on the basis of a speed of the vehicle. It is determined whether an eyelid closed time and/or an eyelid closing time of the driver exceeds the period.

Claims

1. A method for monitoring a degree of attentiveness for a driver of a vehicle, the method comprising:

determining a period based on a speed of the vehicle;

receiving image data from an interior camera that depict a portion of the face of the driver;

determining whether a blink time of the driver exceeds the determined period based on the image data and identifying a reduced degree of attentiveness when the blink time of the driver exceeds the period;

monitoring the degree of attentiveness of the driver based on the determination of whether the blink time exceeds the period,

wherein the method is executed by a controller that is preconfigured to carry out the method.

2. The method of claim 1, further comprising:

obtaining a control signal that indicates at least one of a journey situation parameter for a journey situation in which the driver finds himself, a steering parameter for steering and a lane parameter for the vehicle,

wherein the determination of the period is additionally based on the control signal obtained.

3. The method of claim 2, wherein the journey situation parameter is selected from the group comprising:

a driving time;

a time of day;

an initiation frequency for a driver assistance system;

a frequency for a change in the speed of the vehicle;

a frequency for operation of pedals of the vehicle; and

ambient brightness.

4. The method of claim 2, wherein the steering parameter is selected from the group comprising:

an accuracy with which the driver follows a lane;

a time characteristic for operation of the steering of the vehicle;

a steering angle;

a characteristic for the steering angle;

a steering angle speed; and

a steering torque; and

/or wherein the lane parameter is selected from the group comprising;

a period before a lane marker is crossed and a distance to a lane marker.

5. The method of claim 1, further comprising:

output of an audible warning and/or a haptic warning to the driver when the result of the monitoring is a reduced degree of attentiveness of the driver.

6. The method of claim 1, wherein a driver assistance system of a vehicle outputs a driver assistance action

when the result of the monitoring is a reduced degree of attentiveness of the driver.

7. The method of claim 6, wherein the driver assistance action is initiated when the reduced degree of attentiveness of the driver persists for a prescribed further period.

8. The method of claim 6, further comprising successive initiation of at least two driver assistance actions if the reduced degree of attentiveness persists,

wherein the at least two driver assistance actions are selected from the group comprising:

lateral guidance of the vehicle to follow a lane lateral guidance of the vehicle to reach a breakdown lane;

braking of the vehicle; and

operation of hazard lights of the vehicle.

9. A controller that monitors a degree of attentiveness for a driver of a vehicle, wherein the controller comprises:

an interface, wherein the interface is set up to receive image data that depict a portion of the face of the driver; and

a computation unit, wherein the computation unit is set up to determine a period based on a speed of the vehicle,

wherein the computation unit is additionally set up determine whether a blink time of the driver exceeds the determined period based on the image data,

wherein the computation unit is additionally set up to monitor the degree of attentiveness of the driver based on the determination of whether the blink time exceeds the period.

10. The controller of claim 9, wherein the controller is set up to perform a method comprising:

determining a period based on a speed of the vehicle;

receiving image data that depict a portion of the face of the driver;

determining whether a blink time of the driver exceeds the period based on the image data; and

monitoring the degree of attentiveness of the driver based on the determination of whether the blink time exceeds the period.