LANE DEPARTURE WARNING SYSTEM

• US 20120206252A1
• Filed: 02/16/2011
• Published: 08/16/2012
• Est. Priority Date: 02/16/2011
• Status: Abandoned Application

• Current Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Sherony, Rini, Hada, Hideki
• Application Number:
  US13/029,078
• Publication Number:
  US 20120206252A1
• Time in Patent Office: Days
• US Class Current: 340/438
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2540/043 Identity of occupants
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 2540/26 Incapacity
• CPC Class Codes: B60W 30/12 Lane keeping

Abstract

Devices, methods and systems are disclosed herein to describe a lane departure warning system that warns the driver that the vehicle is about to leave a current lane and enter an adjacent lane. The driver of the vehicle is identified, and a corresponding profile is accessed. The driver'"'"'s pupils may be measured and compared to pupil size data stored in the accessed profile. If the difference in pupil size exceeds a certain threshold, then the vehicle may activate a passive lane departure detector that warns the driver each time the vehicle is getting too close to an adjacent lane, thus alerting the driver that the vehicle may be unintentionally drifting into the next lane. Additional driving tendencies, such as steering angles and braking force, may also be used to determine whether the driver may benefit from lane departure assistance and whether to trigger activation of the lane departure detector.

Claims

1. A method comprising:

identifying a driver of a vehicle;

determining that a completed profile is available corresponding to the driver;

retrieving the completed profile from a corresponding vehicle memory;

collecting impairment indication data including a size of a pupil of the driver;

comparing impairment indication data to the data corresponding to the retrieved completed profile;

determining, based on the comparison of the impairment indication data to data corresponding to the completed profile, that the driver is to be treated as an impaired driver;

activating a lane departure detector; and

outputting a warning when the vehicle is encroaching an edge of the lane of a road.

2. The method of claim 1 further comprising:

in response to identifying the driver as a new driver, inviting the driver to create a profile;

in response to receiving input that the driver accepts the invitation to create a new profile, creating a driver identification profile;

collect and store data related to the driver'"'"'s pupil; and

collect and store data related to the driver'"'"'s operation of the vehicle.

3. The method of claim 1 further comprising:

in response to identifying the driver as a known driver with an incomplete profile, retrieving existing profile data corresponding to the incomplete profile from the vehicle memory;

determine data needed to complete the incomplete profile; and

collect and store the needed data to complete the incomplete profile.

4. The method of claim 1 further comprising stopping output of the warning when the vehicle moves away from the encroached edge of the lane of the road, and wherein outputting a warning includes one of:

displaying on a vehicle display a message indicating that the vehicle is encroaching an edge of the lane of the road, or playing an audible message indicating that the vehicle is encroaching an edge of the lane of the road.

5. The method of claim 1 wherein activating the lane departure detector further comprises:

identifying a point of reference corresponding to the vehicle;

identifying a point of reference corresponding to a first lane marker;

identifying a point of reference corresponding to a second, adjacent lane maker;

calculating a first distance between the point of reference corresponding to the vehicle and the first lane marker;

calculating a second distance between the point of reference corresponding to the vehicle and the point of reference corresponding to the second, adjacent lane marker; and

determining that the vehicle is encroaching the edge of the lane of a road when one of the first distance and second distance exceeds a threshold.

6. The method of claim 5 wherein identifying a point of reference corresponding to the first lane marker is performed by a camera and wherein identifying a point of reference corresponding to the second, adjacent lane marker is performed by a camera.

7. The method of claim 5 wherein activating the lane departure warning system occurs in response to determining that the driver is to be treated as an impaired driver.

8. The method of claim 1 wherein impairment indication data further comprises braking data and steering data.

9. The method of claim 8 wherein determining that the driver is to be treated as an impaired driver includes at least one of:

determining that the size of the pupil of the driver corresponding to the impairment indication data is different than the size of the pupil of the driver corresponding to the completed profile;

determining that the braking data of the impairment indication data is different than the braking data corresponding to the completed profile; and

determining that the steering data of the impairment indication data is different than the steering data corresponding to the completed profile.

10. The method of claim 9 wherein determining that the driver is to be treated as an impaired driver further comprises determining that the diameter of the pupil of the driver corresponding to the impairment indication data is at least 5% longer or 5% shorter than the diameter of the pupil of the driver corresponding to the completed profile.

11. The method of claim 9 wherein determining that the driver is to be treated as an impaired driver further comprises:

determining that the diameter of the pupil of the driver corresponding to the impairment indication data does not exceed either 5% longer or 5% shorter than the diameter of the pupil of the driver corresponding to the completed profile, and that an average braking force applied to a set of vehicle brakes corresponding to the impairment indication data is at least 5% greater or 5% less than an average braking force corresponding to the completed profile, and that an average steering angle of the vehicle corresponding to the impairment indication data is at least 5% greater or 5% less than an average steering angle of the vehicle corresponding to the completed profile.

12. The method of claim 1 wherein the size of a pupil of the driver corresponding to the completed profile is obtained during a driving session different than the driving session of which the size of the pupil of the driver corresponding to the impairment indication data is collected.

13. The method of claim 12 wherein obtaining the size of the pupil of the driver corresponding to the completed profile and collecting the size of the pupil of the driver corresponding to the impairment indication data is performed in part by a camera located within an interior of the vehicle.

14. A device comprising:

a processor;

a memory coupled to the processor;

an image processing module coupled to the processor and configured to process an image to determine pupil size;

a pupil comparator configured to receive the pupil size of the image and compare the pupil size of the image to a pupil size of a user'"'"'s profile stored in the memory, the pupil comparator further configured to output a result of the pupil size comparison; and

a determination module configured to receive the result of the pupil comparison and determine if the result of the pupil size comparison exceeds a pupil difference threshold,

wherein the processor is configured to trigger activation of a lane departure detector when the result of the pupil size comparison exceeds the pupil difference threshold.

15. The device of claim 14 further comprising:

a steering behavior comparator configured to receive the current steering behavior data and compare the current steering behavior data to a baseline steering behavior data stored in the memory, the steering behavior comparator further configured to output a result of the steering behavior comparison; and

a braking data comparator configured to receive the current braking data and compare the current braking data to a baseline braking data stored in the memory, the braking data comparator further configured to output a result of the braking data comparison;

wherein the determination module is further configured to receive the result of the steering behavior comparison from the steering behavior comparator and the result of the braking data comparison from the braking data comparator, the determination module further configured to determine whether the result of the steering behavior comparison exceeds a steering threshold and whether the result of the braking data comparison exceeds a braking threshold,

wherein the processor is further configured to trigger activation of the lane departure detector when both the result of the steering behavior comparison exceeds the steering threshold and the result of the braking data comparison exceeds the braking threshold.

16. The device of claim 14 further comprising:

a lane marker encroachment module configured to be activated in response to receiving a lane departure detector activation signal from the processor, the lane marker encroachment module configured to determine whether a lane of road that that a vehicle is traveling in based on a pair of lane markers, and to determine when a distance between the vehicle and one of the lane markers is shorter than a encroachment threshold, the lane marker encroachment module further configured to output a warning signal when the distance between the vehicle and one of the lane markers is shorter than a encroachment threshold.

17. A system comprising:

a camera configured to capture an image of a driver'"'"'s pupil;

a sensor configured to determine a distance between a lane marker and a vehicle; and

a vehicle control unit configured to receive an image of the driver'"'"'s pupil and the distance between the lane marker and the vehicle, the vehicle control unit configured to determine if the driver is impaired based at least in part on the image of the driver'"'"'s pupil, the vehicle control unit configured to determine if a vehicle is encroaching on the lane marker based a distance between the lane marker and the vehicle, the vehicle control unit further configured to output a warning signal when the driver is impaired and the vehicle is encroaching on the lane marker.

18. The system of claim 17 further comprising an audio control unit configured to receive the warning signal from the vehicle control unit and output an audio message.

19. The system of claim 17 further comprising a display control unit configured to receive the warning signal from the vehicle control unit and output a visual message.

20. The system of claim 17 wherein the vehicle control unit is further configured to determine if the driver is impaired based on steering behavior and braking data.