Lane change prediction and turn signal activation upon observation of head and eye movement

• US 9,616,809 B1
• Filed: 08/01/2016
• Issued: 04/11/2017
• Est. Priority Date: 08/01/2016
• Status: Expired due to Fees

• Current Assignee: DENSO Corporation, Denso International America Incorporated (DENSO Corporation)
• Original Assignee: DENSO Corporation, Denso International America Incorporated (DENSO Corporation)
• Inventors: Alasry, Bilal
• Primary Examiner(s): Swarthout, Brent
• Application Number:
  US15/224,949
• Time in Patent Office: 253 Days
• Field of Search: None
• CPC Class Codes: B60Q 1/346 with automatic actuation
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

A system and method are provided that include a driver status monitor having at least one of an infrared sensor and a camera configured to sense facial feature data associated with an operator of a subject vehicle and an electronic control module that receives the facial feature data and determines that the operator has looked at one of a side mirror and a rear-view mirror and that the operator has looked at a blind spot of the subject vehicle within a predetermined time period. A controller in communication with the driver status monitor activates a turn signal system having at least one turn signal in response to the driver status monitor determining that the operator has looked at one of the side mirror, rear-view mirror, and the blind spot of the subject vehicle.

Claims

1. A system comprising:

a driver status monitor having at least one of an infrared sensor and a camera configured to sense facial feature data associated with an operator of a subject vehicle and an electronic control module that receives the facial feature data and determines that the operator has looked at one of a side mirror and a rear-view mirror and that the operator has looked at a blind spot of the subject vehicle within a predetermined time period;

a turn signal system having at least one turn signal; and

a controller in communication with the driver status monitor that activates the turn signal system in response to the driver status monitor determining that the operator has looked at one of the side mirror and the rear-view mirror and that the operator has looked at the blind spot of the subject vehicle within the predetermined time period.

2. The system of claim 1 further including a blind spot warning system in communication with the controller, the blind spot warning system configured to detect a presence of a secondary vehicle in the blind spot of the subject vehicle and generate an alert indicating the presence of the secondary vehicle in the blind spot of the subject vehicle.

3. The system of claim 2, wherein the alert includes at least one of a visual alert, an audio alert, and a haptic alert.

4. The system of claim 2, wherein the controller is configured to take corrective action in response to the blind spot warning system detecting the presence of the secondary vehicle in the blind spot of the subject vehicle.

5. The system of claim 1, wherein the facial feature data includes at least one of a face angle, an eye position, and a head position.

6. The system of claim 1, wherein the facial feature data includes at least one of an operator'"'"'s ear position, eyebrow position, nose position, mouth position, and jawline position.

7. The system of claim 1, wherein the driver status monitor, in response to receiving the facial feature data corresponding to the operator looking at the rear-view mirror, is configured to determine that the operator is looking at the rear-view mirror when at least one of a head position and an eye position changes from a first position to a second position at one of a threshold head speed and a threshold eye speed.

8. The system of claim 1, wherein the driver status monitor, in response to receiving the facial feature data corresponding to the operator looking at the side mirror, is configured to determine that the operator is looking at the side mirror when at least one of a head and an eye position changes from a first position to a second position at one of a threshold head speed and a threshold eye speed.

9. A method comprising:

sensing, using a driver status monitor, facial feature data associated with an operator of a subject vehicle;

receiving, using an electronic control module of the driver status monitor, the facial feature data associated with the operator of the subject vehicle;

determining, using the electronic control module of the driver status monitor, whether the operator has looked at one of a side mirror and a rear-view mirror within a predetermined time period;

determining, using the electronic control module of the driver status monitor, whether the operator has looked at a blind spot of the subject vehicle within the predetermined time period;

communicating, using the electronic control module of the driver status monitor, a signal to a controller in response to the electronic control module determining that the operator has looked at one of the side mirror and the rear-view mirror and the operator has looked at the blind spot of the subject vehicle within the predetermined time period; and

activating, with the controller, a turn signal system in response to receiving the signal from the electronic control module of the driver status monitor.

10. The method of claim 9, wherein the method further includes detecting, using a blind spot warning system, a presence of a secondary vehicle in the blind spot of the subject vehicle and generating, with the blind spot warning system, an alert indicating the presence of the secondary vehicle in the blind spot of the subject vehicle.

11. The method of claim 10, wherein the alert includes at least one of a visual alert, an audio alert, and a haptic alert.

12. The method of claim 9, wherein the method includes determining, using the electronic control module of the driver status monitor, that the operator is looking at the side mirror when at least one of a head and an eye position of the operator changes from a first position to a second position at one of a threshold head speed and a threshold eye speed.

13. The method of claim 9, wherein the method includes determining, using the electronic control module of the driver status monitor, that the operator is looking at the rear-view mirror when at least one of a head position and an eye position of the operator changes from a first position to a second position at one of a threshold head speed and a threshold eye speed.