System and method for controlling a vehicle display based on driver behavior

• US 9,475,389 B1
• Filed: 06/19/2015
• Issued: 10/25/2016
• Est. Priority Date: 06/19/2015
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Fung, Kin C., Dick, Timothy J.
• Primary Examiner(s): EL CHANTI, HUSSEIN A
• Application Number:
  US14/744,247
• Time in Patent Office: 494 Days
• Field of Search: 701/36
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/782 on the steering wheel
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays

Abstract

A computer-implemented method and system for controlling a vehicle display in a vehicle. The method includes receiving contact data from a steering wheel, the contact data indicating driver contact with the steering wheel. The method includes determining a head vector based on information received from a head tracking device, the head vector defining a line originating from a head reference point, the line extending in a direction towards a viewing point. The method includes determining a fixation duration towards the viewing point based on the head vector and the information received from the head tracking device. Further, the method includes controlling the vehicle display based on the contact data, the head vector, and the fixation duration.

Claims

1. A computer-implemented method for controlling a vehicle display in a vehicle, comprising:

receiving contact data from a steering wheel, the contact data indicating driver contact with the steering wheel;

determining a head vector based on information received from a head tracking device, the head vector defining a line originating from a head reference point, the line extending in a direction towards a viewing point;

determining a fixation duration of the head vector towards the viewing point based on the head vector and the information received from the head tracking device, wherein the fixation duration of the head vector is a period of time in which the head vector is directed in the direction towards the viewing point; and

upon determining contact of a right hand on the steering wheel based on the contact data, controlling the vehicle display is based on the head vector, and upon determining contact of a left hand on the steering wheel based on the contact data, controlling the vehicle display is based on the head vector and the fixation duration of the head vector.

2. The computer-implemented method of claim 1, wherein controlling the vehicle display includes enabling the vehicle display upon determining contact of a right hand on the steering wheel and determining the direction of the head vector is directed toward a forward way of the vehicle.

3. The computer-implemented method of claim 1, wherein controlling the vehicle display includes disabling the vehicle display upon determining contact of a left hand on the steering wheel, the direction of the head vector is directed toward the vehicle display, and the fixation duration of the head vector meets a fixation duration threshold based on a comparison of the fixation duration of the head vector to the fixation duration threshold.

4. The computer-implemented method of claim 3, wherein controlling the vehicle display includes enabling the vehicle display after disabling the vehicle display upon determining a second head vector, wherein the direction of the second head vector is directed toward a forward way of the vehicle.

5. The computer-implemented method of claim 1, further including modifying a fixation duration threshold based on detecting a hazard in an area surrounding the vehicle, wherein detecting the hazard is based on information from one or more vehicle systems of the vehicle.

6. The computer-implemented method of claim 5, further including decreasing the fixation duration threshold based on detecting the hazard.

7. The computer-implemented method of claim 5, wherein the hazard is a target vehicle in front of the vehicle and modifying the fixation duration threshold is based on a headway distance between the vehicle and the target vehicle.

8. The computer-implemented method of claim 1, wherein determining the head vector further includes determining a number of head vector sequences based on the head vector and information received from the head tracking device, wherein a head vector sequence is a transition of a driver from a first head vector with a direction of the first head vector directed to a forward way of the vehicle and to a second head vector with a direction of the second head vector directed toward the vehicle display and a fixation duration of the second head vector meets a fixation duration threshold.

9. The computer-implemented method of claim 8, further including comparing the number of head vector sequences to a head vector sequence threshold, and upon determining the number of head vector sequences meets the head vector sequence threshold, controlling the vehicle display to disable use of the vehicle display until an override action is detected.

10. The computer-implemented method of claim 9, wherein the override action includes detecting contact of a left hand and a right hand of the driver with the steering wheel based on the contact data.

11. The computer-implemented method of claim 1, wherein controlling the vehicle display further includes determining a number of vehicle control sequences over a period of time, wherein a vehicle control sequences includes a sequence of enabling the vehicle display and disabling the vehicle display and wherein enabling the vehicle display and disabling the vehicle display is based on the contact data and the head vector, and the fixation duration of the head vector.

12. The computer-implemented method of claim 11, further including comparing the number of vehicle control sequences to a lock out threshold and upon determining number of vehicle control sequences meets the lock out threshold, disabling use of the vehicle display until an override action is detected.

13. A system for controlling a vehicle display in a vehicle, comprising:

a steering wheel including sensors for sensing contact data, the contact data indicating driver contact of a left hand or a right hand with the steering wheel;

a head tracking device for determining a head vector of a driver with respect to the vehicle and the vehicle display, wherein the head vector defines a line originating from a head reference point of the driver, the line extending in a direction towards a viewing point of the driver for a fixation duration of the head vector, wherein the fixation duration of the head vector is a period of time in which the head vector is directed in the direction towards the viewing point; and

a processor operatively connected for computer communication to the vehicle display, the steering wheel and the head tracking device, the processor including a vehicle control display module for controlling the vehicle display based on the head vector and driver contact of the left hand or the right hand with the steering wheel.

14. The system of claim 13, further including the head tracking device determining a number of head vector sequences based on the head vector and information received from the head tracking device, wherein a head vector sequence is a transition of a driver from a first head vector with a direction of the first head vector directed to a forward way of the vehicle and to a second head vector with a direction of the second head vector directed toward the vehicle display, wherein a fixation duration of the second head vector meets a fixation duration threshold.

15. The system of claim 14, wherein the vehicle control display module compares the number of head vector sequences to a head vector sequence threshold, and upon determining the number of head vector sequences meets the head vector sequence threshold, the vehicle control display module disables the vehicle display until an override action is detected.

16. The system of claim 14, further including receiving information from one or more vehicle systems of the vehicle, the information indicating a hazard in an area surrounding the vehicle, wherein the vehicle control display module modifies the fixation duration threshold based on the hazard.

17. A non-transitory computer readable medium comprising instructions that when executed by a processor perform a method for controlling a vehicle display in a vehicle, comprising:

receiving contact data from a steering wheel, the contact data indicating driver contact with the steering wheel;

determining a head vector of a driver based on information received from a head tracking device, the head vector defining a line originating from a head reference point, the line extending in a direction towards a viewing point for a fixation duration of the head vector;

determining a number of head vector sequences based on the head vector and information received from the head tracking device, wherein a head vector sequence is detected as a first head vector of the driver with a direction of the first head vector directed to a forward way of the vehicle followed in sequence by a second head vector of the driver with a direction of the second head vector directed toward the vehicle display and a fixation duration of the second head vector meets a fixation duration threshold; and

executing control of the vehicle display based on at least one of the contact data, the head vector, and the number of head vector sequences.

18. The non-transitory computer readable medium of claim 17, wherein executing control of the vehicle display further includes comparing the number of head vector sequences to a head vector sequence threshold, and upon determining the number of head vector sequences meets the head vector sequence threshold, executing control of the vehicle display to disable use of the vehicle display.

19. The non-transitory computer readable medium of claim 17, wherein executing control of the vehicle display further includes comparing the fixation duration of the head vector to a predetermined head vector duration threshold and executing control of the vehicle display to disable use of the vehicle display upon determining contact of the left hand on the steering wheel, determining the direction of the head vector of the driver is directed toward the vehicle display, and determining the fixation duration of the head vector of the driver meets the fixation duration threshold based on the comparison.