Gaze driven interaction for a vehicle

• US 9,580,081 B2
• Filed: 01/26/2015
• Issued: 02/28/2017
• Est. Priority Date: 01/24/2014
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: George-Svahn, Erland, Lannsj, Rebecka, Skog, Mrten
• Primary Examiner(s): WONG, YUEN H
• Application Number:
  US14/605,677
• Publication Number:
  US 20150210292A1
• Time in Patent Office: 764 Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/122 Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2370/122 with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2370/149 Input by detecting viewing direction
• CPC Class Codes: B60K 2370/194 by directing line of sight
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60K 26/02 of initiating means or elements
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/285 for improving awareness by directing driver's gaze direction or eye points
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

According to the invention, a method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver is disclosed. The method may include receiving gaze data indicative of the gaze direction of a driver of a vehicle. The method may also include modifying operation of at least one system of the vehicle based at least in part on the gaze data.

Claims

1. A system for modifying operation of at least one vehicular system of a vehicle based at least in part on a gaze direction of a driver of the vehicle, wherein the system comprises:

an eye tracking device for receiving gaze data indicative of the gaze direction of the driver of the vehicle; and

a processor configured to;

determine, based on the gaze data, biometric characteristics of the driver, wherein the biometric characteristics of the driver includes a distance between eyes and iris size;

determine whether the gaze direction of the driver is directed to an instrument panel of the vehicle;

illuminate the instrument panel at a first level of illumination when the gaze direction of the driver is determined to be directed to the instrument panel of the vehicle;

illuminate the instrument panel at a second level of illumination when then the gaze direction of the driver is determined to not be directed at the instrument panel, wherein the first level is greater than the second level;

determine a command has been received when the gaze direction of the driver is determined to be located away from a displayed item of the instrument panel, but at least within a threshold distance from the displayed item of the instrument panel;

modify the operation of the at least one vehicular system of the vehicle based at least in part on the command being received and the biometric characteristics of the driver.

2. The system of claim 1, wherein:

the processor is further for receiving video data from an interior of the vehicle and correlating the gaze direction with information in the video data; and

modifying the operation of the at least one vehicular system of the vehicle is further based at least in part on the information in the video data.

3. The system of claim 1, wherein:

the processor is further for receiving video data from an exterior of the vehicle and correlating the gaze direction with information in the video data; and

modifying the operation of the at least one vehicular system of the vehicle is further based at least in part on the information in the video data.

4. The system of claim 1, wherein the displayed item of the instrument panel comprises:

an icon displayed by a control system display.