Gaze driven interaction for a vehicle

• US 9,817,474 B2
• Filed: 01/26/2015
• Issued: 11/14/2017
• Est. Priority Date: 01/24/2014
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: George-Svahn, Erland, Lannsj, Rebecka, Skog, Mrten
• Primary Examiner(s): Pervan, Michael
• Application Number:
  US14/605,647
• Publication Number:
  US 20150234459A1
• Time in Patent Office: 1,023 Days
• Field of Search: 345102, 345156-158, 349 61- 69, 362 971- 974, 701 1- 344, 715863
• CPC Class Codes: B60K 2360/122 Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 26/02 of initiating means or elements
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/285 for improving awareness by directing driver's gaze direction or eye points
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

According to the invention, a method for changing information on a display in a vehicle based on a gaze direction of a driver is disclosed. The method may include displaying information on the display in the vehicle. The method may also include receiving gaze data indicative of the gaze direction of a user. The method may further include changing the display based at least in part on the gaze data.

Claims

1. A method for changing information on a display in a vehicle based on a gaze direction of a driver, wherein the method comprises:

displaying information on the display in the vehicle;

receiving gaze data indicative of the gaze direction of the driver;

determining a command has been received when the gaze direction of the driver is not located on an item displayed on the display, but is within a threshold distance of the item displayed on the display;

changing operation of a vehicle subsystem associated with the item on the display based at least in part on the command being received;

changing the display based at least in part on the gaze data by changing the shape and/or size of the information on the display when gaze data is received indicative of the driver gazing at, and then gazing away from, the information; and

returning the information on the display to its original shape and/or size when gaze data is received indicative of the driver gazing at the information.

2. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 1, wherein:

changing the display is further based at least in part on receipt of a non-gaze input.

3. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 1, wherein:

the gaze data comprises data indicating the driver has gazed at the information on the display.

4. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 3, wherein:

the gaze data comprises data indicating the driver has gazed at the information on the display for at least a predetermined length of time.

5. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 3, wherein:

the gaze data comprises data indicating the driver has gazed at the information on the display in a particular pattern.

6. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 5, wherein the particular pattern comprises:

a movement of the driver'"'"'s gaze from left to right over the information on the display.

7. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 1, wherein:

changing the display comprises removing the information from the display; and

the method further comprises redisplaying the information on the display in the vehicle after a predetermined length of time has passed since removal of the information from the display.

8. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 7, wherein the method further comprises:

displaying new information related to the information.

9. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 8, wherein:

the new information is displayed immediately after removal of the information from the display.

10. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 8, wherein:

the new information is displayed upon receipt of an input from the driver, and wherein the input comprises a selection from a group consisting of;

gaze data and at least one non-gaze input.

11. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 1, wherein:

the display comprises an instrument panel;

the information comprises a light level of the instrument panel; and

changing the display based at least in part on the gaze data comprises changing the light level of the instrument panel so that it is higher when the driver is gazing at the instrument panel than when the driver is gazing away from the instrument panel.

12. The method for changing information on a display in a vehicle based on a gaze direction of a driver of claim 11, wherein:

the light level of the instrument panel is maintained at a higher level until gaze data is received affirmatively indicative of the driver not gazing at the instrument panel.

13. A non-transitory machine readable medium having instructions stored thereon for changing information on a display in a vehicle based on a gaze direction of a driver, the instructions executable by at least one processor for at least:

displaying information on the display in the vehicle;

receiving gaze data indicative of the gaze direction of the driver;

determining a command has been received when the gaze direction of the driver is not located on an item displayed on the display, but is within a threshold distance of the item displayed on the display;

changing operation of a vehicle subsystem associated with the item on the display based at least in part on the command being received;

changing the display based at least in part on the gaze data by changing the shape and/or size of the information on the display when gaze data is received indicative of the driver gazing at, and then gazing away from, the information; and

returning the information on the display to its original shape and/or size when gaze data is received indicative of the driver gazing at the information.

14. The non-transitory machine readable medium of claim 13, wherein:

the gaze data comprises data indicating the driver has gazed at the information on the display.

15. The non-transitory machine readable medium of claim 13, wherein:

the display comprises an instrument panel;

the information comprises a light level of the instrument panel; and

changing the display based at least in part on the gaze data comprises changing the light level of the instrument panel so that it is higher when the driver is gazing at the instrument panel than when the driver is gazing away from the instrument panel.

16. A system for changing information on a display in a vehicle based on a gaze direction of a driver, wherein the system comprises:

an eye tracking device for receiving gaze data indicative of the gaze direction of the driver; and

a processor for;

determining a command has been received when the gaze direction of the driver is not located on an item displayed on the display, but is within a threshold distance of the item displayed on the display;

causing operation of a vehicle subsystem associated with the item on the display to be changed based at least in part on the command being received;

changing the display based at least in part on the gaze data by changing the shape and/or size of the information on the display when gaze data is received indicative of the driver gazing at, and then gazing away from, the information; and

returning the information on the display to its original shape and/or size when gaze data is received indicative of the driver gazing at the information.

17. The system for changing information on a display in a vehicle based on a gaze direction of a driver of claim 16, wherein:

the display comprises an instrument panel;

the information comprises a light level of the instrument panel; and

changing the display based at least in part on the gaze data comprises changing the light level of the instrument panel so that it is higher when the driver is gazing at the instrument panel than when the driver is gazing away from the instrument panel.