GAZE DRIVEN INTERACTION FOR A VEHICLE

• US 20150210292A1
• Filed: 01/26/2015
• Published: 07/30/2015
• Est. Priority Date: 01/24/2014
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: George-Svahn, Erland, Lannsj, Rebecka, Skog, Mrten
• Granted Patent: US 9,580,081 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/122 Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2370/122 with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2370/149 Input by detecting viewing direction
• CPC Class Codes: B60K 2370/194 by directing line of sight
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60K 26/02 of initiating means or elements
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/285 for improving awareness by directing driver's gaze direction or eye points
• CPC Class Codes: B60K 37/06 of controls, e.g. controls knobs
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

According to the invention, a method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver is disclosed. The method may include receiving gaze data indicative of the gaze direction of a driver of a vehicle. The method may also include modifying operation of at least one system of the vehicle based at least in part on the gaze data.

Claims

1. A method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver, wherein the method comprises:

receiving gaze data indicative of the gaze direction of a driver of a vehicle; and

modifying operation of at least one system of the vehicle based at least in part on the gaze data.

2. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the method further comprises receiving video data from the interior of the vehicle and correlating the gaze direction with information in the video data; and

modifying operation of at least one system of the vehicle is further based at least in part on the information in the video data.

3. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the method further comprises receiving video data from the exterior of the vehicle and correlating the gaze direction with information in the video data; and

modifying operation of at least one system of the vehicle is further based at least in part on the information in the video data.

4. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 3, wherein the information in the video data comprises a selection from a group consisting of:

lane markings;

intersecting roadways;

traffic signs;

traffic control devices; and

other vehicles.

5. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 3, wherein:

the information in the video data comprises text; and

modifying operation of at least one system of the vehicle is further based at least in part on the text.

6. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the gaze direction is not a direction out a window of the vehicle.

7. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the gaze direction is a direction out a window of the vehicle.

8. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the gaze data comprises data indicating the driver has gazed in the gaze direction for at least a predetermined length of time.

9. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the gaze data comprises data indicating the driver has gazed in multiple directions in a particular order.

10. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

the gaze data comprises data indicating the driver has not gazed in a particular direction within a predetermined amount of time.

11. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

modifying operation of at least one system of the vehicle comprises activating a safety system.

12. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

modifying operation of at least one system of the vehicle comprises deactivating a safety system.

13. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

modifying operation of at least one system of the vehicle comprises accelerating or decelerating the vehicle.

14. The method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 1, wherein:

modifying operation of at least one system of the vehicle comprises steering the vehicle.

15. A non-transitory machine readable medium having instructions stored thereon for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver, the instructions executable by at least one processor for at least:

receiving gaze data indicative of the gaze direction of a driver of a vehicle; and

modifying operation of at least one system of the vehicle based at least in part on the gaze data.

16. The non-transitory machine readable medium of claim 15, wherein:

the instructions are further executable for at least receiving video data from the interior of the vehicle and correlating the gaze direction with information in the video data; and

modifying operation of at least one system of the vehicle is further based at least in part on the information in the video data.

17. The non-transitory machine readable medium of claim 15, wherein:

the instructions are further executable for at least receiving video data from the exterior of the vehicle and correlating the gaze direction with information in the video data; and

modifying operation of at least one system of the vehicle is further based at least in part on the information in the video data.

18. A system for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver, wherein the system comprises:

an eye tracking device for receiving gaze data indicative of the gaze direction of a driver of a vehicle; and

a processor for modifying operation of at least one system of the vehicle based at least in part on the gaze data.

19. The system for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 18, wherein:

the processor is further for receiving video data from the interior of the vehicle and correlating the gaze direction with information in the video data; and

modifying operation of at least one system of the vehicle is further based at least in part on the information in the video data.

20. The system for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver of claim 18, wherein:

the processor is further for receiving video data from the exterior of the vehicle and correlating the gaze direction with information in the video data; and

modifying operation of at least one system of the vehicle is further based at least in part on the information in the video data.