Method to map gaze position to information display in vehicle

• US 9,043,042 B2
• Filed: 07/19/2011
• Issued: 05/26/2015
• Est. Priority Date: 07/19/2011
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Kalhous, Amanda J., Al-Amin, Fuad, Chau, Jarvis, Weigert, Norman J.
• Primary Examiner(s): Kiswanto, Nicholas
• Application Number:
  US13/185,545
• Publication Number:
  US 20130024047A1
• Time in Patent Office: 1,407 Days
• Field of Search: 701/1
• US Class Current: 701/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

A method of controlling a vehicle system of a vehicle is provided. The method includes: receiving image data that is captured from an occupant of the vehicle; determining a focus of the occupant of the vehicle based on the image data; and generating a user command to control the vehicle system based on the focus of the occupant.

Claims

1. A method of controlling a vehicle system of a vehicle, comprising:

receiving, by a computer processor, image data that is captured from an occupant of the vehicle;

determining a focus of the occupant with respect to one of a plurality of vehicle systems of the vehicle, the focus determined from the image data;

visually representing, via a two-dimensional coordinate system, control options corresponding to the one of the plurality of vehicle systems subject to the focus;

mapping functions corresponding to the control options to the two-dimensional coordinate system and a user interface, the functions configured to control operation of the vehicle system subject to the focus through a corresponding vehicle control module that is communicatively coupled to the computer processor over a vehicle network of the vehicle, the vehicle system integrally embedded in the vehicle;

displaying the user interface including the function mapped to the two-dimensional coordinate system via a display device that is integrally embedded in the vehicle, the display device communicatively coupled to the computer processor;

determining a selection of one of the functions by the occupant based on coordinates associated with the focus information; and

generating, via the computer processor, a user command to perform the one of the functions with respect to the vehicle system.

2. The method of claim 1, further comprising analyzing the image data to determine at least one of eye data and face data from the image data.

3. The method of claim 2, wherein determining the focus of the occupant is based on the at least one of eye data and face data.

4. The method of claim 1, further comprising generating display data for displaying the user interface associated with the vehicle system.

5. The method of claim 4, further comprising modifying the display data based on the selected one of the functions, and displaying modified display data on the display device.

16. The method of claim 1, wherein the functions are configured to control operation of an entertainment system of the vehicle.

6. A control system for a vehicle, comprising:

a computer processor;

logic executable by the computer processor, the logic configured to;

determine a focus of an occupant with respect to one of a plurality of vehicle systems of the vehicle, the focus determined from image data captured from the occupant using an image processor;

visually represent, via a two-dimensional coordinate system, control options corresponding to the one of the plurality of vehicle systems subject to the focus;

map a-functions corresponding to the control options to the two-dimensional coordinate system and a user interface, the functions configured to control operation of a vehicle system subject to the focus through a corresponding vehicle control module that is communicatively coupled to the computer processor and the vehicle system over a vehicle network of the vehicle, the vehicle system integrally embedded in the vehicle;

display the user interface including the function mapped to the two-dimensional coordinate system via a display device that is integrally embedded in the vehicle, the display device communicatively coupled to the computer processor;

determine a selection of one of the functions by the occupant based on coordinates associated with the focus information; and

generate a user command to perform the one of the functions with respect to the vehicle system.

7. The system of claim 6, wherein the logic is further configured to analyze the image data to determine at least one of eye data and face data from the image data.

8. The system of claim 7, wherein the logic is configured to determine the focus of the occupant based on the at least one of eye data and face data.

9. The system of claim 6, wherein the logic is configured to generate display data for displaying the user interface associated with the vehicle system.

10. The system of claim 6, wherein the logic is configured to modify the display data based on the selected one of the functions, and display modified display data on the display device.

11. The system of claim 6, further comprising the image processor that captures the image data of the occupant.

12. A vehicle, comprising:

an image processor implemented by a computer processor that captures image data of an occupant of the vehicle and determines a focus of the occupant with respect to one of a plurality of vehicle systems of the vehicle from the image data, the computer processor further configured to;

visually represent, via a two-dimensional coordinate system, control options corresponding to the one of the plurality of vehicle systems subject to the focus; and

map a-functions corresponding to the control options to the two-dimensional coordinate system and a user interface, the functions configured to control operation of a vehicle system subject to the focus through a corresponding vehicle control module that is communicatively coupled to the computer process and the vehicle system over a vehicle network of the vehicle; and

display the user interface including the function mapped to the two-dimension coordinate system via a display device that is integrally embedded in the vehicle, the display device communicatively coupled to the computer processor; and

a human machine interface module implemented by the computer processor that processes the image data, determines a selection of one of the functions by the occupant based on coordinates associated with the focus information and generates a user command to perform the one of the functions with respect to the vehicle system;

wherein the vehicle system is implemented by the computer processor and receives the user command that controls the functions of the vehicle system based on the user command.

13. The vehicle of claim 12 wherein the display system displays the user interface in a line of sight of the occupant.

14. The vehicle of claim 13 wherein the human machine interface module processes the image data relative to the user interface.

15. The vehicle of claim 13 wherein the human machine interface module transmits interface data to the display system based on the user command.

17. The vehicle of claim 13, wherein the display system includes a heads up display, and the heads up display presents the user interface on a front windshield of the vehicle.