System and method for controlling an automobile using eye gaze data

• US 9,440,658 B2
• Filed: 05/05/2014
• Issued: 09/13/2016
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Manickaraj, Mark A., Kalhous, Amanda J., Weigert, Norman J.
• Primary Examiner(s): MELTON, TODD M
• Application Number:
  US14/269,902
• Publication Number:
  US 20150314792A1
• Time in Patent Office: 862 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/117 Identification of persons methods or arrangements for recognising patterns, e.g. fingerprints, G06F18/00, G06V40/00; identification of persons by analysing their voice or speech G10L17/00
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60W 50/00 Details of control systems for road vehicle drive control not related to the control of a particular sub-unit , e.g. process diagnostic or vehicle driver interfaces
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system or method capable of using automobile camera system data to generate biometric information for the use in identifying authorized drivers and customizing and controlling automobile components. The system is versatile enough to distinguish between a new or unauthorized person in the automobile and respond accordingly.

Claims

1. A method for automobile customization and control, the method comprising:

obtaining iris image data of a driver;

converting the iris image data into biometric information, wherein the biometric information is the first authorization source;

when it is determined, using the biometric information, that the driver has a driver record in a database, (i) retrieving from the database the driver record including at least one driver preference setting for an automobile component, and (ii) adjusting the automobile component according to the driver preference; and

when it is determined, using the biometric information, that the driver does not have a driver record in the database, determining, using secondary authorization sources whether the driver is authorized to operate the automobile; and

when it is determined, (i) using the biometric information, that the driver does not have a driver record in the database, and (ii) using secondary authorization sources, that the driver is authorized to operate the vehicle,

(a) obtaining a driver identification and at least one driver preference setting, and

(b) generating a driver record including the driver identification, the biometric information, and the driver preference setting.

2. The method of claim 1, wherein secondary authorization sources include at least one of a key fob, a wireless device, a smart phone, a mobile cell phone, a password and a personal identification number.

3. The method of claim 1, further comprising storing the driver record in the driver database.

4. The method of claim 1, wherein the step of obtaining comprises generating visual or aural prompts.

5. The method of claim 1, further comprising:

detecting the amount of light directed at the driver'"'"'s eyes; and

suggesting the use of the visor or sunglasses according to the detected amount of light.

6. The method of claim 1, further comprising authorizing, using the driver identification associated with the biometric information, the download and purchase of applications.

7. The method of claim 1, further comprising:

determining the location of the driver'"'"'s eyes above a hood-line of the automobile; and

adjusting an automobile head-up display in accordance with the location.

8. The method of claim 1, wherein the step of retrieving an associated driver record comprises selecting from among a plurality of associated driver records in reliance on one or more of a GPS location, a light sensor, temperature sensor, and the time of day.

9. The method of claim 1, further comprising:

when it is determined,

(i) using the biometric information, that the driver does not have a driver record in the database, and

(ii) using secondary authorization sources, that the driver is not authorized to operate the vehicle,

preventing the automobile from starting.

10. A system for automobile customization and control, the system comprising:

an automobile camera system configured to locate a driver'"'"'s eyes and generate iris image data;

a database including at least one driver record;

an automobile component; and

a processor coupled to the camera system, automobile component, and the database, and configured to

(1) convert iris image data to biometric information,

(2) determine, using the biometric information, whether the driver has a driver record in a database,

(3) when it is determined that the driver has a driver record in the database, (i) retrieve from the database the driver record including at least one driver preference setting for an automobile component, and (ii) adjust the automobile component according to the driver preference, and

(4) when it is determined using biometric information, that the driver does not have a driver record in the database, determine, using secondary sources, whether the driver is authorized to operate the automobile; and

when it is determined, (i) using the biometric information, that the driver does not have a driver record in the database, and (ii) using secondary authorization sources, that the driver is authorized to operate the vehicle via secondary authorization sources,

(a) obtain a driver identification and at least one driver preference setting, and

(b) generate a driver record including the driver identification, biometric information, and the driver preference setting.

11. The system of claim 10, wherein the processor is further configured to, when it is determined (i) using the biometric information, that the driver does not have a driver record in the database, and (ii) using secondary authorization sources, that the driver is not authorized to operate the vehicle, prevent the automobile from starting.

12. The system of claim 10, wherein the processor is further configured to adjust an automobile head-up display in accordance with a location of the driver'"'"'s eyes.