System and method for driver pattern recognition, identification, and prediction

• US 10,315,665 B2
• Filed: 01/27/2017
• Issued: 06/11/2019
• Est. Priority Date: 01/29/2016
• Status: Active Grant

• Current Assignee: Faraday & Future Inc.
• Original Assignee: Faraday & Future Inc.
• Inventors: Halder, Bibhrajit
• Primary Examiner(s): Ismail, Mahmoud S
• Application Number:
  US15/418,641
• Publication Number:
  US 20170217446A1
• Time in Patent Office: 865 Days
• Field of Search: 701 25, 701117, 3404261, 705 4
• CPC Class Codes: B60W 10/04 including control of propulsion units
• CPC Class Codes: B60W 10/184 with wheel brakes
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 10/30 including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps
• CPC Class Codes: B60W 2050/0075 Automatic parameter input, automatic initialising or calibrating means
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2420/408 Radar; Laser, e.g. lidar
• CPC Class Codes: B60W 2540/043 Identity of occupants
• CPC Class Codes: B60W 2540/30 Driving style
• CPC Class Codes: B60W 2556/00 Input parameters relating to data
• CPC Class Codes: B60W 2556/10 Historical data
• CPC Class Codes: B60W 2556/50 of positioning data, e.g. GPS [Global Positioning System] data
• CPC Class Codes: B60W 30/18009 related to particular drive situations
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: B60W 50/12 Limiting control by the driver depending on vehicle state, e.g. interlocking means for the control input for preventing unsafe operation
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G05D 1/021 specially adapted to land vehicles

Abstract

Examples of the present invention are directed to a method and system of recognizing a driving pattern of a vehicle. Driver input controlling the vehicle can be received and stored in association with various sensor information (e.g., GPS location, camera data, radar data, etc.) and a timestamp. Then, driving patterns can be recognized from the stored information. For example, preferred routes, destinations, driving speeds, driving styles, etc. can be recognized. The driving patterns can be used by automated driving or driving assistance systems to automatically drive on preferred routes or to preferred destinations.

Claims

1. A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors of a vehicle, cause the vehicle to perform a method of recognizing a driving pattern of the vehicle, the method comprising the steps of:

during a first time period;

determining an identity of a driver of the vehicle by recognizing one or more of first biometric data, a first image of a face, a first key fob, and a first mobile device;

receiving driver input data for controlling the vehicle,

receiving first sensor information, the first sensor information comprising first location information, from one or more sensors of the vehicle;

recognizing a driving pattern based on the identity of the driver, the driver input and the first sensor information;

storing private location information including a location of a private road associated with the identity of the driver; and

during a second time period after the first time period;

determining the identity of the driver of the vehicle by recognizing one or more of second biometric data, a second image of the face, a second key fob, and a second mobile device;

receiving second sensor information, the second sensor information comprising second location information, from the one or more sensors of the vehicle; and

in accordance with the second location information matching the first location information in the driving pattern, triggering an action based on the driver input data received during the first time period, wherein recognizing the driving pattern includes storing the driver input data in association with the identity of the driver and one or both of the first sensor information and a timestamp associated with the first time period, and wherein triggering the action includes supplementing public map information with the private location information including the location of the private road and opening a private garage door associated with the identity of the driver of the vehicle.

2. The non-transitory computer-readable storage medium of claim 1, wherein the action is triggered in accordance with a current time being within a predetermined interval of the timestamp associated with the first time period.

3. The non-transitory computer-readable storage medium of claim 1, wherein triggering the action includes displaying a notification on a display of the vehicle.

4. The non-transitory computer-readable storage medium of claim 3, the method further comprising the steps of:

receiving additional driver input controlling the vehicle during the second time period; and

determining that the additional driver input during the second time period does not match the driver input during the first time period, wherein the action is triggered in accordance with determining that the additional driver input during the second time period does not match the driver input during the first time period.

5. The non-transitory computer-readable storage medium of claim 1, wherein triggering the action includes actuating one or more actuator systems of the vehicle independent of corresponding driver input during the second time period.

6. The non-transitory computer-readable storage medium of claim 5, wherein actuating one or more actuator systems of the vehicle during the second time period corresponds to at least a portion of the driver input during the first time period.

7. The non-transitory computer-readable storage medium of claim 1, wherein triggering the action includes configuring one or more climate or infotainment systems of the vehicle.

8. The non-transitory computer-readable storage medium of claim 1, wherein recognizing the driving pattern includes mapping the location information.

9. The non-transitory computer-readable storage medium of claim 8, wherein mapping the location information includes mapping a preferred route to a destination.

17. The non-transitory computer-readable storage medium of claim 1, wherein triggering the action further includes navigating on the private road.

18. The non-transitory computer-readable storage medium of claim 1, wherein the action is triggered based on the identity of the driver of the vehicle.

10. A vehicle, comprising:

one or more processors;

a memory storing instructions, which, when executed by the one or more processors, cause the vehicle to perform a method of recognizing a driving pattern of the vehicle, the method comprising the steps of;

during a first time period;

determining an identity of a driver of the vehicle by recognizing one or more of first biometric data, a first image of a face, a first key fob, and a first mobile device;

receiving driver input data for controlling the vehicle;

receiving first sensor information, the first sensor information comprising first location information, from one or more sensors of the vehicle;

recognizing a driving pattern based on the identity of the driver, the driver input and the first sensor information;

storing private location information including a location of a private road associated with the identity of the driver; and

during a second time period after the first time period;

determining an identity of a driver of the vehicle by recognizing one or more of second biometric data, a second image of the face, a second key fob, and a second mobile device;

receiving second sensor information, the second sensor information comprising second location information, from the one or more sensors of the vehicle; and

in accordance with the second location information matching the first location information in the driving pattern, triggering an action based on the driver input data received during the first time period, wherein recognizing the driving pattern includes storing the driver input data in association with the identity of the driver and one or both of the first sensor information and a timestamp associated with the first time period, and wherein triggering the action includes supplementing public map information with the private location information including the location of the private road and opening a private garage door associated with the identity of the driver of the vehicle.

11. The vehicle of claim 10, wherein the action is triggered in accordance with a current time being within a predetermined interval of the timestamp associated with the first time period.

12. The vehicle of claim 10, wherein triggering the action includes displaying a notification on a display of the vehicle.

13. The vehicle of claim 12, the method further comprising the steps of:

receiving additional driver input controlling the vehicle during the second time period; and

determining that the additional driver input during the second time period does not match the driver input during the first time period, wherein the action is triggered in accordance with determining that the additional driver input during the second time period does not match the driver input during the first time period.

14. The vehicle of claim 10, wherein triggering the action includes actuating one or more actuator systems of the vehicle independent of corresponding driver input during the second time period.

15. The vehicle of claim 14, wherein actuating one or more actuator systems of the vehicle during the second time period corresponds to at least a portion of the driver input during the first time period.

16. The vehicle of claim 10, wherein triggering the action includes configuring one or more climate or infotainment systems of the vehicle.