Methods and systems for preventing unauthorized vehicle operation using face recognition

• US 8,880,291 B2
• Filed: 05/17/2012
• Issued: 11/04/2014
• Est. Priority Date: 05/17/2012
• Status: Active Grant

• Current Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Inventors: Hampiholi, Vallabha Vasant
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): PAYNE, ROBERT T
• Application Number:
  US13/473,955
• Publication Number:
  US 20130311001A1
• Time in Patent Office: 901 Days
• Field of Search: 701/1, 701/33.4, 701/22, 701/409, 701/102, 701/49, 701/36, 701/29.3, 701/5, 382/118, 382/104, 382/116, 382/103, 340/5.2, 340/426.31, 340/5.53, 340/426.28, 180/272
• US Class Current: 701/36
• CPC Class Codes: B60R 25/25 using biometry

Abstract

Various embodiments relate to systems and methods for detecting an unauthorized use of a vehicle. One or more facial images of one or more authorized drivers of a vehicle may be stored on a vehicle computing system. After detecting movement of the vehicle, one or more facial images of a driver of the vehicle may be periodically received from at least one in-vehicle camera. The one or more captured facial images of the driver may be periodically processed based on the stored facial images of the one or more authorized drivers to determine if the driver is an authorized driver. If the driver is not an authorized driver based on the periodic determination, vehicle operation may be disabled. If the driver is authorized based on the periodic determination, operation of the vehicle may continue.

Claims

1. A system for detecting an unauthorized use of a vehicle, the system comprising:

a cellular device communicating with a vehicle computing system; and

a vehicle computing system configured to;

store one or more facial images of one or more authorized drivers of a vehicle;

detect movement of the vehicle;

after movement of the vehicle, receive one or more facial images of a driver of the vehicle captured from at least one in-vehicle camera;

process the one or more captured facial images of the driver based on the stored facial images of the one or more authorized drivers to determine if the driver is an authorized driver;

if the driver is not an authorized driver based on the determination, disable continued vehicle operation and transmit over a communications network via the cellular communication device one or more messages of unauthorized use to one or more devices remote from the vehicle computing system; and

if the driver is authorized based on the determination, enable continued operation of the vehicle.

2. The system of claim 1 wherein the period is time based.

3. The system of claim 1 wherein the one or more facial images are received based on one or more triggering events.

4. The system of claim 3 wherein the one or more triggering events include at least one of a change in seat pressure, erratic acceleration, deviating away from regular routes, detection of a border crossing, detection of a car yard on the present route, doors opening and closing while the vehicle is keyed on, the vehicle is in a secure or protected area, or a gear shift.

5. The system of claim 1 wherein the vehicle computing system is configured to determine whether it is safe to disable the vehicle during vehicle movement when the driver is unauthorized.

6. The system of claim 1 wherein the vehicle computing system is configured to transmit the one or more messages to emergency responders at the one or more remote devices via the cellular communication device when the driver is unauthorized.

7. The system of claim 6 wherein the one or more messages include vehicle tracking information.

8. The system of claim 1 wherein the vehicle computing system is on board the vehicle.

9. The system of claim 1 the vehicle computing system configured to process the captured facial images is further configured to:

send instructions to one or more in-vehicle cameras to scan an image field to detect a presence in the vehicle of at least one vehicle occupant other than the driver;

determine a status of the at least one other vehicle occupant as authorized to drive the vehicle if detected based on the scan; and

determine if the driver is authorized or unauthorized based on the status of the at least one other vehicle occupant.

10. The system of claim 9 wherein the driver is a minor.

11. A system for detecting an unauthorized use of a vehicle, the system comprising:

one or more vehicle sensors for detecting one or more non time-based triggering events to trigger a capture of one or more facial images of the driver after a vehicle startup

one or more vehicle cameras which capture one or more facial images of a driver of a vehicle after a vehicle startup and in response to the one or more non time-based triggering events; and

a vehicle computing system in communication with the one or more vehicle cameras and the one or more vehicle sensors configured to;

detect movement of the vehicle;

after movement of the vehicle, receive the one or more facial images of the driver from the one or more vehicle cameras upon detection of the one or more non time-based triggering events;

determine if the driver is an authorized driver based on the one or more received facial images of the driver;

disable continued vehicle operation if the driver is not an authorized driver based on the determination and transmit one or more messages of unauthorized use to one or more devices remote from the vehicle computing system; and

enable continued operation of the vehicle if the driver is authorized based on the determination.

12. The system of claim 11 wherein the one or more vehicle cameras is in the vicinity of the vehicle cabin.

13. The system of claim 12 wherein the one or more vehicle cameras is on a head unit of the vehicle.

14. The system of claim 11 wherein the one or more non time-based trigger events occur while the vehicle is in motion.

15. The system of claim 14 wherein the one or more vehicle cameras are further configured to transmit the one or more facial images of the driver to the vehicle computing system.

16. The system of claim 11 wherein the one or more triggering events include at least one of a change in seat pressure, erratic acceleration, deviating away from regular routes, detection of a border crossing, detection of a car yard on the present route, doors opening and closing while the vehicle is keyed on, the vehicle is in a secure or protected area, or a gear shift.

17. The system of claim 11 further comprising a cellular communication device communicating with the vehicle computing system.

18. The system of claim 17 wherein the vehicle computing system is configured to transmit the one or more messages to one or more vehicle owners or one or more emergency responders at the one or more remote devices over the Internet via the cellular communication device when the driver is unauthorized.

19. A computer-implemented method for detecting an unauthorized use of a vehicle, the computer-implemented method comprising:

storing one or more facial images of one or more authorized drivers of a vehicle;

during a journey in the vehicle,

receiving one or more facial images of a driver of the vehicle from at least one camera in the vehicle;

,

receiving one or more facial images of one or more vehicle passengers to determine if the one or more vehicle passengers have authorization to drive;

processing the one or more facial images of the driver and the one or more passengers based on the stored facial images of the one or more authorized drivers;

determining if the driver is an authorized driver based on the processing of the one or more captured facial images of the driver and the one or more passengers;

if the driver is not an authorized driver based on the determination, disable vehicle operation; and

if the driver is authorized based on the determination, enable continued operation of the vehicle.

20. The computer-implemented method of claim 19 further comprising determining whether it is safe to disable the vehicle during vehicle movement when the driver is unauthorized.

21. The computer-implemented method of claim 19 further comprising communicating with a cellular communication device to transmit one or more messages to one or more remote devices when the driver is unauthorized.

22. The computer-implemented method of claim 19 wherein determining if the driver is authorized includes identifying an association between the driver and the one or more passengers stored in an image database.

23. The computer-implemented method of claim 19 further comprising retrieving profile information of the driver to identify the age of the driver wherein the determining further includes determining if the driver is an authorized driver based on the age of the driver.