Vehicle security systems and methods employing facial recognition using a reflected image

• US 6,831,993 B2
• Filed: 03/08/2002
• Issued: 12/14/2004
• Est. Priority Date: 05/15/1996
• Status: Expired due to Fees

• Current Assignee: Jerome H. Lemelson, Louis J. Hofffman
• Original Assignee: Jerome H. Lemelson, Louis J. Hofffman
• Inventors: Lemelson, Jerome H., Hoffman, Louis J.
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): Dang, Duy M.
• Application Number:
  US10/094,360
• Publication Number:
  US 20030142849A1
• Time in Patent Office: 1,012 Days
• Field of Search: 382/118, 382/100, 382/104, 382/115, 382/117, 382/124, 340/426.1, 340/426.24, 340/426.31, 340/5.53, 340/5.83, 307/10.2, 307/10.3, 307/10.6
• US Class Current: 382/118
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60R 25/252 Fingerprint recognition
• CPC Class Codes: B60R 25/255 Eye recognition
• CPC Class Codes: B60R 25/257 Voice recognition
• CPC Class Codes: B60R 25/305 using a camera
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

A movable-vehicle security system includes a facial-recognition system including a scanner such as a television or infrared camera directed at the face of a person in the driver'"'"'s seat, which system produces output control signals that are applied to enable or disable operation of the vehicle, with or without a key or other supplemental security system. In a particular embodiment, the system includes a camera mounted on the “third taillight” assembly (which is preferably mounted below the roof and inside the rear window), directed at the rear-view mirror, and coupled to a facial-recognition computer, which in turn is coupled (with appropriate security precautions) to an enabling element for the vehicle, such as a starter motor. In a further embodiment, the system can be coupled to various elements of the motive system to create an auto-starting car.

Claims

1. A security system for a movable vehicle provided with an enabling system, the security system comprising:

(a) an electronic camera structured to produce image signals and having its scanning axis directed at a rear-view mirror of the vehicle;

(b) wherein the camera is positioned to scan at least a portion of the face of a person located at the driver'"'"'s station of the vehicle;

(c) an electronic facial-recognition system supported by the moveable vehicle, coupled to the camera, responsive to the image signals, and controllably coupled to the enabling system; and

(d) an electronic storage device supported by the moveable vehicle and coupled to the facial-recognition system to store a set of image signals, such that the facial-recognition system activates the enabling system only if signals representative of select characteristics of the scanned face of the person derived from the image signals produced on the camera'"'"'s output match a member of a set of signals stored in the electronic storage device, each member representative of select characteristics of the scanned face of an authorized operator.

2. The system of claim 1 wherein the camera is an infrared scanner.

3. The system of claim 2 further comprising another electronic camera that is a reflective-light scanner sensitive to visible light, wherein both cameras are positioned to scan at least a portion of the face of the seated person and are coupled to the facial-recognition system.

4. The system of claim 1 wherein the portion of the face scanned by the camera includes an iris of an eye of the person at the driver'"'"'s station, and wherein the electronic facial-recognition system is structured to recognize characteristics of features within the iris.

5. The system of claim 1 wherein the camera includes an autofocus lens control.

6. The system of claim 1 wherein the camera is mounted along the vertical center plane of the vehicle and adjacent to the rear window, and wherein the scanning axis of the camera is directed along the center plane and at a rear-view mirror of the vehicle.

7. The system of claim 6 wherein the portion of the face scanned by the camera includes an iris of an eye of the person at the driver'"'"'s station, and wherein the electronic facial-recognition system is structured to recognize characteristics of features within the iris.

8. The system of claim 1 wherein the camera is structured to automatically become deactivated upon expiration of a predetermined period of time after it is first activated or upon recognition of an authorized driver by the facial-recognition system, whichever occurs first.

9. The system of claim 1 wherein the camera is responsive to closure of an ignition key switch of the vehicle to become activated when the key switch is closed.

10. The system of claim 1 wherein the camera is responsive to activation of a sensor switch to become activated when a person sits at the driver'"'"'s station of the vehicle.

11. The system of claim 10 wherein the sensor switch is an in-seat sensor.

12. The system of claim 11 wherein the camera is structured to become deactivated upon opening of the sensor switch.

13. The system of claim 1 wherein the electronic storage device contains a personal code associated with each authorized operator, and wherein the facial-recognition system is further coupled to an electronic control of the vehicle so as to alter a personal setting automatically based on the code associated with the operator recognized by the facial-recognition system, said electronic control structured to control an operating setting of at least one of the following elements of the vehicle:

(a) an audio system;

(b) an electronic seat;

(c) a window;

(d) a temperature controller;

(e) a mirror; and

(f) the angle of the steering wheel column relative to the dashboard.

14. The system of claim 1 wherein the facial-recognition system is structured to trigger an audible alarm upon failure of the facial-recognition system to effect said match after a predetermined time.

15. The system of claim 1 wherein the facial-recognition system is structured to transmit alarm signals to a remote location upon failure of the facial-recognition system to effect said match after a predetermined time.

16. The system of claim 1 wherein the facial-recognition system is structured to retain in non-volatile storage information derived from the signals on the camera output upon failure of the facial-recognition system to effect said match after a predetermined time.

17. The system of claim 16 wherein the facial-recognition system is structured to activate a signal light upon failure of the facial-recognition system to effect said match after a predetermined time.

18. The system of claim 1 wherein the facial-recognition system is further coupled to a key-operated switch that, when activated, stores in the electronic storage device, as representative of a member of the set of authorized operators, selected signals representative of select characteristics of the scanned face of a person located at the driver'"'"'s station of the vehicle and derived from the signals on the camera output.

19. The system of claim 18 wherein the key-operated switch is structured to become activated by a coded sequence of turns.

20. The system of claim 19 wherein the facial-recognition system is structured to become disabled for a predetermined period of time upon activation of the key-operated switch.

21. The system of claim 1 wherein:

(a) the facial-recognition system provides an authorization control signal upon determining said match; and

(b) the authorization control signal activates an engine capable of powering and moving the vehicle, the engine being coupled to become activated in response to the authorization control signal only.

22. The system of claim 1 wherein:

(a) the facial-recognition system provides an authorization control signal upon determining said match; and

(b) the engine and the gearshift are coupled to cause the engine to become activated in response to the combination of the authorization control signal and a selected gear-shifting action by the person located at the driver'"'"'s station.

23. The system of claim 1 wherein:

(a) the facial-recognition system provides an authorization control signal upon determining said match; and

(b) the engine and the transmission are coupled to cause the engine to turn off in response to a selected gear-shifting action by the person located at the driver'"'"'s station.

24. The system of claim 1 wherein:

(a) the facial-recognition system provides an authorization control signal upon determining said match;

(b) the system further comprises a second personal-identification system; and

(c) the authorization control signal is produced only in response to identification of an authorized operator by both the facial-recognition system and the second personal-identification system.

25. The system of claim 24 wherein the second personal-identification system includes a fingerprint reader.

26. A movable vehicle comprising and supporting:

(a) a rear-view mirror;

(b) an electronic camera having an output for picture signals, which camera is positioned to be directed at the rear-view mirror;

(c) a facial-recognition system coupled to the output of the camera;

(d) an electronic storage device coupled to the facial-recognition system;

(e) wherein the facial-recognition system issues an authorization control signal only if picture signals representative of select characteristics of a face in the rear-view mirror acquired by the electronic camera match a member of a set of signals stored in said electronic storage device, each member of the stored set representative of select characteristics of the face of an authorized operator;

(f) an enabling system structured to enable operation of the vehicle; and

(g) a control unit coupled to the enabling system and the facial-recognition system to activate the enabling system only if the facial-recognition system has issued an authorization control signal.

27. The vehicle of claim 26 where in the control unit is integrally coupled to the enabling system.

28. The vehicle of claim 26 wherein the electronic camera is suspended from a roof of the vehicle.

29. The vehicle of claim 26 further comprising a brake pedal coupled to the camera.

30. The vehicle of claim 29 further comprising a driver'"'"'s seat sensor coupled to the camera.

31. The vehicle of claim 30 further comprising a sound generator coupled to the control unit.

32. The vehicle of claim 26 further comprising an audible alarm device coupled to the control unit.

33. The vehicle of claim 26 further comprising a key-operated switch coupled to the facial-recognition system to cause a set of signals to be stored in the electronic storage device representative of picture signals on the output of the camera when the key-operated switch is turned.

34. The vehicle of claim 26 further comprising a shift lever and a transmission device coupled to the shift lever, wherein the shift lever is also coupled to the control unit.

35. A method for maintaining security of a powered vehicle, the method comprising:

(a) producing image signals by electronically scanning at least a portion of the face of a person at an operator'"'"'s station, which face portion is reflected in a mirror supported by the powered vehicle;

(b) computer analyzing the image signals and generating code signals representative of a set of predefined facial characteristics;

(c) comparing the code signals with a set of previously stored reference signals representative of the predefined facial characteristics of an authorized operator; and

(d) generating signals enabling operation of the powered vehicle if and only if the code signals electronically match one of the reference signals.

36. The method of claim 35 wherein the scanning is with respect to infrared radiant emissions from the face of the person.

37. The method of claim 36 further comprising scanning further with respect to visible from the face of the person.

38. The method of claim 35 wherein scanning is electro-optical.

39. The method of claim 35 further comprising initiating scanning by determining that the person has pressed a brake pedal of the vehicle.

40. The method of claim 35 further comprising automatically repeating acts (a) through (d) until the earlier of (i) expiration of a predetermined length of time and (ii) generation of the enabling signals.

41. The method of claim 35 further comprising electronically detecting when a person is located at the operator'"'"'s station and effecting such scanning only when a person is so detected.

42. The method of claim 41 further comprising the preliminary act of activating a key-operated switch in the powered vehicle coupled to the facial-recognition system to store the reference signals.

43. The method of claim 35 wherein the scanning includes an iris of an eye of the person.

44. The method of claim 35 wherein the vehicle is an automobile and the scanning is performed with respect to the reflections in a rear-view mirror mounted along the centerline of the automobile near the front of a passenger cabin thereof.

45. The method of claim 35 further comprising initiating scanning by determining that an ignition key switch of the vehicle has been closed.

46. The method of claim 35 further comprising:

(a) if the code signals electronically match one of the reference signals, generating an identification code corresponding to the identity of the recognized person; and

(b) automatically altering a personal setting based on the identification code.

47. The method of claim 46 wherein automatically altering a personal setting comprises adjusting an electronic seat to predetermined settings corresponding to the identification code.

48. The method of claim 46 wherein automatically altering a personal setting comprises adjusting an audio system to predetermined settings corresponding to the identification code.

49. The method of claim 35 further comprising triggering an audible alarm if the code signals fail to match any of the reference signals within a predetermined time.

50. The method of claim 35 further comprising transmitting alarm signals to a remote location if the code signals fail to match any of the reference signals within a predetermined time.

51. The method of claim 35 further comprising retaining in non-volatile storage supported by the vehicle information derived from the image signals if the code signals fail to match any of the reference signals within a predetermined time.

52. The method of claim 51 further comprising activating a signal light adjacent to the storage if the code signals fail to match any of the reference signals within a predetermined time.

53. The method of claim 35 wherein the signals enable operation of the powered vehicle by activating an engine powering the vehicle, and wherein the engine can become activated only in response to the signals enabling operation.

54. The method of claim 35 wherein the signals enable operation of the powered vehicle by activating an engine powering the vehicle, and wherein the engine can become activated only in response to the combination of the signals enabling operation and a selected gear-shifting action.

55. A method of retrofitting a moveable vehicle with a security system, which vehicle has a passenger cabin and an engine compartment, a rear-view mirror mounted along the centerline of the vehicle at the front of the passenger cabin, a brake pedal in the passenger cabin, and an enabling device supported in the engine compartment and structured to enable motive force to the vehicle, comprising:

(a) mounting an assembly to the vehicle, which assembly supports at least the following elements;

i) an electronic camera having an output for picture signals;

ii) a facial-recognition system coupled to the output of the camera; and

iii) an electronic storage device coupled to the facial-recognition system;

(b) positioning the assembly so that the camera is directed at the rear-view mirror;

(c) wherein the facial-recognition system issues an authorization control signal only if picture signals representative of select characteristics of a face in the rear-view mirror acquired by the electronic camera match a member of a set of signals stored in said electronic storage device, each member of the stored set representative of select characteristics of the face of an authorized operator; and

(d) coupling a control unit to the enabling device, which control unit activates the enabling system only upon receipt of the authorization control signal from the facial-recognition system.

56. The method of retrofitting of claim 55 wherein the assembly further comprises a rear-directed taillight and mounting the assembly further comprises coupling the assembly to a location adjacent to the rear of the passenger cabin along the centerline of the vehicle;

and further comprising coupling the light and the camera of the assembly to a line carrying a control signal that is generated upon operation of the brake pedal.

57. The method of retrofitting of claim 55 further comprising replacing the enabling device with an integral unit containing both the control unit and the enabling device.

58. The method of retrofitting of claim 55 wherein such mounting comprises suspending the assembly from a roof supported above the passenger cabin.

59. The method of retrofitting of claim 55 further comprising coupling the camera of the assembly to a line carrying a control signal that is generated by the presence of a person in the driver'"'"'s seat of the passenger cabin.

60. The method of retrofitting of claim 55 further comprising coupling the control unit to a sound generator in the passenger cabin, which control unit further activates the sound generator in a select fashion upon receipt of the authorization control signal.

61. The method of retrofitting of claim 55 further comprising coupling the facial recognition system to at least one adjustable component of the vehicle.