Automatic access to an automobile via biometrics

• US 6,498,970 B2
• Filed: 04/17/2001
• Issued: 12/24/2002
• Est. Priority Date: 04/17/2001
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Trajkovic, Miroslav, Gutta, Srinivas, Colmenarez, Antonio
• Primary Examiner(s): Nguyen, Tan Q.
• Assistant Examiner(s): Tran, Dalena
• Application Number:
  US09/836,680
• Publication Number:
  US 20020152010A1
• Time in Patent Office: 616 Days
• Field of Search: 701/36, 704/273, 704/246, 704/270, 704/274, 704/275, 704/231, 382/116, 382/118, 340/426, 340/5.54, 340/5.8, 340/5.84, 340/5.52, 340/5.53, 340/5.72, 307/10.2, 180/287, 180/289
• US Class Current: 701/36
• CPC Class Codes: B60R 25/2045 by hand gestures
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60R 25/257 Voice recognition
• CPC Class Codes: E05F 15/00 Power-operated mechanisms for wings motor-operated accessories in locks for completing closing or initiating opening of a wing E05B17/00
• CPC Class Codes: E05F 2015/767 using cameras
• CPC Class Codes: E05Y 2400/816 Voice
• CPC Class Codes: E05Y 2400/85 User input means
• CPC Class Codes: E05Y 2400/852 Sensors
• CPC Class Codes: E05Y 2400/86 by hand
• CPC Class Codes: E05Y 2800/00 Details, accessories and auxiliary operations not otherwise provided for
• CPC Class Codes: E05Y 2800/106 Lighting
• CPC Class Codes: E05Y 2800/426 against unauthorised use, e.g. keys
• CPC Class Codes: E05Y 2900/55 Windows
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G07C 9/00563 using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns

Abstract

A system and method for identifying persons who are authorized to activate one or more vehicle mechanisms uses both an implicit identification of a face and an explicit identification of speech or a gesture. This system and method enables identification to be performed where a single identification is otherwise unable to perform the identification for some reason and improves the reliability and accuracy of an identification so that only authorized persons can activate the vehicle mechanisms. Vehicle mechanisms that can be activated using this multimodal identification system and method include, for example, automatic locks, automatic windows, a trunk lock, a vehicle engine, outdoor or interior lights, and a vehicle alarm.

Claims

1. A method for activating a vehicle mechanism, the method comprising:

capturing with a detector a first indication comprising one of a facial feature of a person, an utterance by the person, and an action performed by the person;

comparing at least one of the captured facial feature and the captured at least one of utterance and action to a database comprising at least one of facial features, utterances, and actions that are predefined by people who are authorized to activate a vehicle mechanism in order to determine whether the person is authorized to activate a vehicle mechanism;

if the person is authorized to activate a vehicle mechanism, capturing a second indication comprising one of an utterance by the authorized person and an action by the authorized person for specifying the vehicle mechanism to be activated; and

activating the specified vehicle mechanism.

2. The method of claim 1, wherein the detector comprises at least one of a camera and a microphone mounted to a vehicle, wherein the first indication comprises at least one of a facial feature captured in a field of view of a camera, a hand gesture captured in the field of view of the camera, and a voice command uttered by the person and captured by the microphone.

3. The method of claim 1, wherein the database comprises at least two of the facial features, utterances, and actions of the people who are authorized to activate the vehicle mechanism, wherein at least two of the facial features, utterances, and actions of the person are captured and compared to the database to determine whether the person is authorized to activate the vehicle mechanism.

4. The method of claim 1, wherein an utterance captured for specifying the vehicle mechanism to be activated is further used to corroborate the determination that the person is authorized to activate a vehicle mechanism.

5. The method of claim 4, wherein the corroboration is accomplished by at least lipreading techniques.

6. The method of claim 1, further comprising compiling the information for the database from the people who are authorized to activate the vehicle mechanism.

7. The method of claim 1, wherein the vehicle mechanism to be activated comprises at least one of the group of vehicle mechanisms consisting of a vehicle lock that can be moved between an open position and a closed position, an engine that can be set to an “

on” and

an “

off”

condition, vehicle lights that can be adjusted to an “

on”

condition and an “

off”

condition, and a vehicle alarm that can be activated and deactivated.

8. The method of claim 1, wherein the vehicle mechanism comprises an electronically operated door that can be opened and closed electronically, and wherein the step of activating the vehicle mechanism comprises causing the vehicle door to move between a closed position and an opened position electronically.

9. The method of claim 1, wherein the step of capturing a first indication is commenced upon activation of a switch.

10. The method of claim 1, wherein said step of capturing the second indication comprises capturing an utterance by an authorized person.

11. The method of claim 1, wherein said step of capturing the second indication comprises capturing an action by an authorized person.

12. An activation system for activating a vehicle mechanism, comprising:

a vehicle mechanism on a vehicle;

a detector mounted to the vehicle for capturing a first indication comprising at least one of a facial feature of the person, an utterance by the person, and an action performed by the person;

a database comprising at least one of facial features, utterances, and actions that are predefined by people who arc authorized to activate a vehicle mechanism;

means for comparing the captured at least one of the attribute, speech, and action to be performed to attributes, speech, and actions stored in the database;

means for determining a vehicle mechanism to be activated from a second indication comprising a captured utterance or action by the person only if it is determined that the person is authorized to activate the vehicle by said means for comparing; and

means for activating the determined vehicle mechanism only if it is determined that the person is authorized to activate the vehicle mechanism.

13. The activation system of claim 12, wherein the vehicle mechanism to be activated comprises at least one of the group of vehicle mechanisms consisting of a vehicle lock that can be moved between an open position and a closed position, a motor that can be adjusted to an “

on”

position and an “

off”

position, vehicle lights that can be adjusted to an “

on”

position and an “

off”

position, and a vehicle alarm that can be activated and deactivated.

14. The activation system of claim 12, wherein the vehicle mechanism to be activated comprises an electronically operated door on the vehicle that can be opened and closed electronically.

15. The activation system of claim 12, wherein the at least one detector comprises at least one of a camera and a microphone mounted to the vehicle, wherein the first indication comprises at least one of a facial feature captured in a field of view of a camera, a hand gesture captured in the field of view of the camera, and a voice command uttered by the person and captured by the microphone.

16. The activation system of claim 12, wherein the database comprises at least two of the facial features, utterances, and actions of the people who are authorized to activate the vehicle mechanism, wherein at least two of the facial features, utterances, and actions of the person are captured and compared to the facial features, utterances, and actions stored in the database to determine whether the person is authorized to activate the vehicle mechanism, and wherein the vehicle mechanism is activated only if the captured at least two of facial features, utterances, and actions of the person match at least two of the attributes, speech, and actions predefined as belonging to one of the people authorized to activate the vehicle mechanism.

17. The activation system of claim 12, wherein the second indication comprises an utterance captured for determining a vehicle mechanism to be activated and is further used to corroborate the determination that the person authorized to activate the vehicle mechanism.

18. The activation system of claim 17, wherein the corroboration is by at least lipreading techniques.

19. The activation system of claim 12, further comprising at least one additional camera, and a switch to poll the cameras until the captured at least one of a facial feature, utterance, and action is detected at a particular one of the cameras.

20. The activation system of claim 12, wherein the at least one detector comprises a plurality of microphones mounted to the vehicle for detecting the speech, and a switch to poll the plurality of microphones until an utterance is detected at a particular one of the plurality of microphones.

21. The activation system of claim 12, further comprising a switch which, when activated, commences the capturing of the at least one of a facial feature of the person, an utterance of the person, and an action performed by the person.

22. The activation system of claim 12, wherein said second indication comprises an utterance by the authorized person.

23. The activation system of claim 12, wherein said second indication comprises an utterance by the authorized person.