Method and System for Multi-Modal Identity Recognition

• US 20130246270A1
• Filed: 03/08/2013
• Published: 09/19/2013
• Est. Priority Date: 03/15/2012
• Status: Abandoned Application

• Current Assignee: O2 Micro Incorporated
• Original Assignee: O2 Micro Incorporated
• Inventors: Du, Sterling Shyundii, Zuo, Jingjing, He, Chengxia, Zhu, Qi
• Application Number:
  US13/790,543
• Publication Number:
  US 20130246270A1
• Time in Patent Office: Days
• US Class Current: 705/44
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2117 User registration
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/24 the user being prompted to utter a password or a predefined phrase

Abstract

A device, a system and a method are provided for multi-modal identity recognition. The device includes a face recognition unit, a voice recognition unit, and a control unit. The face recognition unit is configured for generating a first recognition result by obtaining and processing face recognition information of a customer and by comparing the processed face recognition information with face recognition information stored in a facial feature database. The voice recognition unit is configured for generating a second recognition result by obtaining and processing voice recognition information of a customer and by comparing the processed voice recognition information with voice recognition information stored in an audio signature database. The control unit is configured for confirming an identity of the customer based on the first recognition result and the second recognition result.

Claims

1. An identity recognition device, comprising:

a face recognition unit, configured for generating a first recognition result by obtaining and processing face recognition information of a customer and by comparing the processed face recognition information with face recognition information stored in a facial feature database;

a voice recognition unit, configured for generating a second recognition result by obtaining and processing voice recognition information of a customer and by comparing the processed voice recognition information with voice recognition information stored in an audio signature database; and

a control unit, configured for confirming an identity of the customer based on the first recognition result and the second recognition result.

2. The identity recognition device of claim 1, wherein

the processed face recognition information comprises first face recognition information and second face recognition information;

the face recognition unit obtains the first face recognition information and the second face recognition information based on a first facial image from a first capturing device and a second facial image from a second capturing device respectively; and

the second face recognition information and the first face recognition information complement one another.

3. The identity recognition device of claim 2, wherein

the first capturing device is a grayscale camera;

and

the second capturing device is an infrared camera.

4. The identity recognition device of claim 1, further comprising a storage unit coupled to the face recognition unit and the voice recognition unit,

wherein the storage unit comprises the facial feature database and the audio signature database.

5. A payment system comprising an identity recognition device that comprises:

a face recognition unit, configured for generating a first recognition result by obtaining and processing face recognition information of a customer and by comparing the processed face recognition information obtained with face recognition information stored in a facial feature database;

a voice recognition unit, configured for generating a second recognition result by obtaining and processing voice recognition information of a customer and by comparing the processed voice recognition information with voice recognition information stored in an audio signature database; and

a control unit, configured for confirming an identity of the customer based on the first recognition result and the second recognition result, and further configured for associating the confirmed identity of the customer with a stored payment account of the customer to facilitate payment.

6. The payment system of claim 5, further comprising a server configured for storing the payment account of the customer.

7. The payment system of claim 5, wherein

the processed face recognition information comprises first face recognition information and second face recognition information;

the face recognition unit obtains the first face recognition information and the second face recognition information based on a first facial image from a first capturing device and a second facial image from a second capturing device respectively; and

the second face recognition information and the first face recognition information complement one another.

8. The payment system of claim 7, wherein

the first capturing device is a grayscale camera and the first facial image is a grayscale facial image;

and

the second capturing device is an infrared camera and the second facial image is an infrared facial image.

9. The payment system of claim 8, wherein the infrared facial image is utilized to enhance the grayscale facial image.

10. The payment system of claim 5, further comprising a storage unit coupled to the face recognition unit and the voice recognition unit,

wherein the storage unit comprises the facial feature database and the audio signature database.

11. An identity recognition method, comprising:

obtaining face recognition information of a customer;

processing the face recognition information;

comparing the processed face recognition information with face recognition information stored in a facial feature database to generate a first recognition result;

obtaining voice recognition information of the customer;

processing the voice recognition information;

comparing the processed voice recognition information with voice recognition information stored in an audio signature database to generate a second recognition result; and

confirming an identity of the customer based on the first recognition result and the second recognition result.

12. The identity recognition method of claim 11, wherein obtaining face recognition information of the customer comprises:

obtaining first face recognition information based on a first facial image from a first capturing device; and

obtaining second face recognition information based on a second facial image from a second capturing device, wherein the second face recognition information and the first face recognition information complement one another.

13. The identity recognition method of claim 12, wherein

the first capturing device is a grayscale camera, and

the second capturing device is an infrared camera.

14. The identity recognition method of claim 11, wherein the voice recognition information is obtained from a microphone.

15. A payment method comprising:

obtaining face recognition information of a customer;

processing the face recognition information;

comparing the processed face recognition information with face recognition information stored in a facial feature database to generate a first recognition result;

obtaining voice recognition information of the customer;

processing the voice recognition information;

comparing the processed voice recognition information with voice recognition information stored in an audio signature database to generate a second recognition result;

confirming an identity of the customer based on the first recognition result and the second recognition result; and

associating the confirmed identity of the customer with a stored payment account of the customer to facilitate payment.

16. The payment method of claim 15, further comprising the following steps for registering the customer:

obtaining and storing customer information of the customer, wherein the customer information comprises payment account, authorization information, voice recognition information, and face recognition information;

setting up a voice command for the customer;

extracting and storing an audio signature from the voice recognition information of the customer;

extracting and storing a facial feature from the face recognition information of the customer; and

confirming that the customer is registered.

17. The payment method of claim 15, wherein obtaining face recognition information of the customer comprises:

obtaining first face recognition information based on a first facial image from a first capturing device; and

obtaining second face recognition information based on a second facial image from a second capturing device, wherein the second face recognition information and the first face recognition information complement one another.

18. The payment method of claim 17, wherein

the first capturing device is a grayscale camera and the first facial image is a grayscale facial image;

and

the second capturing device is an infrared camera and the second facial image is an infrared facial image.

19. The payment method of claim 18, wherein the infrared facial image is utilized to enhance the grayscale facial image.

20. The payment method of claim 15, wherein the voice recognition information is obtained from a microphone.