Smart glasses and method for recognizing and prompting face using smart glasses

• US 9,536,159 B2
• Filed: 07/01/2015
• Issued: 01/03/2017
• Est. Priority Date: 08/21/2014
• Status: Active Grant

• Current Assignee: Coretronic Corporation
• Original Assignee: Coretronic Corporation
• Inventors: Wu, Chia-Chien, Kan, Wei-Hsin, Huang, Cheng-Yen
• Primary Examiner(s): Rahmjoo, Manuchehr
• Application Number:
  US14/788,814
• Publication Number:
  US 20160055371A1
• Time in Patent Office: 552 Days
• Field of Search: 382/118
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: H04L 67/30 Profiles
• CPC Class Codes: H04L 67/306 User profiles

Abstract

Smart glasses and a method for recognizing and prompting a face are provided. The smart glasses store a database recording a plurality of profile information and business card information thereof. In the method, an image located in the field of view of the smart glasses is captured by an image capturing unit and at least one face appearing in the image is recognized. Facial features of each of the recognized faces are compared with those of the profile information in the database to find the profile information matching the facial features. In particular, if profile information matching the facial features is found, business card information corresponding to the profile information is displayed on a display unit; if profile information matching the facial features is not found, the business card information of a business card appearing in the image is recognized to associate the business card information with the recognized face.

Claims

1. A method for recognizing and prompting a face, adapted for smart glasses having an image capturing unit, a storage unit, and a display unit, wherein the storage unit stores a database recording a plurality of profile information and business card information corresponding to each of the profile information, the method comprising:

capturing an image located in a field of view of the smart glasses via the image capturing unit;

recognizing at least one face appearing in the image captured by the image capturing unit;

comparing facial features of each of the recognized faces with the facial features of the profile information in the database to find the profile information matching the facial features;

displaying the business card information corresponding to the profile information on the display unit if the profile information matching the facial features is found; and

recognizing the business card information of a business card appearing in the image captured by the image capturing unit and associating the recognized business card information with the recognized face if the profile information matching the facial features is not found.

2. The method of claim 1, wherein before the step of recognizing the business card information of the business card appearing in the image captured by the image capturing unit, the method further comprises:

detecting whether the business card appears in the image captured by the image capturing unit; and

accumulating a time for which the business card is not detected, and stopping the detection of the business card and the recognition of the business card information when the accumulated time exceeds a preset value.

3. The method of claim 1, wherein the step of comparing the facial features of each of the recognized faces with the facial features of the profile information in the database to find the profile information matching the facial features further comprises:

calculating a size of each of the recognized faces and determining whether the size of the face is within a preset range if the profile information matching the facial features is not found; and

starting the step of recognizing the business card information and associating the face for which the size is within the preset range with the recognized business card information if the size of the face is within the preset range.

4. The method of claim 1, wherein the step of associating the recognized business card information with the recognized face further comprises:

calculating a size of each of the recognized faces and determining whether the size of the face is within a preset range; and

associating the face for which the size is within the preset range with the recognized business card information.

5. The method of claim 1, wherein the smart glasses further comprises a positioning unit, and the step of comparing the facial features of each of the recognized faces with the facial features of the profile information in the database to find the profile information matching the facial features further comprises:

positioning the smart glasses via the positioning unit to obtain a location of the smart glasses; and

comparing the location with an address in the business card information of each of the profile information in the database to select the profile information for which the address is close to the location, and comparing the facial features of the profile information with the facial features of each of the recognized faces.

6. The method of claim 1, wherein the smart glasses further comprise a sound capturing unit, and the method further comprises:

capturing a voiceprint signal via the sound capturing unit in the meantime of capturing the image via the image capturing unit;

comparing the captured voiceprint signal with the voiceprint signal of each of the profile information in the database to find the profile information matching the voiceprint signal; and

displaying the business card information corresponding to the profile information on the display unit if the profile information matching both the voiceprint signal and the facial features is found.

7. Smart glasses, comprising:

an image capturing unit capturing an image located in a field of view of the smart glasses;

a storage unit storing a database, wherein the database records a plurality of profile information and a business card information corresponding to each of the profile information;

a display unit; and

a processing unit coupled to the image capturing unit, the storage unit, and the display unit, recognizing at least one face appearing in an image captured by the image capturing unit, and comparing facial features of each of the recognized faces with the profile information in the database to find the profile information matching the facial features, wherein

the business card information corresponding to the profile information is displayed on the display unit if the profile information matching the facial features is found; and

the business card information of a business card appearing in the image captured by the image capturing unit is recognized and the recognized business card information is associated with the recognized face if the profile information matching the facial features is not found.

8. The smart glasses of claim 7, wherein the processing unit further detects whether the business card appears in the image captured by the image capturing unit, accumulates a time for which the business card is not detected, and stops the detection of the business card and the recognition of the business card information when the accumulated time exceeds a preset value.

9. The smart glasses of claim 7, wherein the processing unit further calculates a size of each of the recognized faces and determines whether the size of the face is within a preset range if the profile information matching the facial features is not found, wherein

the processing unit starts the step of recognizing the business card information and associates the face for which the size is within the preset range with the recognized business card information if the size of the face is within the preset range.

10. The smart glasses of claim 7, wherein the processing unit further calculates a size of each of the recognized faces and determines whether the size of the face is within a preset range, and only associates the face for which the size is within the preset range with the recognized business card information.

11. The smart glasses of claim 7, further comprising:

a positioning unit positioning the smart glasses to obtain a location of the smart glasses, wherein

the processing unit further compares the location with an address in the business card information of each of the profile information in the database to select the profile information for which the address is close to the location, and compares the facial features of the profile information with those of each of the recognized faces.

12. The smart glasses of claim 7, further comprising:

a sound capturing unit capturing a voiceprint signal at the same time the image capturing unit captures the image, wherein

the processing unit comprises comparing the captured voiceprint signal with the voiceprint signal of each of the profile information in the database to find the profile information matching the voiceprint signal, and displays the business card information corresponding to the profile information on the display unit when the profile information matching both the voiceprint signal and the facial features is found.