INTELLIGENT TERMINAL

• US 20200134341A1
• Filed: 12/31/2019
• Published: 04/30/2020
• Est. Priority Date: 12/28/2019
• Status: Active Grant

• Current Assignee: Beijing Taitan Technology Co., Ltd.
• Original Assignee: Beijing Taitan Technology Co., Ltd.
• Inventors: HU, GUOHUI
• Granted Patent: US 11,120,285 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/117 Biometrics derived from hands
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

Disclosed is an intelligent terminal, for which the startup authentication includes first performing face authentication and continuing to perform gesture-based virtual password authentication after the face authentication, even if the face authentication is cracked, the gesture-based password authentication is required to perform for logging in, and so the intelligent terminal of the disclosure can effectively improve the security of authentication. Further, the gesture-based virtual password authentication is performed based on a gesture image input by a user in the air, so that since there is no need to perform input operations on a screen of the intelligent terminal, the aesthetics of the intelligent terminal will not be affected. Moreover, in the disclosure, when the virtual password is determined by detecting binary images of fingertips, the disturbance of the binary images of the fingertips is also removed, which can improve the probability and efficiency in subsequent detection of the virtual password.

Claims

1. An intelligent terminal, comprising:

an initiation processing module, configured to initiate the intelligent terminal for startup;

a face authentication processing module, configured to perform a face authentication on a user;

a gesture image capturing processing module, configured to initiate a user gesture authentication after the face authentication, and capture a gesture image input by the user in the air;

a fingertip binary image extraction processing module, configured to process the captured gesture image of each frame to extract a fingertip binary image corresponding to the frame, wherein the fingertip binary image comprises a black background image block and a white fingertip image block;

a fingertip binary image validity detection processing module, configured to, starting from a fingertip binary image at a starting frame, detect a displacement of the fingertip image block at a current frame with respect to the fingertip image block at a previous frame, determine the fingertip image block at the current frame as a perturbed fingertip binary image when the displacement is less than a predetermined threshold, then continue to detect a displacement of the fingertip image block at a next frame with respect to the fingertip image block at the current frame, determine the fingertip image block at the next frame as the perturbed fingertip binary image when the displacement is less than a predetermined threshold, and then continue to detect the fingertip binary images at subsequent frames until the detection of the fingertip binary image at a last frame is completed, and then remove the perturbed fingertip binary images to finally determine a valid fingertip binary image;

a virtual password determination processing module, configured to generate a fingertip motion trajectory according to coordinates of each fingertip in a valid fingertip binary image, and determine a virtual password corresponding to the fingertip motion trajectory;

an authentication processing module, configured to determine whether the virtual password matches a preset virtual password, and pass the authentication if yes to allow logging in the intelligent terminal.

2. The intelligent terminal according to claim 1, wherein the fingertip binary image extraction processing module extracts the fingertip binary image by:

performing a skin color segmentation for the gesture image at each frame to obtain a skin-color-segmented image;

extracting a palm binary image from the skin-color-segmented image according to the predetermined threshold;

extracting a palm contour binary image from the palm binary image;

extracting the fingertip binary image from the palm contour binary image.

3. The intelligent terminal according to claim 2, wherein the fingertip binary image extraction processing module further, for the extracted palm contour binary image, smoothes the palm contour according to a polygon with minimum perimeter of a boundary of the palm contour.

4. The intelligent terminal according to claim 1, further comprising:

an image sharpening processing module, configured to perform an image sharpening on the captured gesture image input by the user in the air.

5. The intelligent terminal according to claim 1, wherein the intelligent terminal comprises a smart phone, a computer, a tablet, and an intelligent watch.