User authentication using gesture input and facial recognition

• US 10,349,273 B2
• Filed: 03/30/2017
• Issued: 07/09/2019
• Est. Priority Date: 12/10/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Seo, Joon-kyu, Choi, Young-joon, Kwak, Ji-yeon, Kim, Hyun-jin, Yoon, Yeo-jun
• Primary Examiner(s): Lee, Laurence J
• Application Number:
  US15/474,212
• Publication Number:
  US 20170208466A1
• Time in Patent Office: 831 Days
• CPC Class Codes: G04F 10/00 Apparatus for measuring unknown time intervals by electric means
• CPC Class Codes: G04G 17/08 Housings
• CPC Class Codes: G04G 21/00 Input or output devices integrated in time-pieces
• CPC Class Codes: G04G 21/02 Detectors of external physical values, e.g. temperature
• CPC Class Codes: G04G 21/025 for measuring physiological data
• CPC Class Codes: G04G 21/04 using radio waves radio-controlled time-pieces G04R
• CPC Class Codes: G04G 9/0064 in which functions not related to time can be displayed digital output to display devices of digital computers G06F3/14
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 11/3013 where the computing system is an embedded system, i.e. a combination of hardware and software dedicated to perform a certain function in mobile devices, printers, automotive or aircraft systems testing or monitoring of control systems or parts thereof G05B23/02
• CPC Class Codes: G06F 11/3058 Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations thermal management in cooling arrangements of a computing system G06F1/206
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 : Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 : Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 : Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 : Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 : Scrolling or panning
• CPC Class Codes: G06F 3/0486 : Drag-and-drop
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/147 : using display panels
• CPC Class Codes: G06V 40/161 : Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/166 : using acquisition arrangements
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/18 : Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/19 : Sensors therefor
• CPC Class Codes: G09G 2300/04 : Structural and physical details of display devices
• CPC Class Codes: G09G 2340/045 : Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2354/00 : Aspects of interface with display user
• CPC Class Codes: G09G 2380/02 : Flexible displays
• CPC Class Codes: G09G 5/003 : Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: H04B 1/385 : Transceivers carried on the body, e.g. in helmets
• CPC Class Codes: H04B 2001/3861 : carried in a hand or on fingers
• CPC Class Codes: H04L 63/0861 : using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04M 1/0268 : including a flexible display panel
• CPC Class Codes: H04M 1/05 : specially adapted for use on head, throat or breast
• CPC Class Codes: H04M 1/6041 : Portable telephones adapted for handsfree use
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72412 : using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/02 : including a Bluetooth interface
• CPC Class Codes: H04M 2250/12 : including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04N 23/60 : Control of cameras or camera modules
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04W 12/06 : Authentication
• CPC Class Codes: H04W 12/08 : Access security
• CPC Class Codes: H04W 12/33 : using wearable devices, e.g. using a smartwatch or smart-glasses
• CPC Class Codes: H04W 12/68 : Gesture-dependent or behaviour-dependent
• CPC Class Codes: Y02D 10/00 : Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A mobile device is provided. The mobile device includes a body of a bangle type configured to be worn on a user body, a display mounted in the body, a motion sensor configured to detect a motion, a storage configured to store control information which is differently set according to a motion state, and, when a motion is detected by the motion sensor, a controller configured to change a screen of the display according to control information corresponding to the detected motion. Accordingly, the mobile device is easily carried and used.

Claims

1. An electronic apparatus comprising:

a display;

a camera;

a motion sensor; and

a processor configured to;

in response to detecting, via the motion sensor, the electronic apparatus being lifted while the electronic apparatus is in a locked state and the display is inactivated, activate the display,

obtain an image from the camera,

in response to identifying that the image includes a face of a user, perform an authentication of the user based on the image,

based on the authentication of the user being successful, display an indicator for indicating that the electronic apparatus is in an unlocked state, and

based on the authentication of the user being unsuccessful, maintain the electronic apparatus in the locked state.

2. The electronic apparatus as claimed in claim 1, wherein the processor is further configured to control the display to provide the image to an unlock screen.

3. The electronic apparatus as claimed in claim 1, wherein the processor is further configured to, in response to the user authentication being performed based on the image, perform unlock.

4. The electronic apparatus as claimed in claim 1, wherein the processor is further configured to perform the user authentication by analyzing the face of the user in the image.

5. The electronic apparatus as claimed in claim 1, wherein the processor is further configured to control the display to display a screen of the locked state when a user input is not detected for a predetermined amount of time.

6. The electronic apparatus as claimed in claim 1, wherein the performing of the authentication of the user further comprises performing the authentication of the user based on the image in response to identifying that the image includes a face and open eyes of the user.

7. A method for controlling a mobile device, the method comprising:

detecting the mobile device being lifted while the mobile device is in a locked state and a display is inactivated;

in response to detecting the mobile device being lifted, activating the display;

obtaining an image from a camera;

in response to identifying that the image includes a face of a user, performing an authentication of the user based on the image;

based on the authentication of the user being successful, displaying an indicator for indicating that the mobile device is in an unlocked state; and

based on the authentication of the user being unsuccessful, maintaining the mobile device in the locked state.