Embedded authentication systems in an electronic device

• US 10,275,585 B2
• Filed: 03/27/2017
• Issued: 04/30/2019
• Est. Priority Date: 09/24/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fadell, Anthony M., Hodge, Andrew Bert, Schell, Stephan V., Caballero, Ruben, Dorogusker, Jesse Lee, Zadesky, Stephen Paul, Sanford, Emery
• Primary Examiner(s): Gergiso, Techane
• Application Number:
  US15/470,752
• Publication Number:
  US 20170199997A1
• Time in Patent Office: 764 Days
• CPC Class Codes: G06F 21/316 by observing the pattern of computer usage, e.g. typical user behaviour
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1312 direct reading, e.g. contactless acquisition
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/104 Grouping of entities
• CPC Class Codes: H04L 9/3231 Biological data, e.g. fingerprint, voice or retina network architectures or network communication protocols for supporting authentication of entities using biometrical features in a packet data network H04L63/0861
• CPC Class Codes: H04W 12/065 Continuous authentication
• CPC Class Codes: H04W 12/068 : using credential vaults, e.g. password manager applications or one time password [OTP] applications
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

This invention is directed to an electronic device with an embedded authentication system for restricting access to device resources. The authentication system may include one or more sensors operative to detect biometric information of a user. The sensors may be positioned in the device such that the sensors may detect appropriate biometric information as the user operates the device, without requiring the user to perform a step for providing the biometric information (e.g., embedding a fingerprint sensor in an input mechanism instead of providing a fingerprint sensor in a separate part of the device housing). In some embodiments, the authentication system may be operative to detect a visual or temporal pattern of inputs to authenticate a user. In response to authenticating, a user may access restricted files, applications (e.g., applications purchased by the user), or settings (e.g., application settings such as contacts or saved game profile).

Claims

1. An electronic device, comprising:

a display;

one or more image sensors, wherein the one or more image sensors includes a visible light image sensor and an infra-red image sensor;

one or more processors;

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a lock screen on the display while the electronic device is in a locked mode of operation;

while displaying the lock screen, detecting a first input; and

in response to detecting the first input;

in accordance with a determination that the first input satisfies a first authentication system;

unlocking the device; and

providing access to an application on the device without providing access to a respective feature associated with the application; and

in accordance with a determination that the first input does not satisfy the first authentication system;

forgoing unlocking the device;

while the device is unlocked;

detecting a second input that corresponds to a request to access the respective feature; and

in response to detecting the second input;

capturing image data from the one or more image sensors, wherein the captured image data includes data from the visible light image sensor and data from the infra-red image sensor;

detecting two or more attributes of a user'"'"'s face from the captured image data, the two or more attributes including a first attribute detected from the data from the visible light image sensor and a second attribute detected from the data from the infra-red image sensor;

in response to detecting the two or more attributes of the user'"'"'s face from the captured image data;

in accordance with a determination that the two or more attributes from the captured image data, including the first attribute and the second attribute, authorizes the user, providing access to the respective feature associated with the application; and

in accordance with a determination that the two or more attributes from the captured image data does not authorize the user, continuing to provide access to the application without providing access to the respective feature.

2. The device of claim 1, wherein the one or more image sensors includes a three-dimensional capture device to capture depths of the user'"'"'s facial features.

3. The device of claim 1, wherein the captured image data comprises depth data for the user'"'"'s face.

4. The device of claim 3, wherein:

detecting two or more attributes includes detecting a third attribute from the depth data; and

authenticating the user based on the two or more attributes includes authenticating the user based on the third attribute.

5. The device of claim 1, the one or more programs further including instructions for:

detecting a user'"'"'s face is opposite the one or more image sensors, wherein the capturing image data occurs in response to detecting the user'"'"'s face.

6. The device of claim 1, wherein authenticating the user based on the two or more attributes comprises comparing the two or more attributes to attributes in a library associated with authorized users.

7. The device of claim 1, wherein the one or more sensors comprises an ultra-violet sensor, a scanning laser, an ultrasound sensor, or a combination thereof.

8. The device of claim 1, wherein the two or more attributes comprises a three-dimensional contour of the user'"'"'s eye sockets, chin, nose, or a combination thereof.

9. The device of claim 1, further comprising a light source operative to emit infrared light to be reflected by the user'"'"'s eye and captured by the one or more sensors.

10. The device of claim 1, wherein the unlocked user interface is an application launch user interface that includes a plurality of application icons for launching different applications.

11. The device of claim 1, wherein the lock screen includes an indication that the device is in a locked state.

12. The device of claim 1, wherein the second input is detected while the device is unlocked without providing access to the respective feature associated with the application.

13. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display and one or more image sensors, the one or more programs including instructions for:

displaying a lock screen on the display while the electronic device is in a locked mode of operation;

while displaying the lock screen, detecting a first input and

in response to detecting the first input;

in accordance with a determination that the first input satisfies a first authentication system;

unlocking the device; and

providing access to an application on the device without providing access to a respective feature associated with the application; and

in accordance with a determination that the first input does not satisfy the first authentication system;

forgoing unlocking the device;

while the device is unlocked;

detecting a second input that corresponds to a request to access the respective feature; and

in response to detecting the second input;

capturing image data from the one or more image sensors, wherein the captured image data includes data from the visible light image sensor and data from the infra-red image sensor;

detecting two or more attributes of a user'"'"'s face from the captured image data, the two or more attributes including a first attribute detected from the data from the visible light image sensor and a second attribute detected from the data from the infra-red image sensor;

in response to detecting the two or more attributes of the user'"'"'s face from the captured image data;

in accordance with a determination that the two or more attributes from the captured image data, including the first attribute and the second attribute, authorizes the user, providing access to the respective feature associated with the application; and

in accordance with a determination that the two or more attributes from the captured image data does not authorize the user, continuing to provide access to the application without providing access to the respective feature.

14. The non-transitory computer-readable storage medium of claim 13, wherein the one or more image sensors includes a three-dimensional capture device to capture depths of the user'"'"'s facial features.

15. The non-transitory computer-readable storage medium of claim 13, wherein the captured image data comprises depth data for the user'"'"'s face.

16. The device of claim 15, wherein:

detecting two or more attributes includes detecting a third attribute from the depth data; and

authenticating the user based on the two or more attributes includes authenticating the user based on the third attribute.

17. The non-transitory computer-readable storage medium of claim 13, the one or more programs further including instructions for:

detecting a user'"'"'s face is opposite the one or more image sensors, wherein the capturing image data occurs in response to detecting the user'"'"'s face.

18. The non-transitory computer-readable storage medium of claim 13, wherein authenticating the user based on the two or more attributes comprises comparing the two or more attributes to attributes in a library associated with authorized users.

19. The non-transitory computer-readable storage medium of claim 13, wherein the one or more sensors comprises an ultra-violet sensor, a scanning laser, an ultrasound sensor, or a combination thereof.

20. The non-transitory computer-readable storage medium of claim 13, wherein the two or more attributes comprises a three-dimensional contour of the user'"'"'s eye sockets, chin, nose, or a combination thereof.

21. The non-transitory computer-readable storage medium of claim 13, further comprising a light source operative to emit infrared light to be reflected by the user'"'"'s eye and captured by the one or more sensors.

22. The non-transitory computer-readable storage medium of claim 13, wherein the unlocked user interface is an application launch user interface that includes a plurality of application icons for launching different applications.

23. The non-transitory computer-readable storage medium of claim 13, wherein the lock screen includes an indication that the device is in a locked state.

24. The non-transitory computer-readable storage medium of claim 13, wherein the second input is detected while the device is unlocked without providing access to the respective feature associated with the application.

25. A method, comprising:

at an electronic device with a display and one or more image sensors, wherein the one or more image sensors includes a visible light image sensor and an infra-red image sensor;

displaying a lock screen on the display while the electronic device is in a locked mode of operation;

while displaying the lock screen, detecting a first input; and

in response to detecting the first input;

in accordance with a determination that the first input satisfies a first authentication system;

unlocking the device; and

providing access to an application on the device without providing access to a respective feature associated with the application; and

in accordance with a determination that the first input does not satisfy the first authentication system;

forgoing unlocking the device;

while the device is unlocked;

detecting a second input that corresponds to a request to access the respective feature; and

in response to detecting the second input;

capturing image data from the one or more image sensors, wherein the captured image data includes data from the visible light image sensor and data from the infra-red image sensor;

detecting two or more attributes of a user'"'"'s face from the captured image data, the two or more attributes including a first attribute detected from the data from the visible light image sensor and a second attribute detected from the data from the infra-red image sensor;

in response to detecting the two or more attributes of the user'"'"'s face from the captured image data;

in accordance with a determination that the two or more attributes from the captured image data, including the first attribute and the second attribute, authorizes the user, providing access to the respective feature associated with the application; and

in accordance with a determination that the two or more attributes from the captured image data does not authorize the user, continuing to provide access to the application without providing access to the respective feature.

26. The method of claim 25, wherein the one or more image sensors includes a three-dimensional capture device to capture depths of the user'"'"'s facial features.

27. The method of claim 25, wherein the captured image data comprises depth data for the user'"'"'s face.

28. The method of claim 27, wherein:

detecting two or more attributes includes detecting a third attribute from the depth data; and

authenticating the user based on the two or more attributes includes authenticating the user based on the third attribute.

29. The method of claim 25, further comprising:

detecting a user'"'"'s face is opposite the one or more image sensors, wherein the capturing image data occurs in response to detecting the user'"'"'s face.

30. The method of claim 25, wherein authenticating the user based on the two or more attributes comprises comparing the two or more attributes to attributes in a library associated with authorized users.

31. The method of claim 25, wherein the one or more sensors comprises an ultra-violet sensor, a scanning laser, an ultrasound sensor, or a combination thereof.

32. The method of claim 25, wherein the two or more attributes comprises a three-dimensional contour of the user'"'"'s eye sockets, chin, nose, or a combination thereof.

33. The method of claim 25, further comprising a light source operative to emit infrared light to be reflected by the user'"'"'s eye and captured by the one or more sensors.

34. The method of claim 25, wherein the unlocked user interface is an application launch user interface that includes a plurality of application icons for launching different applications.

35. The method of claim 25, wherein the lock screen includes an indication that the device is in a locked state.

36. The method of claim 25, wherein the second input is detected while the device is unlocked without providing access to the respective feature associated with the application.