Embedded authentication systems in an electronic device

• US 9,953,152 B2
• Filed: 11/21/2016
• Issued: 04/24/2018
• Est. Priority Date: 09/24/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fadell, Anthony M., Hodge, Andrew Bert, Schell, Stephan V., Caballero, Ruben, Dorogusker, Jesse Lee, Zadesky, Stephen Paul, Sanford, Emery
• Primary Examiner(s): Gergiso, Techane
• Application Number:
  US15/357,873
• Publication Number:
  US 20170169204A1
• Time in Patent Office: 519 Days
• CPC Class Codes: G06F 21/316 by observing the pattern of computer usage, e.g. typical user behaviour
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1312 direct reading, e.g. contactless acquisition
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/104 Grouping of entities
• CPC Class Codes: H04L 9/3231 Biological data, e.g. fingerprint, voice or retina network architectures or network communication protocols for supporting authentication of entities using biometrical features in a packet data network H04L63/0861
• CPC Class Codes: H04W 12/065 Continuous authentication
• CPC Class Codes: H04W 12/068 : using credential vaults, e.g. password manager applications or one time password [OTP] applications
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

This invention is directed to an electronic device with an embedded authentication system for restricting access to device resources. The authentication system may include one or more sensors operative to detect biometric information of a user. The sensors may be positioned in the device such that the sensors may detect appropriate biometric information as the user operates the device, without requiring the user to perform a step for providing the biometric information (e.g., embedding a fingerprint sensor in an input mechanism instead of providing a fingerprint sensor in a separate part of the device housing). In some embodiments, the authentication system may be operative to detect a visual or temporal pattern of inputs to authenticate a user. In response to authenticating, a user may access restricted files, applications (e.g., applications purchased by the user), or settings (e.g., application settings such as contacts or saved game profile).

Claims

1. An electronic device, comprising:

a display;

one or more image sensors;

one or more processors;

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a respective user interface that includes an obscured version of first information;

while displaying the obscured version of the first information on the display;

capturing image data from the one or more image sensors; and

detecting one or more attributes of a user'"'"'s face from the captured image data;

in response to detecting the one or more attributes of the user'"'"'s face from the captured image data;

in accordance with a determination that the one or more attributes from the captured image data authorizes the user, replacing display of the obscured version of the first information with an unobscured version of the first information; and

in accordance with a determination that the one or more attributes from the captured image data does not authorize the user, maintaining display of the obscured version of the first information on the display.

2. The device of claim 1, wherein the one or more programs include instructions for:

prior to displaying the respective user interface, receiving a request to display the respective user interface; and

in response to receiving the request, displaying the respective user interface.

3. The device of claim 1, wherein the one or more programs include instructions for, while displaying the obscured version of the first information, displaying unobscured text in the respective user interface.

4. The device of claim 1, wherein the obscured version of the first information includes a plurality of separate information items that include obscured text.

5. The device of claim 1, wherein the obscured version of the first information includes a blurred version of corresponding unobscured information.

6. The device of claim 1, wherein:

the respective user interface is a user interface for displaying information about personal contacts of a user of the device; and

replacing display of the obscured version of the first information with the unobscured version of the first information includes providing access to the information about the personal contacts.

7. The device of claim 1, wherein the one or more programs include instructions for, prior to detecting the one or more attributes of the user'"'"'s face, displaying a notice instructing the user to authenticate before accessing the unobscured version of the first information.

8. The device of claim 1, wherein:

prior to detecting the one or more attributes of the user'"'"'s face, one or more respective objects in the respective user interface are not selectable; and

the one or more programs include instructions for, in response to detecting the one or more attributes of the user'"'"'s face from the captured image data;

in accordance with the determination that the one or more attributes from the captured image data authorizes the user, enabling selection of the one or more respective objects; and

in accordance with the determination that the one or more attributes from the captured image data does not authorizes the user, forgoing enabling selection of the one or more respective objects.

9. The device of claim 1, wherein the obscured version of the first information is a blurred version of the first information.

10. The device of claim 1, wherein the obscured version of the first information is a hidden version of the first information.

11. The device of claim 1, wherein the one or more image sensors includes a visible light image sensor.

12. The device of claim 1, wherein the one or more image sensors includes an image sensor that detects light outside the visible light spectrum.

13. The device of claim 12, wherein the one or more image sensors includes an infra-red image sensor.

14. The device of claim 1, wherein the one or more image sensors includes a visible light image sensor and an infra-red image sensor.

15. The device of claim 14, wherein

the captured image data includes data from the visible light image sensor and data from the infra-red image sensor;

and

detecting the one or more attributes includes detecting a first attribute from the visible light image sensor and a second attribute from the infra-red image sensor.

16. The device of claim 1, wherein the one or more image sensors includes a three-dimensional capture device to capture depths of the user'"'"'s facial features.

17. The device of claim 1, wherein the captured image data comprises depth data for the user'"'"'s face.

18. The device of claim 17, wherein detecting the one or more attributes includes detecting a third attribute from the depth data.

19. The device of claim 1, the one or more programs further including instructions for:

detecting the user'"'"'s face is opposite the one or more image sensors, wherein capturing the image data occurs in response to detecting the user'"'"'s face.

20. The device of claim 1, wherein the one or more sensors comprises an ultra-violet sensor, a scanning laser, an ultrasound sensor, or a combination thereof.

21. The device of claim 1, wherein the one or more attributes comprises a three-dimensional contour of the user'"'"'s eye sockets, chin, nose, or a combination thereof.

22. The device of claim 1, further comprising a light source operative to emit infrared light to be reflected by the user'"'"'s eye and captured by the one or more sensors.

52. The method of claim 5, wherein:

prior to detecting the one or more attributes of the user'"'"'s face, one or more respective objects in the respective user interface are not selectable; and

the method further comprising, in response to detecting the one or more attributes of the user'"'"'s face from the captured image data;

in accordance with the determination that the one or more attributes from the captured image data authorizes the user, enabling selection of the one or more respective objects; and

in accordance with the determination that the one or more attributes from the captured image data does not authorizes the user, forgoing enabling selection of the one or more respective objects.

23. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display and one or more image sensors, the one or more programs including instructions for:

displaying, on the display, a respective user interface that includes an obscured version of first information;

while displaying the obscured version of the first information on the display;

capturing image data from the one or more image sensors; and

detecting one or more attributes of a user'"'"'s face from the captured image data;

in response to detecting the one or more attributes of the user'"'"'s face from the captured image data;

in accordance with a determination that the one or more attributes from the captured image data authorizes the user, replacing display of the obscured version of the first information with an unobscured version of the first information; and

in accordance with a determination that the one or more attributes from the captured image data does not authorize the user, maintaining display of the obscured version of the first information on the display.

24. The non-transitory computer-readable storage medium of claim 23, wherein the one or more programs include instructions for:

prior to displaying the respective user interface, receiving a request to display the respective user interface; and

in response to receiving the request, displaying the respective user interface.

25. The non-transitory computer-readable storage medium of claim 23, wherein the one or more programs include instructions for, while displaying the obscured version of the first information, displaying unobscured text in the respective user interface.

26. The non-transitory computer-readable storage medium of claim 23, wherein the obscured version of the first information includes a plurality of separate information items that include obscured text.

27. The non-transitory computer-readable storage medium of claim 23, wherein the obscured version of the first information includes a blurred version of corresponding unobscured information.

28. The non-transitory computer-readable storage medium of claim 23, wherein:

the respective user interface is a user interface for displaying information about personal contacts of a user of the device; and

replacing display of the obscured version of the first information with the unobscured version of the first information includes providing access to the information about the personal contacts.

29. The non-transitory computer-readable storage medium of claim 23, wherein the one or more programs include instructions for, prior to detecting the one or more attributes of the user'"'"'s face, displaying a notice instructing the user to authenticate before accessing the unobscured version of the first information.

30. The non-transitory computer-readable storage medium of claim 23, wherein:

prior to detecting the one or more attributes of the user'"'"'s face, one or more respective objects in the respective user interface are not selectable; and

the one or more programs include instructions for, in response to detecting the one or more attributes of the user'"'"'s face from the captured image data;

in accordance with the determination that the one or more attributes from the captured image data authorizes the user, enabling selection of the one or more respective objects; and

in accordance with the determination that the one or more attributes from the captured image data does not authorizes the user, forgoing enabling selection of the one or more respective objects.

31. The non-transitory computer-readable storage medium of claim 23, wherein the obscured version of the first information is a blurred version of the first information.

32. The non-transitory computer-readable storage medium of claim 23, wherein the obscured version of the first information is a hidden version of the first information.

33. The non-transitory computer-readable storage medium of claim 23, wherein the one or more image sensors includes a visible light image sensor.

34. The non-transitory computer-readable storage medium of claim 23, wherein the one or more image sensors includes an image sensor that detects light outside the visible light spectrum.

35. The non-transitory computer-readable storage medium of claim 34, wherein the one or more image sensors includes an infra-red image sensor.

36. The non-transitory computer-readable storage medium of claim 23, wherein the one or more image sensors includes a visible light image sensor and an infra-red image sensor.

37. The non-transitory computer-readable storage medium of claim 36, wherein

the captured image data includes data from the visible light image sensor and data from the infra-red image sensor;

and

detecting the one or more attributes includes detecting a first attribute from the visible light image sensor and a second attribute from the infra-red image sensor.

38. The non-transitory computer-readable storage medium of claim 23, wherein the one or more image sensors includes a three-dimensional capture device to capture depths of the user'"'"'s facial features.

39. The non-transitory computer-readable storage medium of claim 23, wherein the captured image data comprises depth data for the user'"'"'s face.

40. The non-transitory computer-readable storage medium of claim 39, wherein detecting the one or more attributes includes detecting a third attribute from the depth data.

41. The non-transitory computer-readable storage medium of claim 23, the one or more programs further including instructions for:

detecting the user'"'"'s face is opposite the one or more image sensors, wherein capturing the image data occurs in response to detecting the user'"'"'s face.

42. The non-transitory computer-readable storage medium of claim 23, wherein the one or more sensors comprises an ultra-violet sensor, a scanning laser, an ultrasound sensor, or a combination thereof.

43. The non-transitory computer-readable storage medium of claim 23, wherein the one or more attributes comprises a three-dimensional contour of the user'"'"'s eye sockets, chin, nose, or a combination thereof.

44. The non-transitory computer-readable storage medium of claim 23, wherein the one or more programs include instructions for causing a light source to emit infrared light to be reflected by the user'"'"'s eye and captured by the one or more sensors.

45. A method, comprising:

at an electronic device with a display and one or more image sensors;

displaying, on the display, a respective user interface that includes an obscured version of first information;

while displaying the obscured version of the first information on the display;

capturing image data from the one or more image sensors; and

detecting one or more attributes of a user'"'"'s face from the captured image data;

in response to detecting the one or more attributes of the user'"'"'s face from the captured image data;

in accordance with a determination that the one or more attributes from the captured image data authorizes the user, replacing display of the obscured version of the first information with an unobscured version of the first information; and

in accordance with a determination that the one or more attributes from the captured image data does not authorize the user, maintaining display of the obscured version of the first information on the display.

46. The method of claim 45, further comprising:

prior to displaying the respective user interface, receiving a request to display the respective user interface; and

in response to receiving the request, displaying the respective user interface.

47. The method of claim 45, further comprising:

while displaying the obscured version of the first information, displaying unobscured text in the respective user interface.

48. The method of claim 45, wherein the obscured version of the first information includes a plurality of separate information items that include obscured text.

49. The method of claim 45, wherein the obscured version of the first information includes a blurred version of corresponding unobscured information.

50. The method of claim 45, wherein:

the respective user interface is a user interface for displaying information about personal contacts of a user of the device; and

replacing display of the obscured version of the first information with the unobscured version of the first information includes providing access to the information about the personal contacts.

51. The method of claim 45, further comprising:

prior to detecting the one or more attributes of the user'"'"'s face, displaying a notice instructing the user to authenticate before accessing the unobscured version of the first information.

53. The method of claim 45, wherein the obscured version of the first information is a blurred version of the first information.

54. The method of claim 45, wherein the obscured version of the first information is a hidden version of the first information.

55. The method of claim 45, wherein the one or more image sensors includes a visible light image sensor.

56. The method of claim 45, wherein the one or more image sensors includes an image sensor that detects light outside the visible light spectrum.

57. The method of claim 56, wherein the one or more image sensors includes an infra-red image sensor.

58. The method of claim 45, wherein the one or more image sensors includes a visible light image sensor and an infra-red image sensor.

59. The method of claim 58, wherein

the captured image data includes data from the visible light image sensor and data from the infra-red image sensor;

and

detecting the one or more attributes includes detecting a first attribute from the visible light image sensor and a second attribute from the infra-red image sensor.

60. The method of claim 45, wherein the one or more image sensors includes a three-dimensional capture device to capture depths of the user'"'"'s facial features.

61. The method of claim 45, wherein the captured image data comprises depth data for the user'"'"'s face.

62. The method of claim 61, wherein detecting the one or more attributes includes detecting a third attribute from the depth data.

63. The method of claim 45, further comprising:

detecting the user'"'"'s face is opposite the one or more image sensors, wherein capturing the image data occurs in response to detecting the user'"'"'s face.

64. The method of claim 45, wherein the one or more sensors comprises an ultra-violet sensor, a scanning laser, an ultrasound sensor, or a combination thereof.

65. The method of claim 45, wherein the one or more attributes comprises a three-dimensional contour of the user'"'"'s eye sockets, chin, nose, or a combination thereof.

66. The method of claim 45, further comprising:

emitting, from a light source, infrared light to be reflected by the user'"'"'s eye and captured by the one or more sensors.