Implementation of biometric authentication

• US 10,395,128 B2
• Filed: 02/23/2018
• Issued: 08/27/2019
• Est. Priority Date: 09/09/2017
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Van Os, Marcel, Anton, Peter D., Behzadi, Arian, Devine, Lynne, Foss, Christopher Patrick, Griffin, Bradley W., Mari, Pedro, Mohseni, Daamun, Mouilleseaux, Jean-Pierre M., Moussette, Camille, Preston, Daniel Trent, Yerkes, Giancarlo, Dye, Alan C., Ive, Jonathan P.
• Primary Examiner(s): Brown, Vernal U
• Application Number:
  US15/903,456
• Publication Number:
  US 20190080066A1
• Time in Patent Office: 550 Days
• Field of Search: 340 583
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 10/98 Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• CPC Class Codes: G06V 40/12 Fingerprints or palmprints
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04W 12/06 Authentication

Abstract

An electronic device performs techniques related generally to implementing biometric authentication. In some examples, a device provides user interfaces for a biometric enrollment process tutorial. In some examples, a device provides user interfaces for aligning a biometric feature for enrollment. In some examples, a device provides user interfaces for enrolling a biometric feature. In some examples, a device provides user interfaces for providing hints during a biometric enrollment process. In some examples, a device provides user interfaces for application-based biometric authentication. In some examples, a device provides user interfaces for autofilling biometrically secured fields. In some examples, a device provides user interfaces for unlocking a device using biometric authentication. In some examples, a device provides user interfaces for retrying biometric authentication. In some examples, a device provides user interfaces for managing transfers using biometric authentication. In some examples, a device provides interstitial user interfaces during biometric authentication. In some examples, a device provides user interfaces for preventing retrying biometric authentication. In some examples, a device provides user interfaces for cached biometric authentication. In some examples, a device provides user interfaces for autofilling fillable fields based on visibility criteria. In some examples, a device provides user interfaces for automatic log-in using biometric authentication.

Claims

1. An electronic device, comprising:

one or more biometric sensors;

a display;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a biometric enrollment user interface for enrolling a biometric feature, wherein displaying the biometric enrollment user interface includes displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes;

while displaying the biometric enrollment user interface;

enrolling a portion of the biometric feature; and

after enrolling the portion of the biometric feature, detecting that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature;

in response to detecting that the enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner, wherein the respective prompt is selected based on an enrollment state of one or more portions of the biometric feature and is displayed concurrently with the representation of the biometric feature in the biometric enrollment user interface, including;

in accordance with a determination that the enrollment-prompt criteria have been met with respect to a first portion of the biometric feature that can be enrolled by moving the biometric feature in a first manner, outputting the respective prompt includes outputting a prompt to move the biometric feature in the first manner; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to a second portion of the biometric feature, different from the first portion of the biometric feature, that can be enrolled by moving the biometric feature in a second manner, different from the first manner, outputting the respective prompt includes outputting a prompt to move the biometric feature in the second manner;

while maintaining display of the biometric enrollment user interface including the representation of the biometric feature, detecting movement of the biometric feature; and

in response to detecting movement of the biometric feature and while continuing to display the representation of the biometric feature in the biometric enrollment user interface, enrolling one or more additional portions of the biometric feature.

2. The electronic device of claim 1, wherein the portion of the biometric feature is less than all of the biometric feature.

3. The electronic device of claim 1, wherein the one or more portions of the biometric feature are one or more unenrolled portions of the biometric feature.

4. The electronic device of claim 1, wherein the first portion of the biometric feature is different from the portion of the biometric feature, and wherein the second portion of the biometric feature is different from the portion of the biometric feature.

5. The electronic device of claim 1, wherein the enrollment-prompt criteria include a requirement that the biometric feature moves less than a first threshold amount for at least a first threshold time period.

6. The electronic device of claim 1, wherein moving the biometric feature in the first manner includes moving the biometric feature in a first direction and moving the biometric feature in the second manner includes moving the biometric feature in a second direction different from the first direction.

7. The electronic device of claim 6, wherein:

outputting a prompt to move the biometric feature in the first manner includes outputting a prompt to move the biometric feature in the first direction; and

outputting a prompt to move the biometric feature in the second manner includes outputting a prompt to move the biometric feature in the second direction.

8. The electronic device of claim 1, wherein:

the enrollment prompt criteria include a requirement that the biometric feature has moved less than a threshold amount for a first period of time,

outputting the respective prompt includes a prompt to move the biometric feature in the first manner, and

the one or more programs further including instructions for;

after outputting the respective prompt, determining that the biometric feature has moved less than the threshold amount for a second period of time that is greater than the first period of time; and

in response to determining that the biometric feature has moved less than the threshold amount for the second period of time, displaying a subsequent prompt that is different from the respective prompt.

9. The electronic device of claim 1, wherein outputting a respective prompt to move the biometric feature in a respective manner includes:

in accordance with a determination that auditory prompt criteria are met, outputting an auditory prompt to move the biometric feature in the first manner.

10. The electronic device of claim 1, wherein outputting a respective prompt to move the biometric feature in a respective manner includes displaying a text prompt to move the biometric feature in the respective manner.

11. The electronic device of claim 1, wherein outputting a respective prompt to move the biometric feature in a respective manner includes overlaying a visual prompt on the representation of the biometric feature.

12. The electronic device of claim 1, wherein outputting a respective prompt to move the biometric feature in a respective manner includes displaying an animation prompt to move the biometric feature in the respective manner.

13. The electronic device of claim 12, wherein displaying an animation prompt to move the biometric feature in the respective manner includes displaying an arrow element indicating the respective manner in which to move the biometric feature.

14. The electronic device of claim 12, wherein:

the first manner of movement includes rotation about an axis parallel to the display;

the second manner of movement includes rotation about the axis parallel to the display; and

the animation prompt includes simulated rotation of a user interface element about the axis parallel to the display.

15. The electronic device of claim 12, wherein:

the biometric enrollment user interface includes an orientation guide that is overlaid on the representation of the biometric feature and tilts in different directions as the representation of the biometric feature tilts in different directions; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to the first portion of the biometric feature that can be enrolled by moving the biometric feature in the first manner, the animation prompt includes movement of a portion of the orientation guide in a direction that the orientation guide would move if the biometric feature moved in the first manner; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to the second portion of the biometric feature that can be enrolled by moving the biometric feature in the second manner, the animation prompt includes movement of a portion of the orientation guide in a direction that the orientation guide would move if the biometric feature moved in the second manner.

16. The electronic device of claim 1, the one or more programs further including instructions for:

after outputting the respective prompt, detecting movement of the biometric feature that meets enrollment criteria for a respective portion of the biometric feature;

in response to detecting the movement of the biometric feature, enrolling the respective portion of the biometric feature;

while enrolling the respective portion of the biometric feature, ceasing to provide the prompts;

after enrolling the respective portion of the biometric feature, determining that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature; and

in response to determining that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature, outputting another respective prompt to move the biometric feature in a respective manner determined based on the one or more portions of the biometric feature for which the enrollment-prompt criteria have been met.

17. The electronic device of claim 1, wherein the biometric feature is a face.

18. The electronic device of claim 1, wherein the first portion of the biometric feature is a first side of the biometric feature, and the second portion of the biometric feature is a second side of the biometric feature.

19. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with one or more biometric sensors and a display, the one or more programs including instructions for:

displaying, on the display, a biometric enrollment user interface for enrolling a biometric feature, wherein displaying the biometric enrollment user interface includes displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes;

while displaying the biometric enrollment user interface;

enrolling a portion of the biometric feature; and

after enrolling the portion of the biometric feature, detecting that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature;

in response to detecting that the enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner, wherein the respective prompt is selected based on an enrollment state of one or more portions of the biometric feature and is displayed concurrently with the representation of the biometric feature in the biometric enrollment user interface, including;

in accordance with a determination that the enrollment-prompt criteria have been met with respect to a first portion of the biometric feature that can be enrolled by moving the biometric feature in a first manner, outputting the respective prompt includes outputting a prompt to move the biometric feature in the first manner; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to a second portion of the biometric feature, different from the first position of the biometric feature, that can be enrolled by moving the biometric feature in a second manner, different from the first manner, outputting the respective prompt includes outputting a prompt to move the biometric feature in the second manner;

while maintaining display of the biometric enrollment user interface including the representation of the biometric feature, detecting movement of the biometric feature; and

in response to detecting movement of the biometric feature and while continuing to display the representation of the biometric feature in the biometric enrollment user interface, enrolling one or more additional portions of the biometric feature.

20. The non-transitory computer-readable storage medium of claim 19, wherein the portion of the biometric feature is less than all of the biometric feature.

21. The non-transitory computer-readable storage medium of claim 19, wherein the one or more portions of the biometric feature are one or more unenrolled portions of the biometric feature.

22. The non-transitory computer-readable storage medium of claim 19, wherein the first portion of the biometric feature is different from the portion of the biometric feature, and wherein the second portion of the biometric feature is different from the portion of the biometric feature.

23. The non-transitory computer-readable storage medium of claim 19, wherein the enrollment-prompt criteria include a requirement that the biometric feature moves less than a first threshold amount for at least a first threshold time period.

24. The non-transitory computer-readable storage medium of claim 19, wherein moving the biometric feature in the first manner includes moving the biometric feature in a first direction and moving the biometric feature in the second manner includes moving the biometric feature in a second direction different from the first direction.

25. The non-transitory computer-readable storage medium of claim 24, wherein:

outputting a prompt to move the biometric feature in the first manner includes outputting a prompt to move the biometric feature in the first direction; and

outputting a prompt to move the biometric feature in the second manner includes outputting a prompt to move the biometric feature in the second direction.

26. The non-transitory computer-readable storage medium of claim 19, wherein:

the enrollment prompt criteria include a requirement that the biometric feature has moved less than a threshold amount for a first period of time,

outputting the respective prompt includes a prompt to move the biometric feature in the first manner, and

the one or more programs further including instructions for;

after outputting the respective prompt, determining that the biometric feature has moved less than the threshold amount for a second period of time that is greater than the first period of time; and

in response to determining that the biometric feature has moved less than the threshold amount for the second period of time, displaying a subsequent prompt that is different from the respective prompt.

27. The non-transitory computer-readable storage medium of claim 19, wherein outputting a respective prompt to move the biometric feature in a respective manner includes:

in accordance with a determination that auditory prompt criteria are met, outputting an auditory prompt to move the biometric feature in the first manner.

28. The non-transitory computer-readable storage medium of claim 19, wherein outputting a respective prompt to move the biometric feature in a respective manner includes displaying a text prompt to move the biometric feature in the respective manner.

29. The non-transitory computer-readable storage medium of claim 19, wherein outputting a respective prompt to move the biometric feature in a respective manner includes overlaying a visual prompt on the representation of the biometric feature.

30. The non-transitory computer-readable storage medium of claim 19, wherein outputting a respective prompt to move the biometric feature in a respective manner includes displaying an animation prompt to move the biometric feature in the respective manner.

31. The non-transitory computer-readable storage medium of claim 30, wherein displaying an animation prompt to move the biometric feature in the respective manner includes displaying an arrow element indicating the respective manner in which to move the biometric feature.

32. The non-transitory computer-readable storage medium of claim 30, wherein:

the first manner of movement includes rotation about an axis parallel to the display;

the second manner of movement includes rotation about the axis parallel to the display; and

the animation prompt includes simulated rotation of a user interface element about the axis parallel to the display.

33. The non-transitory computer-readable storage medium of claim 30, wherein:

the biometric enrollment user interface includes an orientation guide that is overlaid on the representation of the biometric feature and tilts in different directions as the representation of the biometric feature tilts in different directions; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to the first portion of the biometric feature that can be enrolled by moving the biometric feature in the first manner, the animation prompt includes movement of a portion of the orientation guide in a direction that the orientation guide would move if the biometric feature moved in the first manner; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to the second portion of the biometric feature that can be enrolled by moving the biometric feature in the second manner, the animation prompt includes movement of a portion of the orientation guide in a direction that the orientation guide would move if the biometric feature moved in the second manner.

34. The non-transitory computer-readable storage medium of claim 19, the one or more programs further including instructions for:

after outputting the respective prompt, detecting movement of the biometric feature that meets enrollment criteria for a respective portion of the biometric feature;

in response to detecting the movement of the biometric feature, enrolling the respective portion of the biometric feature;

while enrolling the respective portion of the biometric feature, ceasing to provide the prompts;

after enrolling the respective portion of the biometric feature, determining that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature; and

in response to determining that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature, outputting another respective prompt to move the biometric feature in a respective manner determined based on the one or more portions of the biometric feature for which the enrollment-prompt criteria have been met.

35. The non-transitory computer-readable storage medium of claim 19, wherein the biometric feature is a face.

36. The non-transitory computer-readable storage medium of claim 19, wherein the first portion of the biometric feature is a first side of the biometric feature, and the second portion of the biometric feature is a second side of the biometric feature.

37. A method, comprising:

at an electronic device with one or more biometric sensors and a display;

displaying, on the display, a biometric enrollment user interface for enrolling a biometric feature, wherein displaying the biometric enrollment user interface includes displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes;

while displaying the biometric enrollment user interface;

enrolling a portion of the biometric feature; and

after enrolling the portion of the biometric feature, detecting that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature;

in response to detecting that the enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner, wherein the respective prompt is selected based on an enrollment state of one or more portions of the biometric feature and is displayed concurrently with the representation of the biometric feature in the biometric enrollment user interface, including;

in accordance with a determination that the enrollment-prompt criteria have been met with respect to a first portion of the biometric feature that can be enrolled by moving the biometric feature in a first manner, outputting the respective prompt includes outputting a prompt to move the biometric feature in the first manner; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to a second portion of the biometric feature, different from the first position of the biometric feature, that can be enrolled by moving the biometric feature in a second manner, different from the first manner, outputting the respective prompt includes outputting a prompt to move the biometric feature in the second manner;

while maintaining display of the biometric enrollment user interface including the representation of the biometric feature, detecting movement of the biometric feature; and

in response to detecting movement of the biometric feature and while continuing to display the representation of the biometric feature in the biometric enrollment user interface, enrolling one or more additional portions of the biometric feature.

38. The method of claim 37, wherein the portion of the biometric feature is less than all of the biometric feature.

39. The method of claim 37, wherein the one or more portions of the biometric feature are one or more unenrolled portions of the biometric feature.

40. The method of claim 37, wherein the first portion of the biometric feature is different from the portion of the biometric feature, and wherein the second portion of the biometric feature is different from the portion of the biometric feature.

41. The method of claim 37, wherein the enrollment-prompt criteria include a requirement that the biometric feature moves less than a first threshold amount for at least a first threshold time period.

42. The method of claim 37, wherein moving the biometric feature in the first manner includes moving the biometric feature in a first direction and moving the biometric feature in the second manner includes moving the biometric feature in a second direction different from the first direction.

43. The method of claim 42, wherein:

outputting a prompt to move the biometric feature in the first manner includes outputting a prompt to move the biometric feature in the first direction; and

outputting a prompt to move the biometric feature in the second manner includes outputting a prompt to move the biometric feature in the second direction.

44. The method of claim 37, wherein:

the enrollment prompt criteria include a requirement that the biometric feature has moved less than a threshold amount for a first period of time,

outputting the respective prompt includes a prompt to move the biometric feature in the first manner, and

the method further comprising;

after outputting the respective prompt, determining that the biometric feature has moved less than the threshold amount for a second period of time that is greater than the first period of time; and

in response to determining that the biometric feature has moved less than the threshold amount for the second period of time, displaying a subsequent prompt that is different from the respective prompt.

45. The method of claim 37, wherein outputting a respective prompt to move the biometric feature in a respective manner includes:

in accordance with a determination that auditory prompt criteria are met, outputting an auditory prompt to move the biometric feature in the first manner.

46. The method of claim 37, wherein outputting a respective prompt to move the biometric feature in a respective manner includes displaying a text prompt to move the biometric feature in the respective manner.

47. The method of claim 37, wherein outputting a respective prompt to move the biometric feature in a respective manner includes overlaying a visual prompt on the representation of the biometric feature.

48. The method of claim 37, wherein outputting a respective prompt to move the biometric feature in a respective manner includes displaying an animation prompt to move the biometric feature in the respective manner.

49. The method of claim 48, wherein displaying an animation prompt to move the biometric feature in the respective manner includes displaying an arrow element indicating the respective manner in which to move the biometric feature.

50. The method of claim 48, wherein:

the first manner of movement includes rotation about an axis parallel to the display;

the second manner of movement includes rotation about the axis parallel to the display; and

the animation prompt includes simulated rotation of a user interface element about the axis parallel to the display.

51. The method of claim 48, wherein:

the biometric enrollment user interface includes an orientation guide that is overlaid on the representation of the biometric feature and tilts in different directions as the representation of the biometric feature tilts in different directions; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to the first portion of the biometric feature that can be enrolled by moving the biometric feature in the first manner, the animation prompt includes movement of a portion of the orientation guide in a direction that the orientation guide would move if the biometric feature moved in the first manner; and

in accordance with a determination that the enrollment-prompt criteria have been met with respect to the second portion of the biometric feature that can be enrolled by moving the biometric feature in the second manner, the animation prompt includes movement of a portion of the orientation guide in a direction that the orientation guide would move if the biometric feature moved in the second manner.

52. The method of claim 37, further comprising:

after outputting the respective prompt, detecting movement of the biometric feature that meets enrollment criteria for a respective portion of the biometric feature;

in response to detecting the movement of the biometric feature, enrolling the respective portion of the biometric feature;

while enrolling the respective portion of the biometric feature, ceasing to provide the prompts;

after enrolling the respective portion of the biometric feature, determining that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature; and

in response to determining that enrollment-prompt criteria have been met with respect to one or more portions of the biometric feature, outputting another respective prompt to move the biometric feature in a respective manner determined based on the one or more portions of the biometric feature for which the enrollment-prompt criteria have been met.

53. The method of claim 37, wherein the biometric feature is a face.

54. The method of claim 37, wherein the first portion of the biometric feature is a first side of the biometric feature, and the second portion of the biometric feature is a second side of the biometric feature.