Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs

• US 9,898,642 B2
• Filed: 09/08/2014
• Issued: 02/20/2018
• Est. Priority Date: 09/09/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Han, Byron, Shepherd, Matthew E., Chaudhri, Imran, Christie, Gregory N., Coffman, Patrick L., Federighi, Craig M., Gamble, Matthew H., Paine, Brittany D., Langoulant, Brendan J., Marciniak, Craig A., Pitschel, Donald W., Schimpf, Daniel O., Whalley, Andrew R., Whitney, Christopher R., Dascola, Jonathan R., Yang, Lawrence Y.
• Primary Examiner(s): VU, THANH T
• Application Number:
  US14/480,183
• Publication Number:
  US 20150074615A1
• Time in Patent Office: 1,261 Days
• Field of Search: None
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/41 where a single sign-on provides access to a plurality of computers
• CPC Class Codes: G06F 2221/2113 Multi-level security, e.g. mandatory access control
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/1353 Extracting features related to minutiae or pores
• CPC Class Codes: H04L 63/0815 providing single-sign-on or federations
• CPC Class Codes: H04L 63/083 using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/105 Multiple levels of security
• CPC Class Codes: H04L 9/3231 Biological data, e.g. fingerprint, voice or retina network architectures or network communication protocols for supporting authentication of entities using biometrical features in a packet data network H04L63/0861
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

An electronic device with a display and a fingerprint sensor displays a fingerprint enrollment interface and detects, on the fingerprint sensor, a plurality of finger gestures performed with a finger. The device collects fingerprint information from the plurality of finger gestures performed with the finger. After collecting the fingerprint information, the device determines whether the collected fingerprint information is sufficient to enroll a fingerprint of the finger. When the collected fingerprint information for the finger is sufficient to enroll the fingerprint of the finger, the device enrolls the fingerprint of the finger with the device. When the collected fingerprint information for the finger is not sufficient to enroll the fingerprint of the finger, the device displays a message in the fingerprint enrollment interface prompting a user to perform one or more additional finger gestures on the fingerprint sensor with the finger.

Claims

1. A method, comprising:

at an electronic device with a display and a fingerprint sensor;

while a finger is not detected on the fingerprint sensor, displaying a fingerprint enrollment interface that includes a fingerprint representation that includes a plurality of lines that are representative of fingerprint ridges;

while displaying the fingerprint representation, detecting on the fingerprint sensor a plurality of separate and distinct stationary finger gestures performed with a respective finger;

in response to one or more of the separate and distinct stationary finger gestures performed with the respective finger;

updating an appearance of the fingerprint representation to change an appearance of one or more of the plurality of lines that are representative of fingerprint ridges that were displayed while the finger was not detected on the fingerprint sensor; and

collecting fingerprint information from the plurality of separate and distinct stationary finger gestures performed with the respective finger; and

after collecting the fingerprint information and updating the appearance of the fingerprint representation;

determining, based on fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes a predefined minimum amount of non-overlapping fingerprint area;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area, displaying a message in the fingerprint enrollment interface prompting a user to perform one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

2. The method of claim 1, wherein fingerprint information from the plurality of separate and distinct stationary finger gestures is collected for an area of the fingerprint of the respective finger that is at least twice as large as the area that can be captured by the fingerprint sensor during a single stationary finger gesture.

3. The method of claim 1, including, after enrolling the fingerprint of the respective finger with the device:

receiving a request to perform a restricted operation and detecting a fingerprint on the fingerprint sensor; and

in response to receiving the request to perform the restricted operation;

in accordance with a determination that the fingerprint is enrolled with the device, performing the restricted operation; and

in accordance with a determination that the fingerprint is not enrolled with the device, forgoing performance of the restricted operation.

4. The method of claim 1, wherein the message prompting the user to perform one or more additional finger gestures includes displayed instructions to perform subsequent finger gestures differently from the respective finger gesture.

5. The method of claim 1, wherein the message prompting the user to perform one or more additional finger gestures includes an indication of one or more portions or locations of the respective fingerprint for which fingerprint information is inadequate or has not been collected.

6. The method of claim 1, including, while the respective finger is on the fingerprint sensor during a respective stationary gesture:

collecting fingerprint information; and

after the fingerprint information has been collected, providing haptic feedback at the device to indicate that the fingerprint information has been collected.

7. The method of claim 1, including, after enrolling the fingerprint of the respective finger with the device:

displaying a fingerprint settings interface with a plurality of entries that correspond to respective enrolled fingerprints, wherein the plurality of entries includes a respective entry that corresponds to the fingerprint of the respective finger and one or more other entries that correspond to other enrolled fingerprints of other fingers besides the respective finger;

detecting a second finger gesture on the fingerprint sensor that corresponds to the fingerprint of the respective finger; and

in response to detecting the second finger gesture, highlighting the respective entry that corresponds to the fingerprint of the respective finger.

8. The method of claim 1, wherein the fingerprint representation includes a portion of a surface of a three-dimensional object.

9. The method of claim 1, wherein

changing the appearance of the one or more of the plurality of lines that are representative of fingerprint ridges includes coloring in a portion of the plurality of lines that are representative of fingerprint ridges.

10. The method of claim 1, wherein the fingerprint enrollment interface includes a plurality of concentric circles, the method further including:

in response to the one or more of the separate and distinct stationary finger gestures performed with the respective finger, filling in one of the plurality of concentric circles with a predefined fill.

11. The method of claim 1, wherein:

the one or more of the plurality of lines that are representative of fingerprint ridges comprise a plurality of progress-indicator portions that correspond to fingerprint portions of the respective fingerprint; and

when fingerprint information from a respective fingerprint portion is collected, an appearance of the corresponding progress-indicator portion is changed to indicate that fingerprint information from the respective fingerprint portion has been collected.

12. The method of claim 11, including, after changing the appearance of the plurality of progress-indicator portions, in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area, changing the appearance of one or more unchanged progress-indicator portions to match the appearance of the plurality of progress-indicator portions.

13. The method of claim 1, further comprising:

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes fingerprint images with a predefined degree of contiguousness;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area and fingerprint images with the predefined degree of contiguousness, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area or fingerprint images with the predefined degree of contiguousness, displaying the message in the fingerprint enrollment interface prompting the user to perform the one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

14. The method of claim 1, further comprising:

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes fingerprint images of a predetermined quality;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area and fingerprint images of a predetermined quality, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area or fingerprint images of a predetermined quality, displaying the message in the fingerprint enrollment interface prompting the user to perform the one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

15. The method of claim 1, wherein the display is used as the fingerprint sensor.

16. An electronic device, comprising:

a display;

a fingerprint sensor;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

while a finger is not detected on the fingerprint sensor, displaying a fingerprint enrollment interface that includes a fingerprint representation that includes a plurality of lines that are representative of fingerprint ridges;

while displaying the fingerprint representation, detecting on the fingerprint sensor a plurality of separate and distinct stationary finger gestures performed with a respective finger;

in response to one or more of the separate and distinct stationary finger gestures performed with the respective finger;

updating an appearance of the fingerprint representation to change an appearance of one or more of the plurality of lines that are representative of fingerprint ridges that were displayed while the finger was not detected on the fingerprint sensor; and

collecting fingerprint information from the plurality of separate and distinct stationary finger gestures performed with the respective finger; and

after collecting the fingerprint information and updating the appearance of the fingerprint representation;

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes a predefined minimum amount of non-overlapping fingerprint area;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area, displaying a message in the fingerprint enrollment interface prompting a user to perform one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

17. The electronic device of claim 16, wherein fingerprint information from the plurality of separate and distinct stationary finger gestures is collected for an area of the fingerprint of the respective finger that is at least twice as large as the area that can be captured by the fingerprint sensor during a single stationary finger gesture.

18. The electronic device of claim 16, wherein the one or more programs further include instructions for:

after enrolling the fingerprint of the respective finger with the device;

receiving a request to perform a restricted operation and detecting a fingerprint on the fingerprint sensor; and

in response to receiving the request to perform the restricted operation;

in accordance with a determination that the fingerprint is enrolled with the device, performing the restricted operation; and

in accordance with a determination that the fingerprint is not enrolled with the device, forgoing performance of the restricted operation.

19. The electronic device of claim 16, wherein the message prompting the user to perform one or more additional finger gestures includes displayed instructions to perform subsequent finger gestures differently from the respective finger gesture.

20. The electronic device of claim 16, wherein the message prompting the user to perform one or more additional finger gestures includes an indication of one or more portions or locations of the respective fingerprint for which fingerprint information is inadequate or has not been collected.

21. The electronic device of claim 16, wherein the one or more programs further include instructions for:

while the respective finger is on the fingerprint sensor during a respective stationary gesture;

collecting fingerprint information; and

after the fingerprint information has been collected, providing haptic feedback at the device to indicate that the fingerprint information has been collected.

22. The electronic device of claim 16, wherein the one or more programs further include instructions for:

after enrolling the fingerprint of the respective finger with the device;

displaying a fingerprint settings interface with a plurality of entries that correspond to respective enrolled fingerprints, wherein the plurality of entries includes a respective entry that corresponds to the fingerprint of the respective finger and one or more other entries that correspond to other enrolled fingerprints of other fingers besides the respective finger;

detecting a second finger gesture on the fingerprint sensor that corresponds to the fingerprint of the respective finger; and

in response to detecting the second finger gesture, highlighting the respective entry that corresponds to the fingerprint of the respective finger.

23. The electronic device of claim 16, wherein the fingerprint representation includes a portion of a surface of a three-dimensional object.

24. The electronic device of claim 16, wherein changing the appearance of the one or more of the plurality of lines that are representative of fingerprint ridges includes coloring in a portion of the plurality of lines that are representative of fingerprint ridges.

25. The electronic device of claim 16, wherein the fingerprint enrollment interface includes a plurality of concentric circles, and the one or more programs further include instructions for:

in response to the one or more of the separate and distinct stationary finger gestures performed with the respective finger, filling in one of the plurality of concentric circles with a predefined fill.

26. The electronic device of claim 16, wherein:

the one or more of the plurality of lines that are representative of fingerprint ridges comprise a plurality of progress-indicator portions that correspond to fingerprint portions of the respective fingerprint; and

when fingerprint information from a respective fingerprint portion is collected, an appearance of the corresponding progress-indicator portion is changed to indicate that fingerprint information from the respective fingerprint portion has been collected.

27. The electronic device of claim 26, wherein the one or more programs further include instructions for:

after changing the appearance of the plurality of progress-indicator portions, in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area, changing the appearance of one or more unchanged progress-indicator portions to match the appearance of the plurality of progress-indicator portions.

28. The electronic device of claim 16, wherein the one or more programs further include instructions for:

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes fingerprint images with a predefined degree of contiguousness;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area and fingerprint images with the predefined degree of contiguousness, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area or fingerprint images with the predefined degree of contiguousness, displaying the message in the fingerprint enrollment interface prompting the user to perform the one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

29. The electronic device of claim 16, wherein the one or more programs further include instructions for:

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes fingerprint images of a predetermined quality;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area and fingerprint images of a predetermined quality, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area or fingerprint images of a predetermined quality, displaying the message in the fingerprint enrollment interface prompting the user to perform the one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

30. The electronic device of claim 16, wherein the display is used as the fingerprint sensor.

31. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a fingerprint sensor, cause the device to:

while a finger is not detected on the fingerprint sensor, display a fingerprint enrollment interface that includes a fingerprint representation that includes a plurality of lines that are representative of fingerprint ridges;

while displaying the fingerprint representation, detect on the fingerprint sensor a plurality of separate and distinct stationary finger gestures performed with a respective finger;

in response to one or more of the separate and distinct stationary finger gestures performed with the respective finger;

update an appearance of the fingerprint representation to change an appearance of one or more of the plurality of lines that are representative of fingerprint ridges that were displayed while the finger was not detected on the fingerprint sensor; and

collect fingerprint information from the plurality of separate and distinct stationary finger gestures performed with the respective finger; and

after collecting the fingerprint information and updating the appearance of the fingerprint representation;

determine, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes a predefined minimum amount of non-overlapping fingerprint area;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area, enroll the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area, display a message in the fingerprint enrollment interface prompting a user to perform one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

32. The medium of claim 31, wherein fingerprint information from the plurality of separate and distinct stationary finger gestures is collected for an area of the fingerprint of the respective finger that is at least twice as large as the area that can be captured by the fingerprint sensor during a single stationary finger gesture.

33. The medium of claim 31, wherein the one or more programs further comprise instructions for:

after enrolling the fingerprint of the respective finger with the device;

receiving a request to perform a restricted operation and detecting a fingerprint on the fingerprint sensor; and

in response to receiving the request to perform the restricted operation;

in accordance with a determination that the fingerprint is enrolled with the device, performing the restricted operation; and

in accordance with a determination that the fingerprint is not enrolled with the device, forgoing performance of the restricted operation.

34. The medium of claim 31, wherein the message prompting the user to perform one or more additional finger gestures includes displayed instructions to perform subsequent finger gestures differently from the respective finger gesture.

35. The medium of claim 31, wherein the message prompting the user to perform one or more additional finger gestures includes an indication of one or more portions or locations of the respective fingerprint for which fingerprint information is inadequate or has not been collected.

36. The medium of claim 31, wherein the one or more programs further comprise instructions for:

while the respective finger is on the fingerprint sensor during a respective stationary gesture;

collecting fingerprint information; and

after the fingerprint information has been collected, providing haptic feedback at the device to indicate that the fingerprint information has been collected.

37. The medium of claim 31, wherein the one or more programs further comprise instructions for:

after enrolling the fingerprint of the respective finger with the device;

displaying a fingerprint settings interface with a plurality of entries that correspond to respective enrolled fingerprints, wherein the plurality of entries includes a respective entry that corresponds to the fingerprint of the respective finger and one or more other entries that correspond to other enrolled fingerprints of other fingers besides the respective finger;

detecting a second finger gesture on the fingerprint sensor that corresponds to the fingerprint of the respective finger; and

in response to detecting the second finger gesture, highlighting the respective entry that corresponds to the fingerprint of the respective finger.

38. The medium of claim 31, wherein the fingerprint representation includes a portion of a surface of a three-dimensional object.

39. The medium of claim 31, wherein

changing the appearance of the one or more of the plurality of lines that are representative of fingerprint ridges includes coloring in a portion of the plurality of lines that are representative of fingerprint ridges.

40. The medium of claim 31, wherein the fingerprint enrollment interface includes a plurality of concentric circles, and the one or more programs further comprise instructions for:

in response to the one or more of the separate and distinct stationary finger gestures performed with the respective finger, filling in one of the plurality of concentric circles with a predefined fill.

41. The medium of claim 31, wherein:

the one or more of the plurality of lines that are representative of fingerprint ridges comprise a plurality of progress-indicator portions that correspond to fingerprint portions of the respective fingerprint; and

when fingerprint information from a respective fingerprint portion is collected, an appearance of the corresponding progress-indicator portion is changed to indicate that fingerprint information from the respective fingerprint portion has been collected.

42. The medium of claim 41, wherein the one or more programs further comprise instructions for:

after changing the appearance of the plurality of progress-indicator portions, in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area, changing the appearance of one or more unchanged progress-indicator portions to match the appearance of the plurality of progress-indicator portions.

43. The medium of claim 31, wherein the one or more programs further comprise instructions for:

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes fingerprint images with a predefined degree of contiguousness;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area and fingerprint images with the predefined degree of contiguousness, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area or fingerprint images with the predefined degree of contiguousness, displaying the message in the fingerprint enrollment interface prompting the user to perform the one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

44. The medium of claim 31, wherein the one or more programs further comprise instructions for:

determining, based on the fingerprint information collected for the respective finger, whether the fingerprint information that has been collected includes fingerprint images of a predetermined quality;

in accordance with a determination that the fingerprint information that has been collected for the respective finger includes the predefined minimum amount of non-overlapping fingerprint area and fingerprint images of a predetermined quality, enrolling the fingerprint of the respective finger with the device; and

in accordance with a determination that the fingerprint information that has been collected for the respective finger does not include the predefined minimum amount of non-overlapping fingerprint area or fingerprint images of a predetermined quality, displaying the message in the fingerprint enrollment interface prompting the user to perform the one or more additional stationary finger gestures on the fingerprint sensor with the respective finger.

45. The medium of claim 31, wherein the display is used as the fingerprint sensor.