Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

• US 10,268,342 B2
• Filed: 09/30/2015
• Issued: 04/23/2019
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Foss, Christopher P., Bauer, Sebastian J., Dascola, Jonathan R., Lemay, Stephen O., Wan, Wan Si, Alonso Ruiz, Marcos, Apodaca, Gregory M., Dye, Alan C., Ive, Jonathan, Karunamuni, Chanaka G., Kocienda, Kenneth L.
• Primary Examiner(s): Levy, Amy M
• Application Number:
  US14/870,882
• Publication Number:
  US 20160259498A1
• Time in Patent Office: 1,301 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface: displays a first user interface that includes a plurality of selectable objects; while a focus selector is at a location that corresponds to a respective selectable object, detects an input that includes detecting a contact on the touch-sensitive surface; and in response to detecting the input: in accordance with a determination that detecting the input includes detecting an increase in intensity of the contact that meets intensity criteria, displays a menu that includes contact information for the respective selectable object overlaid on top of the first user interface; and in accordance with a determination that detecting the input includes detecting a liftoff of the contact without meeting the intensity criteria, replaces display of the first user interface with display of a second user interface.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensities of contacts with the touch-sensitive surface;

displaying, on the display, a first user interface that includes a plurality of selectable objects that are associated with contactable entity information;

while displaying the plurality of selectable objects and while a focus selector is at a location that corresponds to a respective selectable object, wherein the respective selectable object occupies a portion of a second selectable object, detecting a first input that includes detecting a contact on the touch-sensitive surface; and

in response to detecting the first input;

in accordance with a determination that detecting the first input includes detecting an increase in intensity of the contact that meets intensity criteria, the intensity criteria including a criterion that is met when a characteristic intensity of the contact increases above a respective intensity threshold, displaying a menu for the respective selectable object that includes the contactable entity information for the respective selectable object overlaid on top of the first user interface that includes the plurality of selectable objects; and

in accordance with a determination that detecting the first input includes detecting a liftoff of the contact without meeting the intensity criteria, replacing display of the first user interface that includes the plurality of selectable objects with display of a second user interface that is associated with the respective selectable object;

after detecting an end of the first input, while displaying the plurality of selectable objects and while a focus selector is at a respective location that corresponds to a respective portion of the second selectable object, detecting a second input that includes detecting an increase in a characteristic intensity of a second contact above the respective intensity threshold on the touch-sensitive surface; and

,

in response to detecting the second input;

in accordance with a determination that the respective location corresponds to the respective selectable object, displaying the menu for the respective selectable object that includes the contactable entity for the respective selectable object overlaid on top of the first user interface that includes the plurality of selectable objects; and

,

in accordance with a determination that the respective location corresponds to a portion of the second selectable object other than the respective selectable object, displaying content associated with the second selectable object that is different from the menu for the respective selectable object.

2. The method of claim 1, including:

in response to detecting the first input;

in accordance with the determination that detecting the first input includes detecting an increase in intensity of the contact that meets the intensity criteria, displaying, in addition to the menu, descriptive information describing the respective selectable object.

3. The method of claim 1, including:

applying a visual effect to obscure the first user interface that includes the plurality of selectable objects while displaying the menu.

4. The method of claim 1, including:

while displaying the menu for the respective selectable object, detecting a predefined dismissal gesture directed to a location outside of the menu on the first user interface; and

in response to detecting the predefined dismissal gesture;

ceasing to display the menu for the respective selectable object; and

restoring display of the first user interface that includes the plurality of selectable objects.

5. The method of claim 1, wherein the menu includes one or more communication objects, and wherein the method includes:

while the contact on the touch-sensitive surface is maintained, detecting movement of the contact on the touch-sensitive surface that corresponds to movement of the focus selector to a respective communication object of the one or more communication objects on the display;

while the focus selector is on the respective communication object, detecting a portion of the first input that meets selection criteria; and

in response to detecting the portion of the first input that meets the selection criteria, initiating a communication function corresponding to the respective communication object.

6. The method of claim 5, wherein the portion of the first input that meets the selection criteria is a terminal portion of the first input.

7. The method of claim 5, wherein the portion of the first input that meets the selection criteria corresponds to a change in intensity of the contact.

8. The method of claim 5, wherein initiating the communication function corresponding to the respective communication object includes initiating a communication corresponding to the respective communication object.

9. The method of claim 5, wherein initiating the communication function corresponding to the respective communication object in response to detecting the portion of the first input that meets the selection criteria includes:

in response to detecting the portion of the first input that meets the selection criteria;

in accordance with a determination that the focus selector is located at a first portion of the respective communication object, initiating a communication with a default option among a plurality of options associated with the respective communication object for the respective selectable object; and

in accordance with a determination that the focus selector is located at a second portion of the respective communication object, displaying the plurality of options associated with the respective communication object for the respective selectable object.

10. The method of claim 9, wherein the plurality of options associated with the respective communication object expand out from the respective communication object.

11. The method of claim 9, including:

detecting selection of a respective option of the plurality of options associated with the respective communication object; and

in response to detecting the selection of the respective option, initiating a communication corresponding to the respective option.

12. The method of claim 1, wherein the contactable entity information includes one or more of:

one or more phone numbers, one or more email addresses, one or more geographic addresses, and one or more messaging contact addresses or identities.

13. The method of claim 1, wherein the plurality of selectable objects that are associated with contactable entity information include representations of users associated with the contactable entity information.

14. The method of claim 1, wherein the respective selectable object is an avatar, and the method includes:

in accordance with the determination that detecting the first input includes detecting an increase in intensity of the contact that meets the intensity criteria, displaying a magnified version of the avatar within the menu.

15. The method of claim 1, wherein the plurality of selectable objects that are associated with contactable entity information include representations of locations associated with the contactable entity information.

16. The method of claim 1, wherein the menu includes a header, wherein the header includes additional information about the respective selectable object.

17. The method of claim 1, wherein displaying content associated with the second selectable object that is different from the menu for the respective selectable object includes:

in accordance with a determination that a first portion of the second input meets preview criteria, displaying a preview area overlaid on at least some of the plurality of selectable objects in the first user interface, wherein the preview area includes a reduced scale representation of the second user interface;

in accordance with a determination that a second portion of the second input, detected after the first portion of the second input, meets user-interface-replacement criteria, replacing display of the first user interface and the overlaid preview area with display of the second user interface; and

in accordance with a determination that the second portion of the second input meets preview-area-disappearance criteria, ceasing to display the preview area and displaying the first user interface after the second input ends.

18. The method of claim 17, wherein determining that the first portion of the second input meets preview criteria includes detecting that the characteristic intensity of the second contact during the first portion of the second input increases to a first intensity threshold.

19. The method of claim 18, wherein determining that the second portion of the second input meets user-interface-replacement criteria includes detecting that the characteristic intensity of the second contact during the second portion of the second input increases to a second intensity threshold, greater than the first intensity threshold.

20. The method of claim 17, wherein determining that the second portion of the second input meets preview-area-disappearance criteria includes detecting a liftoff of the second contact without meeting the user-interface-replacement criteria during the second portion of the second input.

21. The method of claim 17, including:

applying a visual effect to obscure the first user interface while displaying the preview area.

22. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensities of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a first user interface that includes a plurality of selectable objects that are associated with contactable entity information;

while displaying the plurality of selectable objects and while a focus selector is at a location that corresponds to a respective selectable object, wherein the respective selectable object occupies a portion of a second selectable object, detecting a first input that includes detecting a contact on the touch-sensitive surface; and

in response to detecting the first input;

in accordance with a determination that detecting the first input includes detecting an increase in intensity of the contact that meets intensity criteria, the intensity criteria including a criterion that is met when a characteristic intensity of the contact increases above a respective intensity threshold, displaying a menu for the respective selectable object that includes the contactable entity information for the respective selectable object overlaid on top of the first user interface that includes the plurality of selectable objects; and

in accordance with a determination that detecting the first input includes detecting a liftoff of the contact without meeting the intensity criteria, replacing display of the first user interface that includes the plurality of selectable objects with display of a second user interface that is associated with the respective selectable object;

after detecting an end of the first input, while displaying the plurality of selectable objects and while a focus selector is at a respective location that corresponds to a respective portion of the second selectable object, detecting a second input that includes detecting an increase in a characteristic intensity of a second contact above the respective intensity threshold on the touch-sensitive surface; and

,

in response to detecting the second input;

in accordance with a determination that the respective location corresponds to the respective selectable object, displaying the menu for the respective selectable object that includes the contactable entity for the respective selectable object overlaid on top of the first user interface that includes the plurality of selectable objects; and

,

in accordance with a determination that the respective location corresponds to a portion of the second selectable object other than the respective selectable object, displaying content associated with the second selectable object that is different from the menu for the respective selectable object.

23. The device of claim 22, including instructions for:

in response to detecting the first input;

in accordance with the determination that detecting the first input includes detecting an increase in intensity of the contact that meets the intensity criteria, displaying, in addition to the menu, descriptive information describing the respective selectable object.

24. The device of claim 22, including instructions for:

applying a visual effect to obscure the first user interface that includes the plurality of selectable objects while displaying the menu.

25. The device of claim 22, including instructions for:

while displaying the menu for the respective selectable object, detecting a predefined dismissal gesture directed to a location outside of the menu on the first user interface; and

in response to detecting the predefined dismissal gesture;

ceasing to display the menu for the respective selectable object; and

restoring display of the first user interface that includes the plurality of selectable objects.

26. The device of claim 22, wherein the menu includes one or more communication objects, and wherein the device includes instructions for:

while the contact on the touch-sensitive surface is maintained, detecting movement of the contact on the touch-sensitive surface that corresponds to movement of the focus selector to a respective communication object of the one or more communication objects on the display;

while the focus selector is on the respective communication object, detecting a portion of the first input that meets selection criteria; and

in response to detecting the portion of the first input that meets the selection criteria, initiating a communication function corresponding to the respective communication object.

27. The device of claim 26, wherein the portion of the first input that meets the selection criteria is a terminal portion of the first input.

28. The device of claim 26, wherein the portion of the first input that meets the selection criteria corresponds to a change in intensity of the contact.

29. The device of claim 26, wherein initiating the communication function corresponding to the respective communication object includes initiating a communication corresponding to the respective communication object.

30. The device of claim 26, wherein initiating the communication function corresponding to the respective communication object in response to detecting the portion of the first input that meets the selection criteria includes:

in response to detecting the portion of the first input that meets the selection criteria;

in accordance with a determination that the focus selector is located at a first portion of the respective communication object, initiating a communication with a default option among a plurality of options associated with the respective communication object for the respective selectable object; and

in accordance with a determination that the focus selector is located at a second portion of the respective communication object, displaying the plurality of options associated with the respective communication object for the respective selectable object.

31. The device of claim 30, wherein the plurality of options associated with the respective communication object expand out from the respective communication object.

32. The device of claim 30, including instructions for:

detecting selection of a respective option of the plurality of options associated with the respective communication object; and

in response to detecting the selection of the respective option, initiating a communication corresponding to the respective option.

33. The device of claim 22, wherein the contactable entity information includes one or more of:

one or more phone numbers, one or more email addresses, one or more geographic addresses, and one or more messaging contact addresses or identities.

34. The device of claim 22, wherein the plurality of selectable objects that are associated with contactable entity information include representations of users associated with the contactable entity information.

35. The device of claim 22, wherein the respective selectable object is an avatar, and the device includes instructions for:

in accordance with the determination that detecting the first input includes detecting an increase in intensity of the contact that meets the intensity criteria, displaying a magnified version of the avatar within the menu.

36. The device of claim 22, wherein the plurality of selectable objects that are associated with contactable entity information include representations of locations associated with the contactable entity information.

37. The device of claim 22, wherein the menu includes a header, wherein the header includes additional information about the respective selectable object.

38. The device of claim 22, wherein displaying content associated with the second selectable object that is different from the menu for the respective selectable object includes:

in accordance with a determination that a first portion of the second input meets preview criteria, displaying a preview area overlaid on at least some of the plurality of selectable objects in the first user interface, wherein the preview area includes a reduced scale representation of the second user interface;

in accordance with a determination that a second portion of the second input, detected after the first portion of the second input, meets user-interface-replacement criteria, replacing display of the first user interface and the overlaid preview area with display of the second user interface; and

in accordance with a determination that the second portion of the second input meets preview-area-disappearance criteria, ceasing to display the preview area and displaying the first user interface after the second input ends.

39. The device of claim 38, wherein determining that the first portion of the second input meets preview criteria includes detecting that the characteristic intensity of the second contact during the first portion of the second input increases to a first intensity threshold.

40. The device of claim 39, wherein determining that the second portion of the second input meets user-interface-replacement criteria includes detecting that the characteristic intensity of the second contact during the second portion of the second input increases to a second intensity threshold, greater than the first intensity threshold.

41. The device of claim 38, wherein determining that the second portion of the second input meets preview-area-disappearance criteria includes detecting a liftoff of the second contact without meeting the user-interface-replacement criteria during the second portion of the second input.

42. The device of claim 38, including instructions for:

applying a visual effect to obscure the first user interface while displaying the preview area.

43. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensities of contacts with the touch-sensitive surface, cause the electronic device to:

display, on the display, a first user interface that includes a plurality of selectable objects that are associated with contactable entity information;

while displaying the plurality of selectable objects and while a focus selector is at a location that corresponds to a respective selectable object, wherein the respective selectable object occupies a portion of a second selectable object, detect a first input that includes detecting a contact on the touch-sensitive surface; and

in response to detecting the first input;

in accordance with a determination that detecting the first input includes detecting an increase in intensity of the contact that meets intensity criteria, the intensity criteria including a criterion that is met when a characteristic intensity of the contact increases above a respective intensity threshold, display a menu for the respective selectable object that includes the contactable entity information for the respective selectable object overlaid on top of the first user interface that includes the plurality of selectable objects; and

in accordance with a determination that detecting the first input includes detecting a liftoff of the contact without meeting the intensity criteria, replace display of the first user interface that includes the plurality of selectable objects with display of a second user interface that is associated with the respective selectable object;

after detecting an end of the first input, while displaying the plurality of selectable objects and while a focus selector is at a respective location that corresponds to a respective portion of the second selectable object, detect a second input that includes detecting an increase in a characteristic intensity of a second contact above the respective intensity threshold on the touch-sensitive surface; and

,

in response to detecting the second input;

in accordance with a determination that the respective location corresponds to the respective selectable object, display the menu for the respective selectable object that includes the contactable entity for the respective selectable object overlaid on top of the first user interface that includes the plurality of selectable objects; and

,

in accordance with a determination that the respective location corresponds to a portion of the second selectable object other than the respective selectable object, display content associated with the second selectable object that is different from the menu for the respective selectable object.

44. The computer readable storage medium of claim 43, including instructions which, when executed by the electronic device, cause the electronic device to:

in response to detecting the first input;

in accordance with the determination that detecting the first input includes detecting an increase in intensity of the contact that meets the intensity criteria, display, in addition to the menu, descriptive information describing the respective selectable object.

45. The computer readable storage medium of claim 43, including instructions which, when executed by the electronic device, cause the electronic device to:

apply a visual effect to obscure the first user interface that includes the plurality of selectable objects while displaying the menu.

46. The computer readable storage medium of claim 43, including instructions which, when executed by the electronic device, cause the electronic device to:

while displaying the menu for the respective selectable object, detect a predefined dismissal gesture directed to a location outside of the menu on the first user interface; and

in response to detecting the predefined dismissal gesture;

cease to display the menu for the respective selectable object; and

restore display of the first user interface that includes the plurality of selectable objects.

47. The computer readable storage medium of claim 43, wherein the menu includes one or more communication objects, and wherein the computer readable storage medium includes instructions which, when executed by the electronic device, cause the electronic device to:

while the contact on the touch-sensitive surface is maintained, detect movement of the contact on the touch-sensitive surface that corresponds to movement of the focus selector to a respective communication object of the one or more communication objects on the display;

while the focus selector is on the respective communication object, detect a portion of the first input that meets selection criteria; and

,

in response to detecting the portion of the first input that meets the selection criteria, initiate a communication function corresponding to the respective communication object.

48. The computer readable storage medium of claim 47, wherein the portion of the first input that meets the selection criteria is a terminal portion of the first input.

49. The computer readable storage medium of claim 47, wherein the portion of the first input that meets the selection criteria corresponds to a change in intensity of the contact.

50. The computer readable storage medium of claim 47, wherein initiating the communication function corresponding to the respective communication object includes initiating a communication corresponding to the respective communication object.

51. The computer readable storage medium of claim 47, wherein initiating the communication function corresponding to the respective communication object in response to detecting the portion of the first input that meets the selection criteria includes:

in response to detecting the portion of the first input that meets the selection criteria;

in accordance with a determination that the focus selector is located at a first portion of the respective communication object, initiating a communication with a default option among a plurality of options associated with the respective communication object for the respective selectable object; and

in accordance with a determination that the focus selector is located at a second portion of the respective communication object, displaying the plurality of options associated with the respective communication object for the respective selectable object.

52. The computer readable storage medium of claim 51, wherein the plurality of options associated with the respective communication object expand out from the respective communication object.

53. The computer readable storage medium of claim 51, including instructions which, when executed by the electronic device, cause the electronic device to:

detect selection of a respective option of the plurality of options associated with the respective communication object; and

in response to detecting the selection of the respective option, initiate a communication corresponding to the respective option.

54. The computer readable storage medium of claim 43, wherein the contactable entity information includes one or more of:

one or more phone numbers, one or more email addresses, one or more geographic addresses, and one or more messaging contact addresses or identities.

55. The computer readable storage medium of claim 43, wherein the plurality of selectable objects that are associated with contactable entity information include representations of users associated with the contactable entity information.

56. The computer readable storage medium of claim 43, wherein the respective selectable object is an avatar, and the computer readable storage medium includes instructions which, when executed by the electronic device, cause the electronic device to:

in accordance with the determination that detecting the first input includes detecting an increase in intensity of the contact that meets the intensity criteria, display a magnified version of the avatar within the menu.

57. The computer readable storage medium of claim 43, wherein the plurality of selectable objects that are associated with contactable entity information include representations of locations associated with the contactable entity information.

58. The computer readable storage medium of claim 43, wherein the menu includes a header, wherein the header includes additional information about the respective selectable object.

59. The computer readable storage medium of claim 43, wherein displaying content associated with the second selectable object that is different from the menu for the respective selectable object includes:

in accordance with a determination that a first portion of the second input meets preview criteria, displaying a preview area overlaid on at least some of the plurality of selectable objects in the first user interface, wherein the preview area includes a reduced scale representation of the second user interface;

in accordance with a determination that a second portion of the second input, detected after the first portion of the second input, meets user-interface-replacement criteria, replacing display of the first user interface and the overlaid preview area with display of the second user interface; and

in accordance with a determination that the second portion of the second input meets preview-area-disappearance criteria, ceasing to display the preview area and displaying the first user interface after the second input ends.

60. The computer readable storage medium of claim 59, wherein determining that the first portion of the second input meets preview criteria includes detecting that the characteristic intensity of the second contact during the first portion of the second input increases to a first intensity threshold.

61. The computer readable storage medium of claim 60, wherein determining that the second portion of the second input meets user-interface-replacement criteria includes detecting that the characteristic intensity of the second contact during the second portion of the second input increases to a second intensity threshold, greater than the first intensity threshold.

62. The computer readable storage medium of claim 59, wherein determining that the second portion of the second input meets preview-area-disappearance criteria includes detecting a liftoff of the second contact without meeting the user-interface-replacement criteria during the second portion of the second input.

63. The computer readable storage medium of claim 59, including instructions which, when executed by the electronic device, cause the electronic device to:

apply a visual effect to obscure the first user interface while displaying the preview area.