Devices, Methods, and Graphical User Interfaces for Manipulating User Interface Objects with Visual and/or Haptic Feedback

• US 20160259519A1
• Filed: 09/30/2015
• Published: 09/08/2016
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Jisrawi, Mohammed N., Foss, Christopher P., Alonso Ruiz, Marcos, Apodaca, Gregory M., Bauer, Sebastian J., Dascola, Jonathan R., Dye, Alan C., Gutknecht, Olivier D.R., Ive, Jonathan, Jurewitz, Michael T., Karunamuni, Chanaka G., Moussette, Camille, Wan, Wan Si
• Granted Patent: US 9,645,709 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts: displays user interface objects in a first user interface; detects an input by a contact while a focus selector is over a first user interface object; if the input meets selection criteria, displays a second user interface; if a first portion of the input meets preview criteria, displays a preview area overlaid on at least some of the user interface objects, wherein the preview area includes a reduced scale representation of the second user interface; if a second portion of the input meets user-interface-replacement criteria, replaces display of the first user interface and the overlaid preview area with display of the second user interface; and, if the second portion of the input meets preview-area-disappearance criteria, ceases to display the preview area and displays the first user interface after the input ends.

Claims

1. A method, comprising:

at an electronic device with a touch-sensitive surface and a display, wherein the device includes one or more sensors to detect intensity of contacts with the touch-sensitive surface;

displaying a plurality of user interface objects in a first user interface on the display;

detecting an input by a contact while a focus selector is over a first user interface object, in the plurality of user interface objects, on the display;

in accordance with a determination that the input meets selection criteria, displaying a second user interface that is distinct from the first user interface in response to detecting the input;

in accordance with a determination that a first portion of the input meets preview criteria, displaying a preview area overlaid on at least some of the plurality of user interface objects in the first user interface in response to detecting the first portion of the input, wherein the preview area includes a reduced scale representation of the second user interface;

in accordance with a determination that a second portion of the input by the contact, detected after the first portion of the input, meets user-interface-replacement criteria, replacing display of the first user interface and the overlaid preview area with display of the second user interface; and

,

in accordance with a determination that the second portion of the input by the contact meets preview-area-disappearance criteria, ceasing to display the preview area and displaying the first user interface after the input ends.

2. The method of claim 1, wherein determining that the first portion of the input meets preview criteria includes, while the focus selector is over the first user interface object, in the plurality of user interface objects, on the display, detecting the characteristic intensity of the contact increase to a second intensity threshold.

3. The method of claim 1, including:

in accordance with a determination that the second portion of the input by the contact meets preview-area-maintenance criteria, maintaining display of the preview area overlaid on at least some of the plurality of user interface objects in the first user interface, after the input ends.

4. The method of claim 1, including:

in accordance with a determination that the first portion of the input meets hint criteria prior to meeting the preview criteria, visually obscuring the plurality of user interface objects other than the first user interface object in the first user interface.

5. The method of claim 4, wherein displaying the preview area overlaid on at least some of the plurality of user interface objects in the first user interface in response to detecting the first portion of the input includes displaying an animation in which the plurality of user interface objects other than the first user interface object in the first user interface are further obscured.

6. The method of claim 4, wherein determining that the first portion of the input meets hint criteria includes, while the focus selector is over the first user interface object, in the plurality of user interface objects, on the display, detecting the characteristic intensity of the contact increase to a first intensity threshold.

7. The method of claim 1, including:

while detecting the first portion of the input and displaying the preview area;

detecting the characteristic intensity of the contact changing over time; and

,

in response to detecting the characteristic intensity of the contact changing over time, dynamically changing the size of the preview area in accordance with changes in the characteristic intensity of the contact.

8. The method of claim 1, wherein the user-interface-replacement criteria include a requirement that the characteristic intensity of the contact increases to a third intensity threshold, greater than a second intensity threshold, during the second portion of the input.

9. The method of claim 1, wherein the user-interface-replacement criteria include a requirement that the characteristic intensity of the contact, during the second portion of the input, decreases below a second intensity threshold and then increases again to at least the second intensity threshold.

10. The method of claim 1, wherein the user-interface-replacement criteria include a requirement that the characteristic intensity of the contact increase at or above a predetermined rate during the second portion of the input.

11. The method of claim 1, wherein the user-interface-replacement criteria include a requirement that an increase in the characteristic intensity of the contact during the second portion of the input is not accompanied by a movement of the contact.

12. The method of claim 3, wherein the preview-area-maintenance criteria include a requirement that the second portion of the input include movement of the contact across the touch-sensitive surface that moves the focus selector in a predefined direction on the display.

13. The method of claim 3, wherein the preview-area-maintenance criteria include a requirement that action icons are displayed in the preview area during the second portion of the input.

14. The method of claim 1, wherein the preview-area-disappearance criteria include a requirement that no action icons are displayed in the preview area during the second portion of the input.

15. The method of claim 1, wherein the preview-area-disappearance criteria include a requirement that the user-interface-replacement criteria are not satisfied and a requirement that the preview-area-maintenance criteria are not satisfied.

16. The method of claim 1, including:

in accordance with a determination that the second portion of the input by the contact includes movement of the contact across the touch-sensitive surface, moving the preview area in accordance with the movement of the contact.

17. The method of claim 1, including:

in accordance with a determination that the second portion of the input by the contact includes movement of the contact across the touch-sensitive surface;

moving the focus selector in accordance with the movement of the contact; and

displaying one or more action items that are associated with the first user interface object.

18. The method of claim 1, including:

in accordance with a determination that the first portion of the input meets preview criteria, providing a tactile output indicative of display of the one or more action items in conjunction with displaying the preview area.

19. The method of claim 17, including:

providing a tactile output indicative of display of the one or more action items, wherein the tactile output indicative of display of the one or more action items is different from the first tactile output indicative of displaying the preview area and the tactile output indicative of display of the one or more action items is provided in conjunction with displaying the one or more action items associated with the first user interface object.

20. The method of claim 1, including:

in accordance with a determination that the second portion of the input by the contact, detected after the first portion of the input, meets user-interface-replacement criteria, providing a tactile output indicative of replacement of the first user interface, wherein the tactile output is provided in conjunction with replacing display of the first user interface and the overlaid preview area with display of the second user interface.

21. The method of claim 17, including:

while the preview area is displayed on the display and the one or more action items are not displayed;

displaying an indicator indicating that the one or more action items associated with the first user interface object are hidden.

22. The method of claim 21, wherein the indicator is configured to represent a direction of movement of a focus selector that triggers display of the one or more action items associated with the first user interface object.

23. The method of claim 17, wherein:

the movement of the contact across the touch-sensitive surface causes a movement of the focus selector on the display in a first direction; and

displaying the one or more action items that are associated with the first user interface object includes;

shifting the preview area in the first direction on the display; and

revealing the one or more action items as the preview area is shifted in the first direction.

24. The method of claim 23, including:

after revealing the one or more action items;

continuing to shift the preview area in the first direction on the display in accordance with the movement of the contact.

25. The method of claim 23, wherein displaying the one or more action items associated with the first user interface object includes displaying a first action item associated with the first user interface object, and the method includes:

while displaying the first action item associated with the first user interface object, detecting that the movement of the contact causes the focus selector to move at least a first threshold amount on the display before detecting lift-off of the contact;

in response to detecting that the movement of the contact causes the focus selector to move at least the first threshold amount on the display, changing a visual appearance of the first action item;

detecting lift-off of the contact after changing the visual appearance of the first action item; and

,

in response to detecting the lift-off of the contact;

ceasing to display the first action item; and

performing a first action represented by the first action item.

26. The method of claim 1, including:

in accordance with a determination that the second portion of the input by the contact includes movement of the contact across the touch-sensitive surface that moves the focus selector in a respective direction and that meets a respective movement threshold, performing an operation associated with movement in the respective direction in response to detecting the end of the input; and

in accordance with a determination that the second portion of the input by the contact includes movement of the contact across the touch-sensitive surface that moves the focus selector in the respective direction and that does not meet the respective movement threshold, forgoing performing the operation associated with movement in the respective direction in response to detecting the end of the input.

27. The method of claim 26, wherein movement of the focus selector in a first direction is associated with a first action and movement of the focus selector in a second direction is associated with a second action.

28. The method of claim 27, wherein movement of the focus selector in the first direction is associated with a first threshold and movement of the focus selector in the second direction is associated with a second threshold that is higher than the first threshold.

29. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensity of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a plurality of user interface objects in a first user interface on the display;

detecting an input by a contact while a focus selector is over a first user interface object, in the plurality of user interface objects, on the display;

in accordance with a determination that the input meets selection criteria, displaying a second user interface that is distinct from the first user interface in response to detecting the input;

in accordance with a determination that a first portion of the input meets preview criteria, displaying a preview area overlaid on at least some of the plurality of user interface objects in the first user interface in response to detecting the first portion of the input, wherein the preview area includes a reduced scale representation of the second user interface;

in accordance with a determination that a second portion of the input by the contact, detected after the first portion of the input, meets user-interface-replacement criteria, replacing display of the first user interface and the overlaid preview area with display of the second user interface; and

,

in accordance with a determination that the second portion of the input by the contact meets preview-area-disappearance criteria, ceasing to display the preview area and displaying the first user interface after the input ends.

30. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface cause the device to:

display a plurality of user interface objects in a first user interface on the display;

detect an input by a contact while a focus selector is over a first user interface object, in the plurality of user interface objects, on the display;

in accordance with a determination that the input meets selection criteria, display a second user interface that is distinct from the first user interface in response to detecting the input;

in accordance with a determination that a first portion of the input meets preview criteria, display a preview area overlaid on at least some of the plurality of user interface objects in the first user interface in response to detecting the first portion of the input, wherein the preview area includes a reduced scale representation of the second user interface;

in accordance with a determination that a second portion of the input by the contact, detected after the first portion of the input, meets user-interface-replacement criteria, replace display of the first user interface and the overlaid preview area with display of the second user interface; and

,

in accordance with a determination that the second portion of the input by the contact meets preview-area-disappearance criteria, cease to display the preview area and display the first user interface after the input ends.