Devices, Methods, and Graphical User Interfaces for Manipulating User Interface Objects with Visual and/or Haptic Feedback

• US 20160259528A1
• Filed: 09/30/2015
• Published: 09/08/2016
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bauer, Sebastian J., Gutknecht, Olivier D.R., Hajas, Peter L., Jurewitz, Michael T., Foss, Christopher P., Anzures, Freddy A., Chaudhri, Imran A., Dascola, Jonathan R., Karunamuni, Chanaka G., Lemay, Stephen O., Wan, Wan Si, Yerkes, Giancarlo
• Granted Patent: US 10,180,772 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts: displays a first user interface that includes objects of a first type and objects of a second type; detects a first portion of a first input that includes an increase in characteristic intensity of a first contact above an intensity threshold while a focus selector is over a respective user interface object; in response, displays supplemental information associated with the respective user interface object; while displaying the supplemental information, detects an end of the first input; and, in response: if the respective user interface object is the first type of object, ceases to display the supplemental information; and, if the respective user interface object is the second type of object, maintains display of the supplemental information after detecting the end of the first input.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more sensors for detecting intensity of contacts on the touch-sensitive surface;

displaying, on the display, a first user interface that includes a plurality of selectable user interface objects, including one or more user interface objects of a first type and one or more user interface objects of a second type that is distinct from the first type;

while displaying the first user interface on the display, detecting a first portion of a first input that includes detecting an increase in a characteristic intensity of a first contact on the touch-sensitive surface above a first intensity threshold while a focus selector is over a respective user interface object of the plurality of selectable user interface objects;

in response to detecting the first portion of the first input, displaying supplemental information associated with the respective user interface object;

while displaying the supplemental information associated with the respective user interface object, detecting an end of the first input; and

,

in response to detecting the end of the first input;

in accordance with a determination that the respective user interface object is the first type of user interface object, ceasing to display the supplemental information associated with the respective user interface object; and

,

in accordance with a determination that the respective user interface object is the second type of user interface object, maintaining display of the supplemental information associated with the respective user interface object after detecting the end of the first input.

2. The method of claim 1, wherein, when the respective user interface object is the first type of user interface object, the supplemental information includes a preview of a second user interface, distinct from the first user interface, that is displayed upon selection of the respective user interface object in the first user interface.

3. The method of claim 1, wherein, when the respective user interface object is the second type of user interface object, the supplemental information includes a first menu of actions that are associated with the respective user interface object.

4. The method of claim 1, including:

detecting a second portion of the first input after the first portion of the first input and before the end of the first input, wherein detecting the second portion of the first input includes detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold without detecting liftoff of the contact from the touch-sensitive surface; and

,

in response to detecting the second portion of the first input, maintaining display of the supplemental information associated with the respective user interface object.

5. The method of claim 1, including:

after detecting the end of the first input and ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the focus selector is over the respective user interface object;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting an increase in the characteristic intensity of the second contact on the touch-sensitive surface above a second intensity threshold; and

,

in response to detecting the second portion of the second input;

in accordance with a determination that the respective user interface object is the first type of user interface object, replacing display of the first user interface and the supplemental information with a second user interface; and

,

in accordance with a determination that the respective user interface object is the second type of user interface object, maintaining display the supplemental information associated with the respective user interface object.

6. The method of claim 1, including:

after detecting the end of the first input and ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the focus selector is over the respective user interface object;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting an increase in the characteristic intensity of the second contact on the touch-sensitive surface above a second intensity threshold; and

,

in response to detecting the second portion of the second input;

in accordance with a determination that the respective user interface object is the first type of user interface object, replacing display of the first user interface and the supplemental information with a second user interface, wherein the second user interface is also displayed upon selection of the respective user interface object in the first user interface; and

,

in accordance with a determination that the respective user interface object is the second type of user interface object, replacing display of the first user interface and the supplemental information with a third user interface, wherein the third user interface is different from a respective user interface that is displayed upon selection of the respective user interface object in the first user interface.

7. The method of claim 5, including:

in accordance with a determination that the increase in the characteristic intensity of the second contact is accompanied by a movement of the second contact, disabling replacement of the first user interface and the supplemental information with the second user interface.

8. The method of claim 1, including:

while displaying the supplemental information on the display and prior to detecting the end of the first input, detecting a second portion of the first input that includes movement of the first contact on the touch-sensitive surface; and

in response to detecting the second portion of the first portion of the input that includes the movement of the first contact;

in accordance with a determination that the respective user interface object is the first type of user interface object, moving the supplemental information in accordance with the movement of the first contact; and

in accordance with a determination that the respective user interface object is the second type of user interface object, maintaining a position of the supplemental information and highlighting a selectable object in the supplemental information in accordance with the movement of the first contact.

9. The method of claim 1, including:

after detecting the end of the first input and ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the focus selector is over the respective user interface object of the plurality of user interface objects;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting a movement of the second contact on the touch-sensitive surface that corresponds to a movement of the focus selector on the display; and

,

in response to detecting the second portion of the second input;

in accordance with a determination that the respective user interface object is the first type of user interface object, displaying one or more action items that are associated with the respective user interface object in the first user interface; and

,

in accordance with a determination that the respective user interface object is the second type of user interface object;

maintaining the redisplay of supplemental information associated with the respective user interface object; and

highlighting a respective portion of the redisplayed supplemental information.

10. The method of claim 9, including:

in response to detecting the first portion of the first input;

in accordance with the determination that the respective user interface object is the first type of user interface object, providing a first tactile output upon displaying the supplemental information associated with the respective user interface object; and

,

in accordance with the determination that the respective user interface object is the second type of user interface object, providing a second tactile output different from the first tactile output upon displaying the supplemental information associated with the respective user interface object.

11. The method of claim 10, including:

in accordance with the determination that the respective user interface object is the first type of user interface object, providing a third tactile output different from the second tactile output upon displaying the one or more action items associated with the respective user interface object.

12. The method of claim 9, wherein the respective user interface object is the first type of object, and the method includes:

while the supplemental information associated with the respective user interface object is displayed on the display and the one or more action items are not displayed;

in accordance with the determination that the respective user interface object is the first type of user interface object, displaying an indicator indicating that the one or more action items associated with the respective user interface object are hidden.

13. The method of claim 12, wherein the indicator is configured to represent a direction of movement of a contact that triggers display of the one or more action items associated with the respective user interface object.

14. The method of claim 9, wherein:

the respective user interface object is the first type of object;

the movement of the second contact on the touch-sensitive surface corresponds to a movement of the focus selector on the display in a respective direction; and

displaying the one or more action items that are associated with the respective user interface object in the first user interface includes;

shifting the supplemental information in the first direction on the display; and

revealing the one or more action items as the supplemental information is shifted in the first direction.

15. The method of claim 14, including:

after revealing the one or more action items;

continuing to shift the supplemental information in the first direction on the display in accordance with the movement of the second contact.

16. The method of claim 14, wherein displaying the one or more action items associated with the respective user interface object includes displaying a first action item associated with the respective user interface object, and wherein the method includes:

after displaying the first action item associated with the respective user interface object, detecting that the movement of the second contact corresponds to movement of the focus selector by at least a first threshold amount on the display before detecting lift-off of the second contact;

in response to detecting that the movement of the second contact corresponds to movement of the focus selector by at least the first threshold amount on the display, changing a visual appearance of the first action item;

detecting lift-off of the second contact after changing the visual appearance of the first action item; and

in response to detecting the lift-off of the second contact;

ceasing to display the first action item; and

performing a first action represented in the first action item.

17. The method of claim 1, wherein the respective user interface object is the first type of object, and the method includes:

detecting a second portion of the first input that includes movement in a respective direction; and

in response to detecting the end of the first input;

in accordance with a determination that the movement in the respective direction meets a respective movement threshold, performing an operation associated with movement in the respective direction; and

in accordance with a determination that the movement in the respective direction does not meet the respective movement threshold, forgoing performance of the operation associated with movement in the respective direction.

18. The method of claim 17, wherein movement of the focus selector in a first direction is associated with a first action and movement of the focus selector in a second direction is associated with a second action.

19. The method of claim 18, wherein movement of the focus selector in the first direction is associated with a first threshold and movement of the focus selector in the second direction is associated with a second threshold that is higher than the first threshold.

20. The method of claim 1, including:

after ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a third input that includes detecting a third contact with the characteristic intensity below the first intensity threshold on the touch-sensitive surface and lift-off of the third contact while the focus selector is over the respective user interface object of the plurality of user interface objects; and

,

in response to detecting the third input, replacing the first user interface with a second user interface associated with the respective user interface element.

21. The method of claim 1, wherein the first type of user interface object includes a link to a webpage or document.

22. The method of claim 1, wherein the second type of user interface object includes a representation of a contactable entity.

23. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensity of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a first user interface that includes a plurality of selectable user interface objects, including one or more user interface objects of a first type and one or more user interface objects of a second type that is distinct from the first type;

while displaying the first user interface on the display, detecting a first portion of a first input that includes detecting an increase in a characteristic intensity of a first contact on the touch-sensitive surface above a first intensity threshold while a focus selector is over a respective user interface object of the plurality of selectable user interface objects;

in response to detecting the first portion of the first input, displaying supplemental information associated with the respective user interface object;

while displaying the supplemental information associated with the respective user interface object, detecting an end of the first input; and

,

in response to detecting the end of the first input;

in accordance with a determination that the respective user interface object is the first type of user interface object, ceasing to display the supplemental information associated with the respective user interface object; and

,

in accordance with a determination that the respective user interface object is the second type of user interface object, maintaining display of the supplemental information associated with the respective user interface object after detecting the end of the first input.

24. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface cause the device to:

display, on the display, a first user interface that includes a plurality of selectable user interface objects, including one or more user interface objects of a first type and one or more user interface objects of a second type that is distinct from the first type;

while displaying the first user interface on the display, detect a first portion of a first input that includes detecting an increase in a characteristic intensity of a first contact on the touch-sensitive surface above a first intensity threshold while a focus selector is over a respective user interface object of the plurality of selectable user interface objects;

in response to detecting the first portion of the first input, display supplemental information associated with the respective user interface object;

while displaying the supplemental information associated with the respective user interface object, detect an end of the first input; and

,

in response to detecting the end of the first input;

in accordance with a determination that the respective user interface object is the first type of user interface object, cease to display the supplemental information associated with the respective user interface object; and

,

in accordance with a determination that the respective user interface object is the second type of user interface object, maintain display of the supplemental information associated with the respective user interface object after detecting the end of the first input.