Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

• US 10,180,772 B2
• Filed: 09/30/2015
• Issued: 01/15/2019
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Foss, Christopher P., Anzures, Freddy A., Bauer, Sebastian J., Chaudhri, Imran A., Dascola, Jonathan R., Gutknecht, Olivier D. R., Hajas, Peter L., Jurewitz, Michael T., Karunamuni, Chanaka G., Lemay, Stephen O., Wan, Wan Si, Yerkes, Giancarlo, Kocienda, Kenneth L.
• Primary Examiner(s): Levy, Amy M
• Application Number:
  US14/870,988
• Publication Number:
  US 20160259528A1
• Time in Patent Office: 1,203 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts: displays a first user interface that includes objects of a first type and objects of a second type; detects a first portion of a first input that includes an increase in characteristic intensity of a first contact above an intensity threshold while a focus selector is over a respective user interface object; in response, displays supplemental information associated with the respective user interface object; while displaying the supplemental information, detects an end of the first input; and, in response: if the respective user interface object is the first type of object, ceases to display the supplemental information; and, if the respective user interface object is the second type of object, maintains display of the supplemental information after detecting the end of the first input.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more sensors for detecting intensities of contacts on the touch-sensitive surface;

displaying, on the display, a first user interface that includes a plurality of selectable user interface objects;

while displaying the first user interface on the display, detecting a first portion of a first input that includes detecting an increase in a characteristic intensity of a first contact on the touch-sensitive surface above a first intensity threshold while the first contact is detected at a location on the touch-sensitive surface that corresponds to a respective user interface object of the plurality of selectable user interface objects, wherein the respective user interface object is associated with supplemental information;

in response to detecting the first portion of the first input, displaying supplemental information associated with the respective user interface object, wherein the supplemental information includes at least one of a menu with selectable options and a preview;

while displaying the supplemental information associated with the respective user interface object, detecting an end of the first input; and

,

in response to detecting the end of the first input;

in accordance with a determination that the displayed supplemental information is a preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object; and

,

in accordance with a determination that the displayed supplemental information includes a menu with selectable options corresponding to the respective user interface object, maintaining display of the supplemental information associated with the respective user interface object after detecting the end of the first input.

2. The method of claim 1, including:

detecting a second portion of the first input after the first portion of the first input and before the end of the first input, wherein detecting the second portion of the first input includes detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold without detecting liftoff of the contact from the touch-sensitive surface; and

,

in response to detecting the second portion of the first input, maintaining display of the supplemental information associated with the respective user interface object.

3. The method of claim 1, including:

after detecting the end of the first input and, in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the second contact is detected at a location on the touch-sensitive surface that corresponds to the respective user interface object;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting an increase in the characteristic intensity of the second contact on the touch-sensitive surface above a second intensity threshold; and

,

in response to detecting the second portion of the second input,

replacing display of the first user interface and the supplemental information with a second user interface.

4. The method of claim 1, including:

while displaying the supplemental information on the display and prior to detecting the end of the first input, detecting a second portion of the first input that includes movement of the first contact on the touch-sensitive surface; and

in response to detecting the second portion of the first input that includes the movement of the first contact;

in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, moving the supplemental information in accordance with the movement of the first contact; and

in accordance with a determination that the displayed supplemental information includes the menu with selectable options corresponding to the respective user interface object, maintaining a position of the supplemental information and highlighting a selectable option in the menu in accordance with the movement of the first contact.

5. The method of claim 1, including:

after detecting the end of the first input and, in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the second contact is detected at a location on the touch-sensitive surface that corresponds to the respective user interface object of the plurality of user interface objects;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting a movement of the second contact on the touch-sensitive surface; and

,

in response to detecting the second portion of the second input,

displaying a revealable menu with one or more action items that are associated with the respective user interface object in the first user interface.

6. The method of claim 5, including:

while the supplemental information associated with the respective user interface object is displayed on the display and the one or more action items are not displayed;

in accordance with the determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, displaying an indicator indicating that the revealable menu with the one or more action items associated with the respective user interface object are hidden, wherein the indicator is configured to represent a direction of movement of a contact on the touch-sensitive surface that triggers display of the revealable menu with the one or more action items associated with the respective user interface object in the first user interface.

7. The method of claim 5, wherein:

the movement of the second contact on the touch-sensitive surface is in a first direction; and

displaying the revealable menu with the one or more action items that are associated with the respective user interface object in the first user interface includes;

shifting the supplemental information in the first direction on the display; and

revealing the revealable menu with the one or more action items as the supplemental information is shifted in the first direction.

8. The method of claim 7, wherein displaying the revealable menu with the one or more action items associated with the respective user interface object includes displaying a first action item associated with the respective user interface object, and wherein the method includes:

after displaying the revealable menu with the first action item associated with the respective user interface object, detecting that the movement of the second contact corresponds to movement by at least a first threshold amount on the touch-sensitive surface before detecting lift-off of the second contact;

in response to detecting that the movement of the second contact corresponds to movement by at least the first threshold amount on the touch-sensitive surface, changing a visual appearance of the first action item;

after changing the visual appearance of the first action item, detecting an end of the second input; and

in response to detecting the end of the second input;

ceasing to display the revealable menu with the first action item; and

performing a first action represented by the first action item.

9. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensities of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a first user interface that includes a plurality of selectable user interface objects;

while displaying the first user interface on the display, detecting a first portion of a first input that includes detecting an increase in a characteristic intensity of a first contact on the touch-sensitive surface above a first intensity threshold while the first contact is detected at a location on the touch-sensitive surface that corresponds to a respective user interface object of the plurality of selectable user interface objects, wherein the respective user interface object is associated with supplemental information;

in response to detecting the first portion of the first input, displaying supplemental information associated with the respective user interface object, wherein the supplemental information includes at least one of a menu with selectable options and a preview;

while displaying the supplemental information associated with the respective user interface object, detecting an end of the first input; and

,

in response to detecting the end of the first input;

in accordance with a determination that the displayed supplemental information is a preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object; and

,

in accordance with a determination that the displayed supplemental information includes a menu with selectable options corresponding to the respective user interface object, maintaining display of the supplemental information associated with the respective user interface object after detecting the end of the first input.

10. The electronic device of claim 9, wherein the one or more programs include instructions for:

detecting a second portion of the first input after the first portion of the first input and before the end of the first input, wherein detecting the second portion of the first input includes detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold without detecting liftoff of the contact from the touch-sensitive surface; and

,

in response to detecting the second portion of the first input, maintaining display of the supplemental information associated with the respective user interface object.

11. The electronic device of claim 9, wherein the one or more programs include instructions for:

after detecting the end of the first input and, in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the second contact is detected at a location on the touch-sensitive surface that corresponds to the respective user interface object;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting an increase in the characteristic intensity of the second contact on the touch-sensitive surface above a second intensity threshold; and

,

in response to detecting the second portion of the second input, replacing display of the first user interface and the supplemental information with a second user interface.

12. The electronic device of claim 9, wherein the one or more programs include instructions for:

while displaying the supplemental information on the display and prior to detecting the end of the first input, detecting a second portion of the first input that includes movement of the first contact on the touch-sensitive surface; and

in response to detecting the second portion of the first input that includes the movement of the first contact;

in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, moving the supplemental information in accordance with the movement of the first contact; and

in accordance with a determination that the displayed supplemental information includes the menu with selectable options corresponding to the respective user interface object, maintaining a position of the supplemental information and highlighting a selectable option in the menu in accordance with the movement of the first contact.

13. The electronic device of claim 9, wherein the one or more programs include instructions for:

after detecting the end of the first input and, in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detecting a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the second contact is detected at a location on the touch-sensitive surface that corresponds to the respective user interface object of the plurality of user interface objects;

in response to detecting the first portion of the second input, redisplaying the supplemental information associated with the respective user interface object;

detecting a second portion of the second input that includes detecting a movement of the second contact on the touch-sensitive surface; and

,

in response to detecting the second portion of the second input, displaying a revealable menu with one or more action items that are associated with the respective user interface object in the first user interface.

14. The electronic device of claim 13, wherein the one or more programs include instructions for:

while the supplemental information associated with the respective user interface object is displayed on the display and the one or more action items are not displayed;

in accordance with the determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, displaying an indicator indicating that the revealable menu with the one or more action items associated with the respective user interface object are hidden, wherein the indicator is configured to represent a direction of movement of a contact on the touch-sensitive surface that triggers display of the revealable menu with the one or more action items associated with the respective user interface object in the first user interface.

15. The electronic device of claim 13, wherein:

the movement of the second contact on the touch-sensitive surface is in a first direction; and

displaying the revealable menu with the one or more action items that are associated with the respective user interface object in the first user interface includes;

shifting the supplemental information in the first direction on the display; and

revealing the revealable menu with the one or more action items as the supplemental information is shifted in the first direction.

16. The electronic device of claim 15, wherein displaying the revealable menu with the one or more action items associated with the respective user interface object includes displaying a first action item associated with the respective user interface object, and wherein the one or more programs include instructions for:

after displaying the revealable menu with the first action item associated with the respective user interface object, detecting that the movement of the second contact corresponds to movement by at least a first threshold amount on the touch-sensitive surface before detecting lift-off of the second contact;

in response to detecting that the movement of the second contact corresponds to movement by at least the first threshold amount on the touch-sensitive surface, changing a visual appearance of the first action item;

after changing the visual appearance of the first action item, detecting an end of the second input; and

in response to detecting the end of the second input;

ceasing to display the revealable menu with the first action item; and

performing a first action represented by the first action item.

17. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensities of contacts with the touch-sensitive surface, cause the electronic device to:

display, on the display, a first user interface that includes a plurality of selectable user interface objects;

while displaying the first user interface on the display, detect a first portion of a first input that includes detecting an increase in a characteristic intensity of a first contact on the touch-sensitive surface above a first intensity threshold while the first contact is detected at a location on the touch-sensitive surface that corresponds to a respective user interface object of the plurality of selectable user interface objects, wherein the respective user interface object is associated with supplemental information;

in response to detecting the first portion of the first input, display supplemental information associated with the respective user interface object, wherein the supplemental information includes at least one of a menu with selectable options and a preview;

while displaying the supplemental information associated with the respective user interface object, detect an end of the first input; and

,

in response to detecting the end of the first input;

in accordance with a determination that the displayed supplemental information is a preview and does not include selectable options corresponding to the respective user interface object, cease to display the supplemental information associated with the respective user interface object; and

,

in accordance with a determination that the displayed supplemental information includes a menu with selectable options corresponding to the respective user interface object, maintain display of the supplemental information associated with the respective user interface object after detecting the end of the first input.

18. The non-transitory computer readable storage medium of claim 17, wherein the one or more programs include instructions which, when executed by the electronic device, cause the electronic device to:

detect a second portion of the first input after the first portion of the first input and before the end of the first input, wherein detecting the second portion of the first input includes detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold without detecting liftoff of the contact from the touch-sensitive surface; and

,

in response to detecting the second portion of the first input, maintain display of the supplemental information associated with the respective user interface object.

19. The non-transitory computer readable storage medium of claim 17, wherein the one or more programs include instructions which, when executed by the electronic device, cause the electronic device to:

after detecting the end of the first input and, in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detect a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the second contact is detected at a location on the touch-sensitive surface that corresponds to the respective user interface object;

in response to detecting the first portion of the second input, redisplay the supplemental information associated with the respective user interface object;

detect a second portion of the second input that includes detecting an increase in the characteristic intensity of the second contact on the touch-sensitive surface above a second intensity threshold; and

,

in response to detecting the second portion of the second input, replace display of the first user interface and the supplemental information with a second user interface.

20. The non-transitory computer readable storage medium of claim 17, wherein the one or more programs include instructions which, when executed by the electronic device, cause the electronic device to:

while displaying the supplemental information on the display and prior to detecting the end of the first input, detect a second portion of the first input that includes movement of the first contact on the touch-sensitive surface; and

in response to detecting the second portion of the first input that includes the movement of the first contact;

in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, move the supplemental information in accordance with the movement of the first contact; and

in accordance with a determination that the displayed supplemental information includes the menu with selectable options corresponding to the respective user interface object, maintain a position of the supplemental information and highlighting a selectable option in the menu in accordance with the movement of the first contact.

21. The non-transitory computer readable storage medium of claim 17, wherein the one or more programs include instructions which, when executed by the electronic device, cause the electronic device to:

after detecting the end of the first input and, in accordance with a determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, ceasing to display the supplemental information associated with the respective user interface object;

while displaying the first user interface on the display, detect a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the second contact is detected at a location on the touch-sensitive surface that corresponds to the respective user interface object of the plurality of user interface objects;

in response to detecting the first portion of the second input, redisplay the supplemental information associated with the respective user interface object;

detect a second portion of the second input that includes detecting a movement of the second contact on the touch-sensitive surface; and

,

in response to detecting the second portion of the second input, display a revealable menu with one or more action items that are associated with the respective user interface object in the first user interface.

22. The non-transitory computer readable storage medium of claim 21, wherein the one or more programs include instructions which, when executed by the electronic device, cause the electronic device to:

while the supplemental information associated with the respective user interface object is displayed on the display and the one or more action items are not displayed;

in accordance with the determination that the displayed supplemental information is the preview and does not include selectable options corresponding to the respective user interface object, display an indicator indicating that the revealable menu with the one or more action items associated with the respective user interface object are hidden, wherein the indicator is configured to represent a direction of movement of a contact on the touch-sensitive surface that triggers display of the revealable menu with the one or more action items associated with the respective user interface object in the first user interface.

23. The non-transitory computer readable storage medium of claim 21, wherein:

the movement of the second contact on the touch-sensitive surface is in a first direction; and

displaying the revealable menu with the one or more action items that are associated with the respective user interface object in the first user interface includes;

shifting the supplemental information in the first direction on the display; and

revealing the revealable menu with the one or more action items as the supplemental information is shifted in the first direction.

24. The non-transitory computer readable storage medium of claim 23, wherein displaying the revealable menu with the one or more action items associated with the respective user interface object includes displaying a first action item associated with the respective user interface object, and wherein the one or more programs include instructions which, when executed by the electronic device, cause the electronic device to:

after displaying the first action item associated with the respective user interface object, detect that the movement of the second contact corresponds to movement by at least a first threshold amount on the touch-sensitive surface before detecting lift-off of the second contact;

in response to detecting that the movement of the second contact corresponds to movement by at least the first threshold amount on the touch-sensitive surface, change a visual appearance of the first action item;

after changing the visual appearance of the first action item, detect an end of the second input; and

in response to detecting the end of the second input;

cease to display the revealable menu with the first action item; and

perform a first action represented by the first action item.