Devices, Methods, and Graphical User Interfaces for Manipulating User Interface Objects with Visual and/or Haptic Feedback

• US 20160259413A1
• Filed: 09/30/2015
• Published: 09/08/2016
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Leonard, Adam J., Trottier, Lauren K., Anzures, Freddy A., Bauer, Sebastian J., Dascola, Jonathan R., Federighi, Craig M., Foss, Christopher P., Karunamuni, Chanaka G., King, Nicholas V., Kocienda, Kenneth L., Moussette, Camille, Wan, Wan Si, Yang, Lawrence Y., Yerkes, Giancarlo
• Granted Patent: US 10,338,772 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts: displays an application launching user interface; detects a first touch input that includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon for launching a first application that is associated with one or more corresponding quick actions; in response to detecting the first touch input, in accordance with a determination that the first touch input meets one or more application-launch criteria, launches the first application; and, in accordance with a determination that the first touch input meets one or more quick-action-display criteria, which include a criterion that is met when the characteristic intensity of the first contact increases above a respective intensity threshold, concurrently displays one or more quick action objects associated with the first application along with the first application icon.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more sensors for detecting intensity of contacts on the touch-sensitive surface;

displaying, on the display, an application launching user interface that includes a plurality of application icons for launching corresponding applications; and

while displaying on the application launching user interface, detecting a first touch input that includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon of the plurality of application icons, wherein the first application icon is an icon for launching a first application that is associated with one or more corresponding quick actions; and

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more application-launch criteria, launching the first application; and

in accordance with a determination that the first touch input meets one or more quick-action-display criteria which include a criterion that is met when the characteristic intensity of the first contact increases above a respective intensity threshold, concurrently displaying one or more quick action objects associated with the first application along with the first application icon without launching the first application.

2. The method of claim 1, wherein the application-launch criteria are criteria that are configured to be met when the characteristic intensity of the contact does not increase above the respective intensity threshold.

3. The method of claim 1, including in response to detecting the first touch input, in accordance with the determination that the first touch input meets the quick-action-display criteria, deemphasizing a plurality of the application icons relative to the first application icon in conjunction with displaying the one or more quick action objects.

4. The method of claim 3, including, during the first touch input detecting changes in the characteristic intensity of the first contact before the quick-action-display criteria are met and, dynamically adjusting an appearance of the other application icons based on the characteristic intensity of the first contact to progressively deemphasize the plurality of application icons other than the first application icon as the characteristic intensity of the first contact increases.

5. The method of claim 1, including in response to detecting the first touch input, in accordance with a determination that the first touch input meets one or more interface-navigation criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected before the characteristic intensity of the first contact increases above the respective intensity threshold, ceasing to display at least a portion of the application launching user interface and displaying at least a portion of a different user interface on a portion of the display that was previously occupied by the plurality of application icons in the application launching user interface immediately prior to detecting the first touch input.

6. The method of claim 5, including, in response to detecting movement of the first contact before the characteristic intensity of the first contact increases above the respective intensity threshold, moving a plurality of application icons in accordance with the movement of the first contact.

7. The method of claim 1, including in response to detecting the first touch input, in accordance with a determination that the first touch input meets icon-reconfiguration criteria that include a criterion that is met when the first contact is detected on the touch-sensitive surface for more than a reconfiguration time threshold before the characteristic intensity of the first contact increases above the respective intensity threshold, entering an icon reconfiguration mode in which one or more application icons can be reorganized within the application launching interface.

8. The method of claim 1, including:

while displaying the one or more quick action objects concurrently with the application icon, detecting a second touch input that includes detecting a second contact at a location on the touch-sensitive surface that corresponds to the first application icon and meets the application launch criteria; and

,

in response to detecting the second touch input, launching the first application.

9. The method of claim 1, including:

while displaying the one or more quick action objects concurrently with the application icon, detecting a third touch input that includes detecting a third contact at a location on the touch-sensitive surface that corresponds to the first application icon, wherein the third touch input meets icon-reconfiguration criteria that include a criterion that is met when the third contact is detected on the touch-sensitive surface for more than a reconfiguration time threshold before the characteristic intensity of the third contact increases above the respective intensity threshold; and

,

in response to detecting the third touch input, entering an icon reconfiguration mode in which application icons can be reorganized within the application launching interface.

10. The method of claim 9, wherein entering the icon reconfiguration mode in response to detecting the third touch input includes ceasing to display the one or more quick action objects.

11. The method of claim 1, including:

while displaying the quick action objects concurrently with the first application icon, detecting a fourth touch input that includes detecting a fourth contact at a location on the touch-sensitive surface that is away from the quick action objects and the first application icon; and

,

in response to detecting the fourth touch input, ceasing to display the one or more quick action objects.

12. The method of claim 1, including, in response to determining that the quick-action-display criteria have been met, generating a first tactile output that is indicative of the satisfaction of the quick-action-display criteria.

13. The method of claim 1, including:

while displaying on the application launching user interface, detecting a fifth touch input that includes detecting a fifth contact at a location on the touch-sensitive surface that corresponds to a second application icon of the plurality of application icons, wherein the second application icon is an icon for launching a second application that is not associated with any corresponding quick actions; and

in response to detecting the fifth touch input;

in accordance with a determination that the fifth touch input meets application-launch criteria, launching the second application; and

in accordance with a determination that the fifth touch input meets the quick-action-display criteria, generating visual and/or tactile output indicating that the fifth touch input met the quick-action-display criteria but that the second application is not associated with any quick actions.

14. The method of claim 13, including:

when the first contact approaches the respective intensity threshold, displaying, on the display, a respective change in the appearance of a plurality of application icons; and

when the fifth contact approaches the respective intensity threshold, displaying, on the display, the respective change in the appearance of the plurality of application icons.

15. The method of claim 13, including:

when the fifth contact approaches the respective intensity threshold, displaying, on the display, a change in the appearance of the plurality of application icons other than the second application icon; and

,

in response to detecting that the fifth touch input meets the quick-action-display criteria, reversing the change in appearance of the plurality of application icons to redisplay the application launch interface as it appeared just prior to detecting the fifth touch input.

16. The method of claim 1, including:

while displaying on the application launching user interface, detecting a sixth touch input that includes detecting a sixth contact at a location on the touch-sensitive surface that corresponds to a respective application icon, wherein the sixth contact meets the quick-action-display criteria; and

in response to detecting the sixth touch input;

in accordance with a determination that the respective application icon is associated with one or more quick actions;

displaying quick action objects for the respective application icon and

generating a first tactile output indicating that the sixth touch input met the quick-action-display criteria and that the respective application icon is associated with quick actions; and

,

in accordance with a determination that the respective application icon is not associated with any quick actions;

generating a second tactile output indicating that the sixth touch input met the quick-action-display criteria and that the respective application icon is not associated with any quick actions and

not displaying quick action objects for the respective application icon, wherein the first tactile output is different from the second tactile output.

17. The method of claim 1, wherein concurrently displaying the one or more quick action objects with the first application icon includes displaying the one or more quick action objects in a menu that includes a plurality of quick action objects.

18. The method of claim 17, including, prior to displaying the menu, displaying a layer under the application icon, and in response to detecting that the first input meets the quick-action-display criteria, expanding the layer to serve as a background for the menu.

19. The method of claim 17, wherein the quick action objects within the menu are ordered within the menu based on the location of the icon within the application launch user interface.

20. The method of claim 1, including:

while displaying the one or more quick action objects, detecting movement of the first contact to a respective location on the touch-sensitive surface that corresponds to a respective quick action object of the one or more quick action objects and detecting liftoff of the first contact from the touch-sensitive surface while the first contact is at the respective location on the touch-sensitive surface; and

,

in response to detecting liftoff of the first contact, performing the respective quick action.

21. The method of claim 1, including:

while displaying the one or more quick action objects, detecting movement of the first contact to a respective location on the touch-sensitive surface that corresponds to a respective quick action object of the one or more quick action objects and detecting an increase in the characteristic intensity of the contact that meets action-selection criteria while the first contact is at the respective location on the touch-sensitive surface; and

,

in response to detecting that the first contact meets the action-selection criteria, performing the respective quick action.

22. The method of claim 1, including:

after displaying the one or more quick action objects, detecting liftoff of the contact from the touch-sensitive surface and detecting a subsequent touch input on the touch sensitive surface at a location that corresponds to a respective quick action object of the one or more quick action objects; and

,

in response to detecting the subsequent touch input on the touch sensitive surface at a location that corresponds to the respective quick action object, performing the respective quick action.

23. The method of claim 1, wherein:

launching the first application in response to detecting the first touch input includes displaying a default view of the application;

the one or more quick action objects include a respective quick action object that is associated with a non-default view of the application; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, displaying the non-default view of the application.

24. The method of claim 1, wherein:

the one or more quick action objects include a quick action object that is associated with a function of an application other than the first application; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, performing the function.

25. The method of claim 1, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with creating new content; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, creating a new blank content object and displaying the new blank content object on the display in an editing mode of operation.

26. The method of claim 1, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with opening previously created content; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, opening the application and displaying the previously created content within the application.

27. The method of claim 1, wherein the one or more quick action objects include a respective quick action object that corresponds to a quick action selected based on recent activity within the first application.

28. The method of claim 1, wherein the one or more quick action objects include a respective quick action object that is dynamically determined based on a current location of the device.

29. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensity of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, an application launching user interface that includes a plurality of application icons for launching corresponding applications; and

while displaying on the application launching user interface, detecting a first touch input that includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon of the plurality of application icons, wherein the first application icon is an icon for launching a first application that is associated with one or more corresponding quick actions; and

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more application-launch criteria, launching the first application; and

in accordance with a determination that the first touch input meets one or more quick-action-display criteria which include a criterion that is met when the characteristic intensity of the first contact increases above a respective intensity threshold, concurrently displaying one or more quick action objects associated with the first application along with the first application icon without launching the first application.

30. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface cause the device to:

display, on the display, an application launching user interface that includes a plurality of application icons for launching corresponding applications; and

while displaying on the application launching user interface, detect a first touch input that includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon of the plurality of application icons, wherein the first application icon is an icon for launching a first application that is associated with one or more corresponding quick actions; and

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more application-launch criteria, launch the first application; and

in accordance with a determination that the first touch input meets one or more quick-action-display criteria which include a criterion that is met when the characteristic intensity of the first contact increases above a respective intensity threshold, concurrently display one or more quick action objects associated with the first application along with the first application icon without launching the first application.