Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

• US 10,860,177 B2
• Filed: 01/09/2019
• Issued: 12/08/2020
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Foss, Christopher P., Anzures, Freddy A., Bauer, Sebastian J., Dascola, Jonathan R., Karunamuni, Chanaka G., Wan, Wan Si, Yerkes, Giancarlo, Kocienda, Kenneth L., Moussette, Camille, Trottier, Lauren K., King, Nicholas V., Leonard, Adam J., Yang, Lawrence Y., Federighi, Craig M.
• Primary Examiner(s): Levy, Amy M
• Application Number:
  US16/243,834
• Publication Number:
  US 20190146643A1
• Time in Patent Office: 699 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

An application launching user interface that includes a plurality of application icons for launching corresponding applications is displayed. A first touch input is detected on a first application icon of the plurality of application icons. The first application icon is for launching a first application that is associated with one or more corresponding quick actions. If the first touch input meets one or more application-launch criteria which require that the first touch input has ended without having met a first input threshold, the first application is launched in response to the first touch input. If the first touch input meets one or more quick-action-display criteria which require that the first touch input meets the first input threshold, one or more quick action objects associated with the first application are concurrently displayed along with the first application icon without launching the first application, in response to the first touch input.

Claims

1. A method, comprising:

at an electronic device with a display, and a touch-sensitive surface;

displaying, on the display, an application launching user interface that includes a plurality of application icons for launching corresponding applications;

while displaying the application launching user interface, detecting a first touch input that includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon of the plurality of application icons, wherein the first application icon is an icon for launching a first application that is associated with one or more corresponding quick actions; and

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more application-launch criteria, wherein the application-launch criteria require that the first touch input has ended without having met a first input threshold in order for the application-launch criteria to be met, launching the first application; and

in accordance with a determination that the first touch input meets one or more quick-action-display criteria, wherein the quick-action-display criteria require that the first touch input meets the first input threshold in order for the quick-action-display criteria to be met, concurrently displaying one or more quick action objects associated with the first application along with the first application icon without launching the first application, while the first touch-input continues to meet the first input threshold;

while displaying the one or more quick action objects concurrently with the first application icon, detecting a second touch input that includes detecting a second contact at a location on the touch-sensitive surface that corresponds to a respective application icon; and

in response to detecting the second touch input;

in accordance with a determination that the respective application icon is the first application icon, launching the first application; and

in accordance with a determination that the respective application icon is a second application icon different from the first application icon, ceasing to display the one or more quick action objects corresponding to the first application icon.

2. The method of claim 1, including:

deemphasizing one or more of the plurality of application icons relative to the first application icon in conjunction with displaying the one or more quick action objects.

3. The method of claim 1, including:

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more interface-navigation criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected before the first input threshold is met by the first touch input, ceasing to display at least a portion of the application launching user interface and displaying at least a portion of a different user interface on a portion of the display that was previously occupied by the plurality of application icons in the application launching user interface immediately prior to detecting the first touch input; and

in accordance with a determination that the first touch input meets one or more quick-action selection criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected after the first input threshold is met by the first touch input, performing a function corresponding to a respective quick action object of the one or more quick action objects in accordance with a characteristic location of the first contact after detecting the movement of the first contact.

4. The method of claim 3, including:

in response to detecting the first touch input;

in accordance with a determination that the first touch input includes more than the threshold amount of movement of the first contact before the first input threshold is met by the first touch input, moving the plurality of application icons, including the first application icon and one or more second application icons, in accordance with the movement of the first contact; and

in accordance with a determination that the first touch input meets a second input threshold that is different from the first input threshold and that the first touch input includes more than a threshold amount of movement after the second input threshold is met by the first touch input, moving the first application icon relative to the one or more second application icons in accordance with the movement of the first contact.

5. The method of claim 1, including:

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets icon-reconfiguration criteria that include a criterion that is met when the first contact is detected on the touch-sensitive surface for more than a reconfiguration time threshold with less than a threshold amount of movement, entering an icon reconfiguration mode in which one or more application icons can be reorganized within the application launching user interface, wherein the icon reconfiguration criteria are met while the one or more quick action objects associated with the first application is concurrently displayed with the first application icon as a result of the one or more quick-action-display criteria having met by an earlier input.

6. The method of claim 1, including:

in response to determining that the first input threshold has been met, generating a first tactile output that is indicative of the first input threshold being met.

7. The method of claim 1, wherein concurrently displaying the one or more quick action objects with the first application icon includes displaying the one or more quick action objects in a menu that includes a plurality of quick action objects.

8. The method of claim 7, including:

prior to displaying the menu, displaying a layer under the first application icon, and in response to detecting that the first input meets the quick-action-display criteria, expanding the layer to serve as a background for the menu.

9. The method of claim 1, wherein:

launching the first application in response to detecting the first touch input includes displaying a default view of the first application;

the one or more quick action objects include a respective quick action object that is associated with a non-default view of the first application; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, displaying the non-default view of the first application.

10. The method of claim 1, wherein:

the one or more quick action objects include a respective quick action object that is associated with a function of an application other than the first application; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, performing the function.

11. The method of claim 1, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with creating new content; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, creating a new blank content object and displaying the new blank content object on the display in an editing mode of operation.

12. The method of claim 1, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with opening previously created content; and

the method includes;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, opening the first application and displaying the previously created content within the first application.

13. The method of claim 1, wherein the one or more quick action objects include a respective quick action object that corresponds to a quick action selected based on recent activity within the first application.

14. The method of claim 1, wherein the one or more quick action objects include a respective quick action object that is dynamically determined based on a current location of the device.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

display, on the display, an application launching user interface that includes a plurality of application icons for launching corresponding applications;

while displaying the application launching user interface, detect a first touch input, wherein detecting the first touch input includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon of the plurality of application icons, and wherein the first application icon is an icon for launching a first application that is associated with one or more corresponding quick actions; and

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more application-launch criteria, wherein the application-launch criteria require that the first touch input has ended without having met a first input threshold in order for the application-launch criteria to be met, launch the first application; and

in accordance with a determination that the first touch input meets one or more quick-action-display criteria, wherein the quick-action-display criteria require that the first touch input meets the first input threshold in order for the quick-action-display criteria to be met, concurrently display one or more quick action objects associated with the first application along with the first application icon without launching the first application, while the first touch-input continues to meet the first input threshold;

while displaying the one or more quick action objects concurrently with the first application icon, detect a second touch input that includes detecting a second contact at a location on the touch-sensitive surface that corresponds to a respective application icon; and

in response to detecting the second touch input;

in accordance with a determination that the respective application icon is the first application icon, launch the first application; and

in accordance with a determination that the respective application icon is a second application icon different from the first application icon, cease to display the one or more quick action objects corresponding to the first application icon.

16. The non-transitory computer readable storage medium of claim 15, wherein the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

deemphasize one or more of the plurality of application icons relative to the first application icon in conjunction with displaying the one or more quick action objects.

17. The non-transitory computer readable storage medium of claim 15, wherein the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more interface-navigation criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected before the first input threshold is met by the first touch input, cease to display at least a portion of the application launching user interface and display at least a portion of a different user interface on a portion of the display that was previously occupied by the plurality of application icons in the application launching user interface immediately prior to detecting the first touch input; and

in accordance with a determination that the first touch input meets one or more quick-action selection criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected after the first input threshold is met by the first touch input, perform a function corresponding to a respective quick action object of the one or more quick action objects in accordance with a characteristic location of the first contact after detecting the movement of the first contact.

18. The non-transitory computer readable storage medium of claim 17, wherein the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the first touch input;

in accordance with a determination that the first touch input includes more than the threshold amount of movement of the first contact before the first input threshold is met by the first touch input, move the plurality of application icons, including the first application icon and one or more second application icons, in accordance with the movement of the first contact; and

in accordance with a determination that the first touch input meets a second input threshold that is different from the first input threshold and that the first touch input includes more than a threshold amount of movement after the second input threshold is met by the first touch input, move the first application icon relative to the one or more second application icons in accordance with the movement of the first contact.

19. The non-transitory computer readable storage medium of claim 15, wherein the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets icon-reconfiguration criteria that include a criterion that is met when the first contact is detected on the touch-sensitive surface for more than a reconfiguration time threshold with less than a threshold amount of movement, enter an icon reconfiguration mode in which one or more application icons can be reorganized within the application launching user interface, wherein the icon reconfiguration criteria are met while the one or more quick action objects associated with the first application is concurrently displayed with the first application icon as a result of the one or more quick-action-display criteria having met by an earlier input.

20. The non-transitory computer readable storage medium of claim 15, wherein the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to determining that the first input threshold has been met, generate a first tactile output that is indicative of the first input threshold being met.

21. The non-transitory computer readable storage medium of claim 15, wherein concurrently displaying the one or more quick action objects with the first application icon includes displaying the one or more quick action objects in a menu that includes a plurality of quick action objects.

22. The non-transitory computer readable storage medium of claim 21, wherein the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

prior to displaying the menu, display a layer under the first application icon, and in response to detecting that the first input meets the quick-action-display criteria, expand the layer to serve as a background for the menu.

23. The non-transitory computer readable storage medium of claim 15, wherein:

launching the first application in response to detecting the first touch input includes displaying a default view of the first application;

the one or more quick action objects include a respective quick action object that is associated with a non-default view of the first application; and

the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to;

detect selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, display the non-default view of the first application.

24. The non-transitory computer readable storage medium of claim 15, wherein:

the one or more quick action objects include a respective quick action object that is associated with a function of an application other than the first application; and

the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to;

detect selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, perform the function.

25. The non-transitory computer readable storage medium of claim 15, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with creating new content; and

the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to;

detect selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, create a new blank content object and display the new blank content object on the display in an editing mode of operation.

26. The non-transitory computer readable storage medium of claim 15, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with opening previously created content; and

the instructions, which, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to;

detect selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, open the first application and display the previously created content within the first application.

27. The non-transitory computer readable storage medium of claim 15, wherein the one or more quick action objects include a respective quick action object that corresponds to a quick action selected based on recent activity within the first application.

28. The non-transitory computer readable storage medium of claim 15, wherein the one or more quick action objects include a respective quick action object that is dynamically determined based on a current location of the device.

29. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, an application launching user interface that includes a plurality of application icons for launching corresponding applications;

while displaying the application launching user interface, detecting a first touch input that includes detecting a first contact at a location on the touch-sensitive surface that corresponds to a first application icon of the plurality of application icons, wherein the first application icon is an icon for launching a first application that is associated with one or more corresponding quick actions; and

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more application-launch criteria, wherein the application-launch criteria require that the first touch input has ended without having met a first input threshold in order for the application-launch criteria to be met, launching the first application; and

in accordance with a determination that the first touch input meets one or more quick-action-display criteria, wherein the quick-action-display criteria require that the first touch input meets the first input threshold in order for the quick-action-display criteria to be met, concurrently displaying one or more quick action objects associated with the first application along with the first application icon without launching the first application, while the first touch-input continues to meet the first input threshold,

while displaying the one or more quick action objects concurrently with the first application icon, detecting a second touch input that includes detecting a second contact at a location on the touch-sensitive surface that corresponds to a respective application icon; and

in response to detecting the second touch input;

in accordance with a determination that the respective application icon is the first application icon, launching the first application; and

in accordance with a determination that the respective application icon is a second application icon different from the first application icon, ceasing to display the one or more quick action objects corresponding to the first application icon.

30. The electronic device of claim 29, wherein the one or more programs include instructions for:

deemphasizing one or more of the plurality of application icons relative to the first application icon in conjunction with displaying the one or more quick action objects.

31. The electronic device of claim 29, wherein the one or more programs include instructions for:

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets one or more interface-navigation criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected before the first input threshold is met by the first touch input, ceasing to display at least a portion of the application launching user interface and displaying at least a portion of a different user interface on a portion of the display that was previously occupied by the plurality of application icons in the application launching user interface immediately prior to detecting the first touch input; and

in accordance with a determination that the first touch input meets one or more quick-action selection criteria that include a criterion that is met when more than a threshold amount of movement of the first contact is detected after the first input threshold is met by the first touch input, performing a function corresponding to a respective quick action object of the one or more quick action objects in accordance with a characteristic location of the first contact after detecting the movement of the first contact.

32. The electronic device of claim 31, wherein the one or more programs include instructions for:

in response to detecting the first touch input;

in accordance with a determination that the first touch input includes more than the threshold amount of movement of the first contact before the first input threshold is met by the first touch input, moving the plurality of application icons, including the first application icon and one or more second application icons, in accordance with the movement of the first contact; and

in accordance with a determination that the first touch input meets a second input threshold that is different from the first input threshold and that the first touch input includes more than a threshold amount of movement after the second input threshold is met by the first touch input, moving the first application icon relative to the one or more second application icons in accordance with the movement of the first contact.

33. The electronic device of claim 29, wherein the one or more programs include instructions for:

in response to detecting the first touch input;

in accordance with a determination that the first touch input meets icon-reconfiguration criteria that include a criterion that is met when the first contact is detected on the touch-sensitive surface for more than a reconfiguration time threshold with less than a threshold amount of movement, entering an icon reconfiguration mode in which one or more application icons can be reorganized within the application launching user interface, wherein the icon reconfiguration criteria are met while the one or more quick action objects associated with the first application is concurrently displayed with the first application icon as a result of the one or more quick-action-display criteria having met by an earlier input.

34. The electronic device of claim 29, wherein the one or more programs include instructions for:

in response to determining that the first input threshold has been met, generating a first tactile output that is indicative of the first input threshold being met.

35. The electronic device of claim 29, wherein concurrently displaying the one or more quick action objects with the first application icon includes displaying the one or more quick action objects in a menu that includes a plurality of quick action objects.

36. The electronic device of claim 35, wherein the one or more programs include instructions for:

prior to displaying the menu, displaying a layer under the first application icon, and in response to detecting that the first input meets the quick-action-display criteria, expanding the layer to serve as a background for the menu.

37. The electronic device of claim 29, wherein:

launching the first application in response to detecting the first touch input includes displaying a default view of the first application;

the one or more quick action objects include a respective quick action object that is associated with a non-default view of the first application; and

the one or more programs include instructions for;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, displaying the non-default view of the first application.

38. The electronic device of claim 29, wherein:

the one or more quick action objects include a respective quick action object that is associated with a function of an application other than the first application; and

the one or more programs include instructions for;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, performing the function.

39. The electronic device of claim 29, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with creating new content; and

the one or more programs include instructions for;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, creating a new blank content object and displaying the new blank content object on the display in an editing mode of operation.

40. The electronic device of claim 29, wherein:

the first application is a content creation application;

the one or more quick action objects include a respective quick action object that is associated with opening previously created content; and

the one or more programs include instructions for;

detecting selection of the respective quick action object, and,

in response to detecting selection of the respective quick action object, opening the first application and displaying the previously created content within the first application.

41. The electronic device of claim 29, wherein the one or more quick action objects include a respective quick action object that corresponds to a quick action selected based on recent activity within the first application.

42. The electronic device of claim 29, wherein the one or more quick action objects include a respective quick action object that is dynamically determined based on a current location of the device.