Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

• US 10,067,645 B2
• Filed: 09/30/2015
• Issued: 09/04/2018
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: King, Nicholas V., Bauer, Sebastian J., Chaudhri, Imran A., Dye, Alan C., Foss, Christopher P., Ive, Jonathan, Manzari, Behkish J., Penha, Henrique D., Preston, Daniel T., Wilson, Christopher I.
• Primary Examiner(s): Levy, Amy M
• Application Number:
  US14/871,227
• Publication Number:
  US 20160259518A1
• Time in Patent Office: 1,070 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

In accordance with some embodiments, a method is performed at an electronic device. The device displays a first user interface including a background with a first appearance and foreground objects. While displaying the first user interface, the device detects a first input while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface. In response, if the contact has a characteristic intensity above a first intensity threshold, the device dynamically changes the background without changing the foreground objects, wherein the dynamic change in the background is based on the characteristic intensity of the contact. While dynamically changing the background, detecting termination of the first input; and, in response, the device reverts the background back to the first appearance of the background.

Claims

1. A method, comprising:

at an electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensities of contacts with the touch-sensitive surface;

displaying a first user interface on the display, wherein the first user interface includes;

a background with a first appearance, the background of the first user interface including a representative image in a sequence of images; and

one or more foreground objects;

while displaying the first user interface on the display, detecting a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface, wherein, when the first input is detected, the electronic device is in a locked state in which access to a plurality of different operations that are accessible when the electronic device is in an unlocked state is prevented;

in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact and wherein dynamically changing the appearance of the background of the first user interface includes displaying in sequence at least some of the sequence of images based at least in part on the characteristic intensity of the first contact;

while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold;

detecting a decrease in the characteristic intensity of the first contact; and

,

in response to detecting the decrease in the characteristic intensity of the first contact, reversing the changing of the appearance of the background of the first user interface;

detecting a second input, the second input meeting criteria to exit the locked state of the electronic device; and

,

in response to detecting the second input, replacing display of the first user interface with display of a second user interface that is distinct from the first user interface on the display, wherein the second user interface includes a background of the second user interface with a first appearance and one or more foreground objects.

2. The method of claim 1, wherein the first intensity threshold is associated with an operating system of the electronic device, and respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy the first intensity threshold.

3. The method of claim 2, wherein:

respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy a second intensity threshold;

the appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold; and

the appearance of the background changes in a second manner, different from the first manner when the characteristic intensity of the contact is above the second intensity threshold.

4. The method of claim 1, including:

while displaying the second user interface on the display, detecting a third input by a third contact on the touch-sensitive surface while a focus selector is at a location in the second user interface that corresponds to the background of the second user interface, wherein the third contact has a characteristic intensity above the first intensity threshold; and

,

in response to detecting the third input by the third contact, maintaining the first appearance of the background of the second user interface.

5. The method of claim 1, wherein a respective foreground object of the one or more foreground objects responds to an input by a contact having a characteristic intensity below the first intensity threshold.

6. The method of claim 1, including:

while displaying the second user interface on the display, detecting a fourth input by a fourth contact on the touch-sensitive surface while a focus selector is at a location in the second user interface that corresponds to the background of the second user interface; and

,

in response to detecting the fourth input by the fourth contact, in accordance with a determination that the fourth contact has a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the second user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the second user interface is based at least in part on the characteristic intensity of the fourth contact.

7. The method of claim 6, including:

while dynamically changing the appearance of the background of the second user interface, detecting termination of the fourth input by the fourth contact; and

,

in response to detecting termination of the fourth input by the fourth contact, reverting the background of the second user interface back to the first appearance of the background of the second user interface.

8. The method of claim 1, wherein reversing the change of the appearance of the background of the first user interface includes:

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact does not exceeds a first rate of change threshold, dynamically reversing the change of the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact; and

,

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact exceeds a first rate of change threshold, animating reversal of the change of the appearance of the background of the first user interface independent of the rate of change of the characteristic intensity of the first contact.

9. The method of claim 1, wherein the dynamic change in the appearance of the background of the first user interface is based in part on a positive rate of change in the characteristic intensity of the first contact.

10. The method of claim 1, wherein a magnitude of the dynamic change in the appearance of the background of the first user interface decays following detection of an impulse force by the first contact.

11. The method of claim 1, including:

detecting termination of the first input by the first contact; and

,

in response to detecting termination of the first input by the first contact, reverting the background of the first user interface back to the first appearance of the background;

wherein reverting the background of the first user interface back to the first appearance of the background is based on a rate of change of the decrease in the characteristic intensity of the first contact prior to termination of the first input.

12. The method of claim 1, including:

in response to detecting the first input by the first contact, in accordance with the determination that the first contact has a characteristic intensity above the first intensity threshold, changing an aspect of the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the change of the aspect of the appearance of the background of the first user interface is independent of position of the first focus selector in the background.

13. The method of claim 1, wherein:

in response to detecting the first input by the first contact on the touch-sensitive surface, in accordance with a determination that the first input does not have a characteristic intensity above the first intensity threshold, maintaining the first appearance of the background of the first user interface.

14. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensities of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a first user interface on the display, wherein the first user interface includes;

a background with a first appearance, the background of the first user interface including a representative image in a sequence of images; and

one or more foreground objects;

while displaying the first user interface on the display, detecting a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface, wherein, when the first input is detected, the electronic device is in a locked state in which access to a plurality of different operations that are accessible when the electronic device is in an unlocked state is prevented;

in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact and wherein dynamically changing the appearance of the background of the first user interface includes displaying in sequence at least some of the sequence of images based at least in part on the characteristic intensity of the first contact;

while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold;

detecting a decrease in the characteristic intensity of the first contact; and

,

in response to detecting the decrease in the characteristic intensity of the first contact, reversing the changing of the appearance of the background of the first user interface;

detecting a second input, the second input meeting criteria to exit the locked state of the electronic device; and

,

in response to detecting the second input, replacing display of the first user interface with display of a second user interface that is distinct from the first user interface on the display, wherein the second user interface includes a background of the second user interface with a first appearance and one or more foreground objects.

15. The electronic device of claim 14, wherein the first intensity threshold is associated with an operating system of the electronic device, and respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy the first intensity threshold.

16. The electronic device of claim 15, wherein:

respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy a second intensity threshold;

the appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold; and

the appearance of the background changes in a second manner, different from the first manner when the characteristic intensity of the contact is above the second intensity threshold.

17. The electronic device of claim 14, wherein reversing the change of the appearance of the background of the first user interface includes:

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact does not exceeds a first rate of change threshold, dynamically reversing the change of the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact; and

,

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact exceeds a first rate of change threshold, animating reversal of the change of the appearance of the background of the first user interface independent of the rate of change of the characteristic intensity of the first contact.

18. The electronic device of claim 14, wherein a magnitude of the dynamic change in the appearance of the background of the first user interface decays following detection of an impulse force by the first contact.

19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface, cause the electronic device to:

display a first user interface on the display, wherein the first user interface includes;

a background with a first appearance, the background of the first user interface including a representative image in a sequence of images; and

one or more foreground objects;

while displaying the first user interface on the display, detect a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface, wherein, when the first input is detected, the electronic device is in a locked state in which access to a plurality of different operations that are accessible when the electronic device is in an unlocked state is prevented;

in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically change the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact and wherein dynamically changing the appearance of the background of the first user interface includes displaying in sequence at least some of the sequence of images based at least in part on the characteristic intensity of the first contact;

while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold;

detect a decrease in the characteristic intensity of the first contact; and

in response to detecting the decrease in the characteristic intensity of the first contact, reverse the changing of the appearance of the background of the first user interface;

detect a second input, the second input meeting criteria to exit the locked state of the electronic device; and

,

in response to detecting the second input, replace display of the first user interface with display of a second user interface that is distinct from the first user interface on the display, wherein the second user interface includes a background of the second user interface with a first appearance and one or more foreground objects.

20. The non-transitory computer readable storage medium of claim 19, wherein the first intensity threshold is associated with an operating system of the electronic device, and respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy the first intensity threshold.

21. The non-transitory computer readable storage medium of claim 20, wherein:

respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy a second intensity threshold;

the appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold; and

the appearance of the background changes in a second manner, different from the first manner when the characteristic intensity of the contact is above the second intensity threshold.

22. The non-transitory computer readable storage medium of claim 19, wherein reversing the change of the appearance of the background of the first user interface includes:

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact does not exceeds a first rate of change threshold, dynamically reversing the change of the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact; and

,

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact exceeds a first rate of change threshold, animating reversal of the change of the appearance of the background of the first user interface independent of the rate of change of the characteristic intensity of the first contact.

23. The non-transitory computer readable storage medium of claim 19, wherein a magnitude of the dynamic change in the appearance of the background of the first user interface decays following detection of an impulse force by the first contact.