Devices, Methods, and Graphical User Interfaces for Manipulating User Interface Objects with Visual and/or Haptic Feedback

• US 20160259518A1
• Filed: 09/30/2015
• Published: 09/08/2016
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wilson, Christopher I., King, Nicholas V., Bauer, Sebastian J., Chaudhri, Imran A., Dye, Alan C., Foss, Christopher P., Ive, Jonathan, Manzari, Behkish J., Penha, Henrique D., Preston, Daniel T.
• Granted Patent: US 10,067,645 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

In accordance with some embodiments, a method is performed at an electronic device. The device displays a first user interface including a background with a first appearance and foreground objects. While displaying the first user interface, the device detects a first input while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface. In response, if the contact has a characteristic intensity above a first intensity threshold, the device dynamically changes the background without changing the foreground objects, wherein the dynamic change in the background is based on the characteristic intensity of the contact. While dynamically changing the background, detecting termination of the first input; and, in response, the device reverts the background back to the first appearance of the background.

Claims

1. A method, comprising:

at an electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts with the touch-sensitive surface;

displaying a first user interface on the display, wherein the first user interface includes

a background with a first appearance and

one or more foreground objects;

while displaying the first user interface on the display, detecting a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface;

in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact;

while dynamically changing the appearance of the background of the first user interface, detecting termination of the first input by the first contact; and

,

in response to detecting termination of the first input by the first contact, reverting the background of the first user interface back to the first appearance of the background.

2. The method of claim 1, wherein the dynamic change of the appearance of the background of the first user interface is based at least in part on a position of the first focus selector on the display.

3. The method of claim 1, wherein, when the first input is detected, the electronic device is in a locked mode in which access to a plurality of different operations that are accessible when the device is in an unlocked state is prevented.

4. The method of claim 3, wherein:

the background is used for both the locked state of the device and the unlocked state of the device;

while in the locked state, the appearance of the background is changed from a first appearance to a second appearance in accordance with the characteristic intensity of the first contact; and

the method includes;

while the background has the second appearance, receiving a request to enter an unlocked state, and,

in response to receiving the request to enter the unlocked state, entering the unlocked state; and

after entering the unlocked state, displaying a transition of the appearance of the background from the second state to the first state.

5. The method of claim 1, wherein the first intensity threshold is associated with an operating system of the electronic device, and respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy the first intensity threshold.

6. The method of claim 5, wherein:

respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy a second intensity threshold;

the appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold; and

the appearance of the background changes in a second manner, different from the first manner, when the characteristic intensity of the contact is above the second intensity threshold.

7. The method of claim 3, wherein a respective foreground object of the one or more foreground objects responds to an input by a contact having a characteristic intensity below the first intensity threshold.

8. The method of claim 3, including:

detecting a second input by a second contact, the second input meeting criteria to exit the locked mode of the electronic device; and

,

in response to detecting the second input by the second contact, replacing display of the first user interface with display of a second user interface that is distinct from the first user interface on the display, wherein the second user interface includes a background of the second user interface with a first appearance and one or more foreground objects.

9. The method of claim 8, including:

while displaying the second user interface on the display, detecting a third input by a third contact on the touch-sensitive surface while a focus selector is at a location in the second user interface that corresponds to the background of the second user interface, wherein the third contact has a characteristic intensity above the first intensity threshold; and

,

in response to detecting the third input by the third contact, maintaining the first appearance of the background of the second user interface.

10. The method of claim 8, including:

while displaying the second user interface on the display, detecting a fourth input by a fourth contact on the touch-sensitive surface while a focus selector is at a location in the second user interface that corresponds to the background of the second user interface; and

,

in response to detecting the fourth input by the fourth contact, in accordance with a determination that the fourth contact has a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the second user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the second user interface is based at least in part on the characteristic intensity of the fourth contact.

11. The method of claim 10, including:

while dynamically changing the appearance of the background of the second user interface, detecting termination of the fourth input by the fourth contact; and

,

in response to detecting termination of the fourth input by the fourth contact, reverting the background of the second user interface back to the first appearance of the background of the second user interface.

12. The method of claim 1, wherein the change in the appearance of the background of the first user interface includes:

a change in the space between background objects;

a change in the radial position of a background object with respect to a position of the first contact;

a change in the opacity of a background object;

a change in the color of a background object;

a change in a simulated depth or focus of a background object;

a change in the contrast of a background object; and

/or

a change in the brightness of a background object.

13. The method of claim 1, wherein the background of the first user interface includes a geometric or abstract pattern.

14. The method of claim 1, wherein the background of the first user interface includes a representative image in a sequence of images and dynamically changing the appearance of the background of the first user interface includes displaying in sequence at least some of the sequence of images based at least in part on the characteristic intensity of the first contact.

15. The method of claim 1, wherein the change in the appearance of the background of the first user interface includes a rippling effect applied to a background object that emanates from the focus selector.

16. The method of claim 1, wherein reverting the background of the first user interface back to the first appearance of the background includes:

moving display of an object of the background of the first user interface back to its first appearance in the background of the first user interface with a simulated inertia that is based on a rate of decrease in the characteristic intensity of the first contact detected immediately prior to detecting termination of the input by the first contact.

17. The method of claim 1, including:

while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold;

detecting a decrease in the characteristic intensity of the first contact; and

,

in response to detecting the decrease in the characteristic intensity of the first contact;

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact does not exceeds a first rate of change threshold, dynamically reversing the change of the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact; and

,

in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact exceeds a first rate of change threshold, animating reversal of the change of the appearance of the background of the first user interface independent of the rate of change of the characteristic intensity of the first contact.

18. The method of claim 1, wherein the dynamic change in the appearance of the background of the first user interface is based in part on a positive rate of change in the characteristic intensity of the first contact.

19. The method of claim 1, wherein a magnitude of the dynamic change in the appearance of the background of the first user interface decays following detection of an impulse force by the first contact.

20. The method of claim 1, including:

while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold;

detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold; and

,

in response to detecting the decrease in the characteristic intensity of the first contact below the first intensity threshold, continuing to dynamically change the appearance of the background of the first user interface based at least in part on the characteristic intensity of the first contact.

21. The method of claim 1, wherein reverting the background of the first user interface back to the first appearance of the background is based on a rate of change of the decrease in the characteristic intensity of the first contact prior to termination of the first input.

22. The method of claim 1, including:

while continuing to detect the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold;

detecting movement of the first contact on the touch-sensitive surface; and

,

in response to detecting the movement of the first contact, dynamically updating the change in the appearance of the background of the first user interface based on the movement of the first contact on the touch-sensitive surface.

23. The method of claim 22, including:

after determining that the first contact has a characteristic intensity above the first intensity threshold, and prior to detecting movement of the first contact on the touch-sensitive surface;

detecting a decrease in the characteristic intensity of the contact below the first intensity threshold.

24. The method of claim 1, including:

in response to detecting the input by the first contact, in accordance with the determination that the first contact has a characteristic intensity above the first intensity threshold, changing an aspect of the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the change of the aspect of the appearance of the background of the first user interface is independent of the position of the focus selector in the background.

25. The method of claim 1, including:

while detecting the first input by the first contact on the touch-sensitive surface, detecting a second input by a second contact on the touch-sensitive surface while a second focus selector is at a location in the first user interface that corresponds to the background of the user interface;

in response to detecting the second input by the second contact;

in accordance with a determination that the second contact does not have a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact; and

,

in accordance with a determination that the second contact has a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on

the characteristic intensity of the first contact,

the characteristic intensity of the second contact, and

positions of the first and second focus selectors on the display;

while dynamically changing the appearance of the background of the first user interface, detecting termination of the first input by the first contact and termination of the second input by the second contact; and

,

in response to detecting termination of the first input by the first contact and termination of the second input by the second contact, reverting the background of the first user interface back to the first appearance of the background.

26. The method of claim 1, wherein:

in response to detecting the first input by the first contact on the touch-sensitive surface, in accordance with a determination that the first input does not have a characteristic intensity above the first intensity threshold, maintaining the first appearance of the background of the first user interface.

27. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensity of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a first user interface on the display, wherein the first user interface includes

a background with a first appearance and

one or more foreground objects;

while displaying the first user interface on the display, detecting a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface;

in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact;

while dynamically changing the appearance of the background of the first user interface, detecting termination of the first input by the first contact; and

,

in response to detecting termination of the first input by the first contact, reverting the background of the first user interface back to the first appearance of the background.

28. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface cause the device to:

display a first user interface on the display, wherein the first user interface includes

a background with a first appearance and

one or more foreground objects;

while displaying the first user interface on the display, detect a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface;

in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically change the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact;

while dynamically changing the appearance of the background of the first user interface, detect termination of the first input by the first contact; and

,

in response to detecting termination of the first input by the first contact, revert the background of the first user interface back to the first appearance of the background.