Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface

• US 10,942,570 B2
• Filed: 01/04/2019
• Issued: 03/09/2021
• Est. Priority Date: 05/09/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Missig, Julian
• Primary Examiner(s): Nguyen, Phuong H
• Application Number:
  US16/240,676
• Publication Number:
  US 20190138102A1
• Time in Patent Office: 795 Days
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

An electronic device with a touch-sensitive surface and a display displays a representation of a clock on the display, detects an input directed to the representation of the clock, while detecting the input directed to the representation of the clock, and provides tactile feedback that corresponds to the clock, wherein the tactile feedback includes a regular pattern of tactile outputs on the touch-sensitive surface. While providing the tactile feedback, the device detects that the input is no longer directed to the representation of the clock, and in response to detecting that the input is no longer directed to the representation of the clock, ceases to provide the tactile feedback corresponding to the clock.

Claims

1. A method, comprising:

at an electronic device with a touch-sensitive surface and a display;

displaying a plurality of user interface objects on the display, wherein;

the plurality of user interface objects have a z-order;

the plurality of user interface objects includes a first user interface object and a second user interface object; and

the first user interface object is above the second user interface object in the z-order;

while detecting a contact on the touch-sensitive surface, receiving a request to move the first user interface object below the second user interface object in the z-order; and

in response to the request;

moving the first user interface object below the second user interface object in the z-order;

in accordance with a determination that the first user interface object overlaps at least a portion of the second user interface object, generating a tactile output associated with moving the first user interface object below the second user interface object in conjunction with moving the first user interface object below the second user interface object; and

in accordance with a determination that the first user interface object does not overlap the second user interface object, forgoing generating the tactile output associated with moving the first user interface object below the second user interface object.

2. The method of claim 1, wherein the first user interface object overlaps at least a portion of the second user interface object when at least a portion of the first user interface object covers at least a portion of the second user interface object.

3. The method of claim 1, wherein receiving the request to move the first user interface object below the second user interface object includes, while a focus selector is over the first user interface object, detecting an increase in intensity of the contact above a respective intensity threshold.

4. The method of claim 1, wherein receiving the request to move the first user interface object below the second user interface object includes, while displaying a control for changing a z-order of the first user interface object, detecting an input on the control that corresponds to moving the first user interface object downward in the z-order.

5. The method of claim 1, wherein receiving the request to move the first user interface object below the second user interface object includes, while displaying a control for changing a z-order of the second user interface object, detecting an input on the control that corresponds to moving the second user interface object upward in the z-order.

6. The method of claim 1, wherein:

the plurality of user interface objects includes an intervening user interface object;

the intervening user interface object has a position in the z-order between the first user interface object and the second user interface object; and

the method includes, in response to the request to move the first user interface object below the second user interface object in the z-order;

moving the first user interface object below the intervening user interface object in the z-order prior to moving the first user interface object below the second user interface object in the z-order;

in accordance with a determination that the first user interface object overlaps at least a portion of the intervening user interface object, generating, on the touch-sensitive surface, a tactile output associated with moving the first user interface object below the intervening user interface object in conjunction with moving the first user interface object below the intervening user interface object; and

in accordance with a determination that the first user interface object does not overlap the intervening user interface object, forgoing generating the tactile output associated with moving the first user interface object below the intervening user interface object.

7. The method of claim 6, wherein:

the first user interface object overlaps the intervening user interface object and the second user interface object;

the method includes, in response to the request to move the first user interface object below the second user interface object in the z-order;

generating a first tactile output, on the touch-sensitive surface, associated with moving the first user interface object below the intervening user interface object, prior to moving the first user interface object below the second user interface object in the z-order; and

generating a second tactile output, on the touch-sensitive surface, associated with moving the first user interface object below the second user interface object, wherein the first tactile output is different from the second tactile output.

8. The method of claim 7, wherein:

the first tactile output is generated by movement of the touch-sensitive surface that includes a first dominant movement component;

the second tactile output is generated by movement of the touch-sensitive surface that includes a second dominant movement component; and

the first dominant movement component and the second dominant movement component have different wavelengths.

9. The method of claim 8, wherein:

the wavelength of the first dominant movement component is determined based on a position of the intervening user interface object in the z-order; and

the wavelength of the second dominant movement component is determined based on a position of the second user interface object in the z-order.

10. The method of claim 8, wherein the wavelength of the first dominant movement component is determined based on a number of user interface objects that the first user interface object overlaps that are between the first user interface object and the intervening user interface object in the z-order.

11. The method of claim 8, wherein the wavelength of the second dominant movement component is determined based on a number of user interface objects that the first user interface object overlaps that are between the first user interface object and the second user interface object in the z-order.

12. The method of claim 1, wherein the tactile output associated with moving the first user interface object below the second user interface object has a wavelength that is determined based on a position of the second user interface object in the z-order prior to receiving the request to move the first user interface object below the second user interface object in the z-order.

13. The method of claim 1, wherein the first user interface object overlaps a plurality of other user interface objects arranged in a respective z-order sequence and a next tactile output corresponding to movement of the first user interface object below a next user interface object in the respective z-order sequence is based on a mathematical progression from a prior tactile output corresponding to movement of the first user interface object below a prior user interface object in the respective z-order sequence.

14. The method of claim 1, wherein the first user interface object overlaps a plurality of other user interface objects arranged in a respective z-order sequence and a next tactile output corresponding to movement of the first user interface object below a next user interface object in the respective z-order sequence is based on a musical progression from a prior tactile output corresponding to movement of the first user interface object below a prior user interface object in the respective z-order sequence.

15. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a plurality of user interface objects on the display, wherein;

the plurality of user interface objects have a z-order;

the plurality of user interface objects includes a first user interface object and a second user interface object; and

the first user interface object is above the second user interface object in the z-order;

while detecting a contact on the touch-sensitive surface, receiving a request to move the first user interface object below the second user interface object in the z-order; and

in response to the request;

moving the first user interface object below the second user interface object in the z-order;

in accordance with a determination that the first user interface object overlaps at least a portion of the second user interface object, generating a tactile output associated with moving the first user interface object below the second user interface object in conjunction with moving the first user interface object below the second user interface object; and

in accordance with a determination that the first user interface object does not overlap the second user interface object, forgoing generating the tactile output associated with moving the first user interface object below the second user interface object.

17. The electronic device of claim 15, wherein the first user interface object overlaps at least a portion of the second user interface object when at least a portion of the first user interface object covers at least a portion of the second user interface object.

18. The electronic device of claim 15, wherein receiving the request to move the first user interface object below the second user interface object includes, while a focus selector is over the first user interface object, detecting an increase in intensity of the contact above a respective intensity threshold.

19. The electronic device of claim 15, wherein receiving the request to move the first user interface object below the second user interface object includes, while displaying a control for changing a z-order of the first user interface object, detecting an input on the control that corresponds to moving the first user interface object downward in the z-order.

20. The electronic device of claim 15, wherein receiving the request to move the first user interface object below the second user interface object includes, while displaying a control for changing a z-order of the second user interface object, detecting an input on the control that corresponds to moving the second user interface object upward in the z-order.

21. The electronic device of claim 15, wherein:

the plurality of user interface objects includes an intervening user interface object;

the intervening user interface object has a position in the z-order between the first user interface object and the second user interface object; and

the one or more programs include instructions for;

in response to the request to move the first user interface object below the second user interface object in the z-order;

moving the first user interface object below the intervening user interface object in the z-order prior to moving the first user interface object below the second user interface object in the z-order;

in accordance with a determination that the first user interface object overlaps at least a portion of the intervening user interface object, generating, on the touch-sensitive surface, a tactile output associated with moving the first user interface object below the intervening user interface object in conjunction with moving the first user interface object below the intervening user interface object; and

in accordance with a determination that the first user interface object does not overlap the intervening user interface object, forgoing generating the tactile output associated with moving the first user interface object below the intervening user interface object.

22. The electronic device of claim 21, wherein:

the first user interface object overlaps the intervening user interface object and the second user interface object; and

the one or more programs include instructions for;

in response to the request to move the first user interface object below the second user interface object in the z-order;

generating a first tactile output, on the touch-sensitive surface, associated with moving the first user interface object below the intervening user interface object, prior to moving the first user interface object below the second user interface object in the z-order; and

generating a second tactile output, on the touch-sensitive surface, associated with moving the first user interface object below the second user interface object, wherein the first tactile output is different from the second tactile output.

23. The electronic device of claim 22, wherein:

the first tactile output is generated by movement of the touch-sensitive surface that includes a first dominant movement component;

the second tactile output is generated by movement of the touch-sensitive surface that includes a second dominant movement component; and

the first dominant movement component and the second dominant movement component have different wavelengths.

24. The electronic device of claim 23, wherein:

the wavelength of the first dominant movement component is determined based on a position of the intervening user interface object in the z-order; and

the wavelength of the second dominant movement component is determined based on a position of the second user interface object in the z-order.

25. The electronic device of claim 23, wherein the wavelength of the first dominant movement component is determined based on a number of user interface objects that the first user interface object overlaps that are between the first user interface object and the intervening user interface object in the z-order.

26. The electronic device of claim 23, wherein the wavelength of the second dominant movement component is determined based on a number of user interface objects that the first user interface object overlaps that are between the first user interface object and the second user interface object in the z-order.

27. The electronic device of claim 15, wherein the tactile output associated with moving the first user interface object below the second user interface object has a wavelength that is determined based on a position of the second user interface object in the z-order prior to receiving the request to move the first user interface object below the second user interface object in the z-order.

28. The electronic device of claim 15, wherein the first user interface object overlaps a plurality of other user interface objects arranged in a respective z-order sequence and a next tactile output corresponding to movement of the first user interface object below a next user interface object in the respective z-order sequence is based on a mathematical progression from a prior tactile output corresponding to movement of the first user interface object below a prior user interface object in the respective z-order sequence.

29. The electronic device of claim 15, wherein the first user interface object overlaps a plurality of other user interface objects arranged in a respective z-order sequence and a next tactile output corresponding to movement of the first user interface object below a next user interface object in the respective z-order sequence is based on a musical progression from a prior tactile output corresponding to movement of the first user interface object below a prior user interface object in the respective z-order sequence.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the electronic device to:

display a plurality of user interface objects on the display, wherein;

the plurality of user interface objects have a z-order;

the plurality of user interface objects includes a first user interface object and a second user interface object; and

the first user interface object is above the second user interface object in the z-order;

while detecting a contact on the touch-sensitive surface, receive a request to move the first user interface object below the second user interface object in the z-order; and

in response to the request;

move the first user interface object below the second user interface object in the z-order;

in accordance with a determination that the first user interface object overlaps at least a portion of the second user interface object, generate a tactile output associated with moving the first user interface object below the second user interface object in conjunction with moving the first user interface object below the second user interface object; and

in accordance with a determination that the first user interface object does not overlap the second user interface object, forgo generating the tactile output associated with moving the first user interface object below the second user interface object.

30. The non-transitory computer readable storage medium of claim 16, wherein the first user interface object overlaps at least a portion of the second user interface object when at least a portion of the first user interface object covers at least a portion of the second user interface object.

31. The non-transitory computer readable storage medium of claim 16, wherein receiving the request to move the first user interface object below the second user interface object includes, while a focus selector is over the first user interface object, detecting an increase in intensity of the contact above a respective intensity threshold.

32. The non-transitory computer readable storage medium of claim 16, wherein receiving the request to move the first user interface object below the second user interface object includes, while displaying a control for changing a z-order of the first user interface object, detecting an input on the control that corresponds to moving the first user interface object downward in the z-order.

33. The non-transitory computer readable storage medium of claim 16, wherein receiving the request to move the first user interface object below the second user interface object includes, while displaying a control for changing a z-order of the second user interface object, detecting an input on the control that corresponds to moving the second user interface object upward in the z-order.

34. The non-transitory computer readable storage medium of claim 16, wherein:

the plurality of user interface objects includes an intervening user interface object;

the intervening user interface object has a position in the z-order between the first user interface object and the second user interface object; and

the one or more programs include instructions, which when executed by the electronic device, cause the electronic device to;

in response to the request to move the first user interface object below the second user interface object in the z-order;

move the first user interface object below the intervening user interface object in the z-order prior to moving the first user interface object below the second user interface object in the z-order;

in accordance with a determination that the first user interface object overlaps at least a portion of the intervening user interface object, generate, on the touch-sensitive surface, a tactile output associated with moving the first user interface object below the intervening user interface object in conjunction with moving the first user interface object below the intervening user interface object; and

in accordance with a determination that the first user interface object does not overlap the intervening user interface object, forgo generating the tactile output associated with moving the first user interface object below the intervening user interface object.

35. The non-transitory computer readable storage medium of claim 34, wherein:

the first user interface object overlaps the intervening user interface object and the second user interface object;

the one or more programs include instructions, which when executed by the electronic device, cause the electronic device to;

in response to the request to move the first user interface object below the second user interface object in the z-order;

generate a first tactile output, on the touch-sensitive surface, associated with moving the first user interface object below the intervening user interface object, prior to moving the first user interface object below the second user interface object in the z-order; and

generate a second tactile output, on the touch-sensitive surface, associated with moving the first user interface object below the second user interface object, wherein the first tactile output is different from the second tactile output.

36. The non-transitory computer readable storage medium of claim 35, wherein:

the first tactile output is generated by movement of the touch-sensitive surface that includes a first dominant movement component;

the second tactile output is generated by movement of the touch-sensitive surface that includes a second dominant movement component; and

the first dominant movement component and the second dominant movement component have different wavelengths.

37. The non-transitory computer readable storage medium of claim 36, wherein:

the wavelength of the first dominant movement component is determined based on a position of the intervening user interface object in the z-order; and

the wavelength of the second dominant movement component is determined based on a position of the second user interface object in the z-order.

38. The non-transitory computer readable storage medium of claim 36, wherein the wavelength of the first dominant movement component is determined based on a number of user interface objects that the first user interface object overlaps that are between the first user interface object and the intervening user interface object in the z-order.

39. The non-transitory computer readable storage medium of claim 36, wherein the wavelength of the second dominant movement component is determined based on a number of user interface objects that the first user interface object overlaps that are between the first user interface object and the second user interface object in the z-order.

40. The non-transitory computer readable storage medium of claim 16, wherein the tactile output associated with moving the first user interface object below the second user interface object has a wavelength that is determined based on a position of the second user interface object in the z-order prior to receiving the request to move the first user interface object below the second user interface object in the z-order.

41. The non-transitory computer readable storage medium of claim 16, wherein the first user interface object overlaps a plurality of other user interface objects arranged in a respective z-order sequence and a next tactile output corresponding to movement of the first user interface object below a next user interface object in the respective z-order sequence is based on a mathematical progression from a prior tactile output corresponding to movement of the first user interface object below a prior user interface object in the respective z-order sequence.

42. The non-transitory computer readable storage medium of claim 16, wherein the first user interface object overlaps a plurality of other user interface objects arranged in a respective z-order sequence and a next tactile output corresponding to movement of the first user interface object below a next user interface object in the respective z-order sequence is based on a musical progression from a prior tactile output corresponding to movement of the first user interface object below a prior user interface object in the respective z-order sequence.