Devices, methods, and graphical user interfaces for generating tactile outputs

• US 10,620,708 B2
• Filed: 07/10/2019
• Issued: 04/14/2020
• Est. Priority Date: 09/06/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Robert, Julien Y., Fox, Tyler M., Moussette, Camille, Miladinov, Viktor, Mouilleseaux, Jean-Pierre M., Cordier, Madeleine S.
• Primary Examiner(s): Abdulselam, Abbas I
• Application Number:
  US16/508,218
• Publication Number:
  US 20190332179A1
• Time in Patent Office: 279 Days
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/177 of tables; using ruled lines

Abstract

An electronic device displaying a user interface on a display. While displaying the user interface on the display and while one or more tactile output generators of the electronic device are in a low-power state, the electronic device detects a first user interaction via the touch-sensitive surface. In response to detecting the first user interaction, the electronic device sets the one or more tactile output generators to a low-latency state. After setting the one or more tactile output generators to the low-latency state, the electronic device detects a second user interaction that is part of a same sequence of user interactions as the first user interaction. In response to detecting the second user interaction, the electronic device generates a tactile output that corresponds to the second user interaction.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more tactile output generators;

displaying a user interface on the display;

while displaying the user interface on the display and while the one or more tactile output generators are in a low-power state, detecting a first user interaction via the touch-sensitive surface;

in response to detecting the first user interaction, setting the one or more tactile output generators to a low-latency state;

after setting the one or more tactile output generators to the low-latency state, detecting a second user interaction that is part of a same sequence of user interactions as the first user interaction; and

in response to detecting the second user interaction, generating a tactile output that corresponds to the second user interaction.

2. The method of claim 1, wherein the first user interaction and the second user interaction are detected as part of a continuous touch input on the touch-sensitive surface that traverses a sequence of components of the user interface displayed on the display.

3. The method of claim 1, wherein the first user interaction is touchdown of a contact on the touch-sensitive surface.

4. The method of claim 1, wherein the first user interaction is a change in a contact after detecting touchdown of the contact on the touch-sensitive surface.

5. The method of claim 1, wherein:

a monitoring function tracks a progress of the sequence of user interactions;

the one or more tactile output generators are changed to the low-latency state based on a determination that the monitoring function has entered a start state in which the monitoring function has started monitoring the sequence of user interactions; and

the tactile output is generated based on a determination that the monitoring function has entered a changed state.

6. The method of claim 1, wherein:

a monitoring function tracks a progress of the sequence of user interactions;

the one or more tactile output generators are changed to the low-latency state based on a determination that the monitoring function has entered a changed state that precedes a changed state that corresponds to a tactile output; and

the tactile output is generated based on a determination that the monitoring function has entered the changed state that corresponds to a tactile output.

7. The method of claim 1, including:

detecting an end of the sequence of user interactions; and

,

in response to detecting the end of the sequence of user interactions, setting the one or more tactile output generators to the low-power state.

8. The method of claim 7, wherein a monitoring function tracks a progress of the sequence of user interactions, and the one or more tactile output generators are set to the low-power state based on a determination that the monitoring function has entered an end state.

9. The method of claim 1, wherein the sequence of user interactions corresponds to a continuous touch input on the touch-sensitive surface that traverses a sequence of components of the user interface displayed on the display, and the method further includes generating a sequence of two or more tactile outputs using identical waveforms.

10. The method of claim 1, including, after generating the tactile output in response to detecting the second user interaction, forgoing generation of a subsequent tactile output in response to detecting a third user interaction that is part of the same sequence of user interactions as the first user interaction and the second user interaction, in accordance with a determination that the third user interaction occurred less than a predefined time duration from the second user interaction.

11. The method of claim 1, including scrolling a set of menu items in response to user input on the touch-sensitive surface, wherein the sequence of user interactions comprises a sequence of respective menu items in the set of menu items scrolling to or through a selection position in the user interface.

12. The method of claim 1, including scrolling a set of date component or time component items in response to user input on the touch-sensitive surface, wherein the sequence of user interactions comprises a sequence of date component or time component items scrolling to or through a selection position in the user interface.

13. The method of claim 1, wherein the sequence of user interactions corresponds to a touch input on the touch-sensitive surface that traverses a sequence of soft keys displayed on the display, and the method further includes generating one or more tactile outputs that correspond to the touch input reaching predefined positions with respect to the sequence of soft keys.

14. The method of claim 1, wherein the sequence of user interactions includes a sequence of events corresponding to distinct phases of dragging an object, in the user interface displayed on the display, from an initial location to another location.

15. The method of claim 14, wherein the distinct phases of dragging the object include an object lifting phase and an object dropping phase.

16. The method of claim 14, wherein the distinct phases of dragging the object include an object snapping phase, corresponding to the object snapping into place with respect to a user interface feature, and the tactile output corresponds to the object snapping into place with respect to the user interface feature.

17. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more tactile output generators;

one or more processors; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

displaying a user interface on the display;

while displaying the user interface on the display and while the one or more tactile output generators are in a low-power state, detecting a first user interaction via the touch-sensitive surface;

in response to detecting the first user interaction, setting the one or more tactile output generators to a low-latency state;

after setting the one or more tactile output generators to the low-latency state, detecting a second user interaction that is part of a same sequence of user interactions as the first user interaction; and

in response to detecting the second user interaction, generating a tactile output that corresponds to the second user interaction.

18. The electronic device of claim 17, wherein the first user interaction and the second user interaction are detected as part of a continuous touch input on the touch-sensitive surface that traverses a sequence of components of the user interface displayed on the display.

19. The electronic device of claim 17, wherein the first user interaction is touchdown of a contact on the touch-sensitive surface.

20. The electronic device of claim 17, wherein the first user interaction is a change in a contact after detecting touchdown of the contact on the touch-sensitive surface.

21. The electronic device of claim 17, wherein:

a monitoring function tracks a progress of the sequence of user interactions;

the one or more tactile output generators are changed to the low-latency state based on a determination that the monitoring function has entered a start state in which the monitoring function has started monitoring the sequence of user interactions; and

the tactile output is generated based on a determination that the monitoring function has entered a changed state.

22. The electronic device of claim 17, wherein:

a monitoring function tracks a progress of the sequence of user interactions;

the one or more tactile output generators are changed to the low-latency state based on a determination that the monitoring function has entered a changed state that precedes a changed state that corresponds to a tactile output; and

the tactile output is generated based on a determination that the monitoring function has entered the changed state that corresponds to a tactile output.

23. The electronic device of claim 17, wherein the one or more programs include instructions for:

detecting an end of the sequence of user interactions; and

,

in response to detecting the end of the sequence of user interactions, setting the one or more tactile output generators to the low-power state.

24. The electronic device of claim 23, wherein a monitoring function tracks a progress of the sequence of user interactions, and the one or more tactile output generators are set to the low-power state based on a determination that the monitoring function has entered an end state.

25. The electronic device of claim 17, wherein the sequence of user interactions corresponds to a continuous touch input on the touch-sensitive surface that traverses a sequence of components of the user interface displayed on the display, and the one or more programs further include instructions for generating a sequence of two or more tactile outputs using identical waveforms.

26. The electronic device of claim 17, wherein the one or more programs include instructions for, after generating the tactile output in response to detecting the second user interaction, forgoing generation of a subsequent tactile output in response to detecting a third user interaction that is part of the same sequence of user interactions as the first user interaction and the second user interaction, in accordance with a determination that the third user interaction occurred less than a predefined time duration from the second user interaction.

27. The electronic device of claim 17, wherein the one or more programs include instructions for scrolling a set of menu items in response to user input on the touch-sensitive surface, wherein the sequence of user interactions comprises a sequence of respective menu items in the set of menu items scrolling to or through a selection position in the user interface.

28. The electronic device of claim 17, wherein the one or more programs include instructions for scrolling a set of date component or time component items in response to user input on the touch-sensitive surface, wherein the sequence of user interactions comprises a sequence of date component or time component items scrolling to or through a selection position in the user interface.

29. The electronic device of claim 17, wherein the sequence of user interactions corresponds to a touch input on the touch-sensitive surface that traverses a sequence of soft keys displayed on the display, and the one or more programs further include instructions for generating one or more tactile outputs that correspond to the touch input reaching predefined positions with respect to the sequence of soft keys.

30. The electronic device of claim 17, wherein the sequence of user interactions includes a sequence of events corresponding to distinct phases of dragging an object, in the user interface displayed on the display, from an initial location to another location.

31. The electronic device of claim 30, wherein the distinct phases of dragging the object include an object lifting phase and an object dropping phase.

32. The electronic device of claim 30, wherein the distinct phases of dragging the object include an object snapping phase, corresponding to the object snapping into place with respect to a user interface feature, and the tactile output corresponds to the object snapping into place with respect to the user interface feature.

33. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an electronic device with a display, a touch-sensitive surface, and one or more tactile output generators, cause the electronic device to:

display a user interface on the display;

while displaying the user interface on the display and while the one or more tactile output generators are in a low-power state, detect a first user interaction via the touch-sensitive surface;

in response to detecting the first user interaction, set the one or more tactile output generators to a low-latency state;

after setting the one or more tactile output generators to the low-latency state, detect a second user interaction that is part of a same sequence of user interactions as the first user interaction; and

in response to detecting the second user interaction, generate a tactile output that corresponds to the second user interaction.

34. The non-transitory computer readable storage medium of claim 33, wherein the first user interaction and the second user interaction are detected as part of a continuous touch input on the touch-sensitive surface that traverses a sequence of components of the user interface displayed on the display.

35. The non-transitory computer readable storage medium of claim 33, wherein the first user interaction is touchdown of a contact on the touch-sensitive surface.

36. The non-transitory computer readable storage medium of claim 33, wherein the first user interaction is a change in a contact after detecting touchdown of the contact on the touch-sensitive surface.

37. The non-transitory computer readable storage medium of claim 33, wherein:

a monitoring function tracks a progress of the sequence of user interactions;

the one or more tactile output generators are changed to the low-latency state based on a determination that the monitoring function has entered a start state in which the monitoring function has started monitoring the sequence of user interactions; and

the tactile output is generated based on a determination that the monitoring function has entered a changed state.

38. The non-transitory computer readable storage medium of claim 33, wherein:

a monitoring function tracks a progress of the sequence of user interactions;

the one or more tactile output generators are changed to the low-latency state based on a determination that the monitoring function has entered a changed state that precedes a changed state that corresponds to a tactile output; and

the tactile output is generated based on a determination that the monitoring function has entered the changed state that corresponds to a tactile output.

39. The non-transitory computer readable storage medium of claim 33, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to:

detect an end of the sequence of user interactions; and

,

in response to detecting the end of the sequence of user interactions, set the one or more tactile output generators to the low-power state.

40. The non-transitory computer readable storage medium of claim 39, wherein a monitoring function tracks a progress of the sequence of user interactions, and the one or more tactile output generators are set to the low-power state based on a determination that the monitoring function has entered an end state.

41. The non-transitory computer readable storage medium of claim 33, wherein the sequence of user interactions corresponds to a continuous touch input on the touch-sensitive surface that traverses a sequence of components of the user interface displayed on the display, and the one or more programs further include instructions that, when executed by the electronic device, cause the electronic device to generate a sequence of two or more tactile outputs using identical waveforms.

42. The non-transitory computer readable storage medium of claim 33, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device, after generating the tactile output in response to detecting the second user interaction, to forgo generation of a subsequent tactile output in response to detecting a third user interaction that is part of the same sequence of user interactions as the first user interaction and the second user interaction, in accordance with a determination that the third user interaction occurred less than a predefined time duration from the second user interaction.

43. The non-transitory computer readable storage medium of claim 33, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to scroll a set of menu items in response to user input on the touch-sensitive surface, wherein the sequence of user interactions comprises a sequence of respective menu items in the set of menu items scrolling to or through a selection position in the user interface.

44. The non-transitory computer readable storage medium of claim 33, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to scroll a set of date component or time component items in response to user input on the touch-sensitive surface, wherein the sequence of user interactions comprises a sequence of date component or time component items scrolling to or through a selection position in the user interface.

45. The non-transitory computer readable storage medium of claim 33, wherein the sequence of user interactions corresponds to a touch input on the touch-sensitive surface that traverses a sequence of soft keys displayed on the display, and the one or more programs further include instructions that, when executed by the electronic device, cause the electronic device to generate one or more tactile outputs that correspond to the touch input reaching predefined positions with respect to the sequence of soft keys.

46. The non-transitory computer readable storage medium of claim 33, wherein the sequence of user interactions includes a sequence of events corresponding to distinct phases of dragging an object, in the user interface displayed on the display, from an initial location to another location.

47. The non-transitory computer readable storage medium of claim 46, wherein the distinct phases of dragging the object include an object lifting phase and an object dropping phase.

48. The non-transitory computer readable storage medium of claim 46, wherein the distinct phases of dragging the object include an object snapping phase, corresponding to the object snapping into place with respect to a user interface feature, and the tactile output corresponds to the object snapping into place with respect to the user interface feature.