Devices, methods, and graphical user interfaces for generating tactile outputs

• US 10,175,762 B2
• Filed: 08/28/2017
• Issued: 01/08/2019
• Est. Priority Date: 09/06/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Robert, Julien Y., Fox, Tyler M., Moussette, Camille, Miladinov, Viktor, Mouilleseaux, Jean-Pierre M., Cordier, Madeleine S.
• Primary Examiner(s): Abdulselam, Abbas I
• Application Number:
  US15/688,754
• Publication Number:
  US 20180067557A1
• Time in Patent Office: 498 Days
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/177 of tables; using ruled lines

Abstract

An electronic device displays a user interface and detects an occurrence of a first condition that triggers a first user interface event, including display of one or more changes to the user interface, associated with a tactile output. The device is not able to generate the tactile output associated with the first user interface event for a respective amount of time. In response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a first user interface event category, the device delays generation of the first user interface event for at least the respective amount of time, and, thereafter, displays the one or more changes to the user interface in synchronization with generation of the tactile output associated with the first user interface event.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more tactile output generators;

displaying, on the display, a user interface;

detecting an occurrence of a first condition that triggers a first user interface event that is associated with a tactile output, wherein;

generating the first user interface event includes displaying one or more changes to the user interface; and

the device will not be able to generate the tactile output associated with the first user interface event for a respective amount of time; and

in response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a first user interface event category;

delaying generating the first user interface event for at least the respective amount of time; and

after delaying generating the first user interface event for at least the respective amount of time, displaying the one or more changes to the user interface and generating the tactile output that is associated with the first user interface event, wherein the display of the one or more changes to the user interface is synchronized with the generation of the tactile output that is associated with the first user interface event.

2. The method of claim 1, including, when the respective amount of time is a first amount of time, delaying displaying the one or more changes to the user interface for the first amount of time, and when the respective amount of time is a second amount of time, delaying displaying the one or more changes to the user interface for the second amount of time.

3. The method of claim 1, including, in response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a second user interface event category, displaying the one or more changes to the user interface before the respective amount of time has elapsed and generating the tactile output that is associated with the one or more changes in the user interface after the respective amount of time has elapsed.

4. The method of claim 3, wherein:

the first user interface event category includes events where the respective amount of time for the one or more changes to the user interface is flexible; and

the second user interface event category includes events where the respective amount of time for the one or more changes to the user interface is inflexible.

5. The method of claim 3, wherein:

the first user interface event category includes events where the one or more changes to the user interface do not simulate direct manipulation of the user interface by user inputs; and

the second user interface event category includes events where the one or more changes to the user interface simulate direct manipulation of the user interface by user inputs.

6. The method of claim 1, including:

detecting a user input on the touch-sensitive surface that triggers a second user interface event that is associated with a tactile output, wherein generating the second user interface event includes displaying one or more changes to the user interface; and

,

in response to detecting the user input on the touch-sensitive surface, displaying the one or more changes to the user interface for the second user interface event and generating the tactile output that is associated with the second user interface event, wherein a first time interval between the display of the one or more changes to the user interface for the first user interface event and the generation of the tactile output that is associated with the first user interface event is less than a second time interval between the display of the one or more changes to the user interface for the second user interface event and the generation of the tactile output that is associated with the second user interface event.

7. The method of claim 1, wherein the detected occurrence of the first condition includes detected movement of the electronic device that meets predefined input pattern criteria and the one or more changes to the user interface include undoing a previously performed operation.

8. The method of claim 1, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event that does not correspond to a user input currently detected on the touch-sensitive surface.

9. The method of claim 1, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with receiving electronically delivered information from an information source external to the electronic device.

10. The method of claim 1, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with receiving electronically delivered information from an application executed by the electronic device and independent of any user input on the touch-sensitive surface that is detected at the same time as, or immediately preceding, the notification event.

11. The method of claim 1, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with completion of a transaction initiated by a user of the electronic device.

12. The method of claim 1, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is provided to an application programming interface (API) with a value indicating that the one or more changes to the user interface can be delayed until the device is ready to generate the tactile output.

13. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more tactile output generators;

one or more processors; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a user interface;

detecting an occurrence of a first condition that triggers a first user interface event that is associated with a tactile output, wherein;

generating the first user interface event includes displaying one or more changes to the user interface; and

the device will not be able to generate the tactile output associated with the first user interface event for a respective amount of time; and

in response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a first user interface event category;

delaying generating the first user interface event for at least the respective amount of time; and

after delaying generating the first user interface event for at least the respective amount of time, displaying the one or more changes to the user interface and generating the tactile output that is associated with the first user interface event, wherein the display of the one or more changes to the user interface is synchronized with the generation of the tactile output that is associated with the first user interface event.

14. The electronic device of claim 13, wherein the one or more programs include instructions for, when the respective amount of time is a first amount of time, delaying displaying the one or more changes to the user interface for the first amount of time, and when the respective amount of time is a second amount of time, delaying displaying the one or more changes to the user interface for the second amount of time.

15. The electronic device of claim 13, wherein the one or more programs include instructions for, in response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a second user interface event category, displaying the one or more changes to the user interface before the respective amount of time has elapsed and generating the tactile output that is associated with the one or more changes in the user interface after the respective amount of time has elapsed.

16. The electronic device of claim 13, wherein:

the first user interface event category includes events where the respective amount of time for the one or more changes to the user interface is flexible; and

the second user interface event category includes events where the respective amount of time for the one or more changes to the user interface is inflexible.

17. The electronic device of claim 13, wherein:

the first user interface event category includes events where the one or more changes to the user interface do not simulate direct manipulation of the user interface by user inputs;

and the second user interface event category includes events where the one or more changes to the user interface simulate direct manipulation of the user interface by user inputs.

18. The electronic device of claim 13, wherein the one or more programs include instructions for:

detecting a user input on the touch-sensitive surface that triggers a second user interface event that is associated with a tactile output, wherein generating the second user interface event includes displaying one or more changes to the user interface; and

,

in response to detecting the user input on the touch-sensitive surface, displaying the one or more changes to the user interface for the second user interface event and generating the tactile output that is associated with the second user interface event, wherein a first time interval between the display of the one or more changes to the user interface for the first user interface event and the generation of the tactile output that is associated with the first user interface event is less than a second time interval between the display of the one or more changes to the user interface for the second user interface event and the generation of the tactile output that is associated with the second user interface event.

19. The electronic device of claim 13, wherein the detected occurrence of the first condition includes detected movement of the electronic device that meets predefined input pattern criteria and the one or more changes to the user interface include undoing a previously performed operation.

20. The electronic device of claim 13, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event that does not correspond to a user input currently detected on the touch-sensitive surface.

21. The electronic device of claim 13, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with receiving electronically delivered information from an information source external to the electronic device.

22. The electronic device of claim 13, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with receiving electronically delivered information from an application executed by the electronic device and independent of any user input on the touch-sensitive surface that is detected at the same time as, or immediately preceding, the notification event.

23. The electronic device of claim 13, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with completion of a transaction initiated by a user of the electronic device.

24. The electronic device of claim 13, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is provided to an application programming interface (API) with a value indicating that the one or more changes to the user interface can be delayed until the device is ready to generate the tactile output.

25. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display, a touch-sensitive surface, and one or more tactile output generators, cause the device to:

display, on the display, a user interface;

detect an occurrence of a first condition that triggers a first user interface event that is associated with a tactile output, wherein;

generating the first user interface event includes displaying one or more changes to the user interface; and

the device will not be able to generate the tactile output associated with the first user interface event for a respective amount of time; and

in response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a first user interface event category;

delay generating the first user interface event for at least the respective amount of time; and

after delaying generating the first user interface event for at least the respective amount of time, display the one or more changes to the user interface and generate the tactile output that is associated with the first user interface event, wherein the display of the one or more changes to the user interface is synchronized with the generation of the tactile output that is associated with the first user interface event.

26. The non-transitory computer readable storage medium of claim 25, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device, when the respective amount of time is a first amount of time, to delay displaying the one or more changes to the user interface for the first amount of time, and when the respective amount of time is a second amount of time, to delay displaying the one or more changes to the user interface for the second amount of time.

27. The non-transitory computer readable storage medium of claim 25, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device, in response to detecting the occurrence of the first condition, in accordance with a determination that the first user interface event corresponds to a second user interface event category, to display the one or more changes to the user interface before the respective amount of time has elapsed and to generate the tactile output that is associated with the one or more changes in the user interface after the respective amount of time has elapsed.

28. The non-transitory computer readable storage medium of claim 25, wherein

the first user interface event category includes events where the respective amount of time for the one or more changes to the user interface is flexible;

and

the second user interface event category includes events where the respective amount of time for the one or more changes to the user interface is inflexible.

29. The non-transitory computer readable storage medium of claim 25, wherein

the first user interface event category includes events where the one or more changes to the user interface do not simulate direct manipulation of the user interface by user inputs;

and

the second user interface event category includes events where the one or more changes to the user interface simulate direct manipulation of the user interface by user inputs.

30. The non-transitory computer readable storage medium of claim 25, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to:

detect a user input on the touch-sensitive surface that triggers a second user interface event that is associated with a tactile output, wherein generating the second user interface event includes displaying one or more changes to the user interface; and

,

in response to detecting the user input on the touch-sensitive surface, display the one or more changes to the user interface for the second user interface event and generate the tactile output that is associated with the second user interface event, wherein a first time interval between the display of the one or more changes to the user interface for the first user interface event and the generation of the tactile output that is associated with the first user interface event is less than a second time interval between the display of the one or more changes to the user interface for the second user interface event and the generation of the tactile output that is associated with the second user interface event.

31. The non-transitory computer readable storage medium of claim 25, wherein the detected occurrence of the first condition includes detected movement of the electronic device that meets predefined input pattern criteria and the one or more changes to the user interface include undoing a previously performed operation.

32. The non-transitory computer readable storage medium of claim 25, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event that does not correspond to a user input currently detected on the touch-sensitive surface.

33. The non-transitory computer readable storage medium of claim 25, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with receiving electronically delivered information from an information source external to the electronic device.

34. The non-transitory computer readable storage medium of claim 25, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with receiving electronically delivered information from an application executed by the electronic device and independent of any user input on the touch-sensitive surface that is detected at the same time as, or immediately preceding, the notification event.

35. The non-transitory computer readable storage medium of claim 25, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is a notification event initiated in accordance with completion of a transaction initiated by a user of the electronic device.

36. The non-transitory computer readable storage medium of claim 25, wherein the determination that the first user interface event corresponds to the first user interface event category includes a determination that the first user interface event is provided to an application programming interface (API) with a value indicating that the one or more changes to the user interface can be delayed until the device is ready to generate the tactile output.