Content-based tactile outputs

• US 10,712,824 B2
• Filed: 09/27/2018
• Issued: 07/14/2020
• Est. Priority Date: 09/11/2018
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Moussette, Camille, Bloom, David H., Butcher, Gary Ian, Edwards, Dylan Ross, Fennis, Jules K., Gleeson, Brian T., He, Miao
• Primary Examiner(s): Baderman, Scott T
• Assistant Examiner(s): Mrabi, Hassan
• Application Number:
  US16/144,950
• Publication Number:
  US 20200081538A1
• Time in Patent Office: 656 Days
• Field of Search: 715702
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present disclosure generally relates to content-based tactile outputs. In some embodiments, user interfaces associated with content-based tactile outputs are described. In some embodiments, user interfaces associated with end-of-content tactile outputs are described. In some embodiments, user interfaces associated with moving a user interface in response to different types of input are described. In some embodiments, user interfaces associated with adjustable item-based tactile outputs are described. In some embodiments, user interfaces associated with input velocity-based tactile outputs are described.

Claims

1. An electronic device, comprising:

a display;

a rotatable input element;

one or more tactile output generators;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a user interface;

while displaying the user interface, detecting, via the rotatable input element, a first input; and

in response to detecting the first input;

navigating through the user interface, wherein navigating through the user interface comprises;

moving a first portion of the user interface off of the display such that the first portion of the user interface is no longer visible on the display; and

while moving the first portion of the user interface off of the display, concurrently moving a second portion of the user interface onto the display such that the second portion of the user interface becomes visible on the display; and

generating, via the one or more tactile output generators, tactile output corresponding to the navigation through the user interface, including;

in accordance with a determination that a currently-displayed portion of the user interface includes a first type of content, the tactile output corresponding to the navigation includes a first type of tactile output sequence that includes one or more tactile outputs determined based on an amount or speed of rotation of the rotatable input element caused by the first input; and

in accordance with a determination that the currently-displayed portion of the user interface includes a second type of content different from the first type of content, the tactile output corresponding to the navigation includes a second type of tactile output sequence that includes one or more tactile outputs determined based on an amount of movement of predefined units of content on the display, and while navigating through the user interface, generating the tactile output comprises generating the tactile output in response to a movement of a first predefined unit of content into alignment on the display.

2. The electronic device of claim 1, wherein the first type of tactile output sequence is different from the second type of tactile output sequence.

3. The electronic device of claim 1, wherein:

the first type of tactile output sequence is determined independently of the movement of content in the user interface.

4. The electronic device of claim 1, wherein the predefined units of content correspond to visually distinguished content elements within the content.

5. The electronic device of claim 1, wherein the user interface does not include content that is the second type of content.

6. The electronic device of claim 1, wherein the user interface does not include content that is the first type of content.

7. The electronic device of claim 1, wherein the one or more programs further include instructions for:

generating, via the one or more tactile output generators, tactile output corresponding to the navigation through the user interface, further including;

in accordance with a determination that the user interface is displaying a terminal portion of the first type of content, the tactile output corresponding to the navigation includes a third type of tactile output sequence, different from the first type of tactile output sequence, indicating that the content is at the terminal portion; and

in accordance with a determination that the user interface is not displaying a terminal portion of the first type of content, the tactile output portion corresponding to the navigation does not include the third type of tactile output sequence.

8. The electronic device of claim 1, wherein, in accordance with the determination that the user interface includes the second type of content, and:

in accordance with a determination that the predefined units of content are of a first type, the tactile output has a first amplitude; and

in accordance with a determination that the predefined units of content are of a second type different from the first type;

the tactile output has a second amplitude smaller than the first amplitude.

9. The electronic device of claim 1, wherein the number of tactile outputs generated in the first type of tactile output sequence corresponds to a speed of the first input, wherein the first input is a rotational input on the rotatable input element.

10. The electronic device of claim 1, including, while navigating through the user interface, in accordance with the determination that the currently-displayed portion of the user interface includes the second type of content, generating the tactile output comprises generating the tactile output in response a movement of a first predefined unit of content out of alignment on the display.

11. The electronic device of claim 1, wherein the one or more programs further include instructions for:

displaying, on the display, a second user interface different from the user interface;

while displaying the second user interface, detecting, via the rotatable input element, a second input; and

in response to detecting the second input;

in accordance with a determination that the second input does not cause a navigation of the second user interface, forgoing generating, via the one or more tactile output generators, a tactile output; and

in accordance with a determination that the second input causes a navigation of the second user interface, generating, via the one or more tactile output generators, the tactile output.

12. The electronic device of claim 11, wherein the second user interface corresponds to a notification, and wherein the notification replaces display of the user interface.

13. The electronic device of claim 1, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting, via a second input element different from the rotatable input element, a second input; and

in response to detecting the second input;

navigating through the user interface; and

forgoing generating, via the one or more tactile output generators, the tactile output corresponding to the navigation through the user interface.

14. The electronic device of claim 1, wherein the one or more programs further include instructions for:

in response to detecting the first input;

generating audio output associated with the tactile output corresponding to the navigation through the user interface, including;

in accordance with the determination that the currently-displayed portion of the user interface includes the first type of content, the audio output includes a first type of audio output sequence that is associated with the first type of tactile output sequence; and

in accordance with the determination that the currently-displayed portion of the user interface includes the second type of content, the audio output includes a second type of audio output sequence that is associated with the second type of tactile output sequence.

15. The electronic device of claim 1, wherein the one or more programs further include instructions for:

in accordance with a determination that an event triggering a notification is detected while not detecting input via the rotatable input element, generating a tactile output corresponding to the notification; and

in accordance with a determination that the event triggering the notification is detected while detecting input via the rotatable input element, forgoing generating the tactile output corresponding to the notification.

16. The electronic device of claim 1, wherein the one or more programs further include instructions for:

in accordance with a determination that an event triggering a notification is detected while detecting the first input, forgoing generating a tactile output corresponding to the notification until predefined criteria are met; and

in response to a determination that the predetermined criteria have been met, generating the tactile output corresponding to the notification.

17. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display, a rotatable input element, and one or more tactile output generators, the one or more programs including instructions for:

displaying, on the display, a user interface;

while displaying the user interface, detecting, via the rotatable input element, a first input; and

in response to detecting the first input;

navigating through the user interface, wherein navigating through the user interface comprises;

moving a first portion of the user interface off of the display such that the first portion of the user interface is no longer visible on the display; and

while moving the first portion of the user interface off of the display, concurrently moving a second portion of the user interface onto the display such that the second portion of the user interface becomes visible on the display; and

generating, via the one or more tactile output generators, tactile output corresponding to the navigation through the user interface, including;

in accordance with a determination that a currently-displayed portion of the user interface includes a first type of content, the tactile output corresponding to the navigation includes a first type of tactile output sequence that includes one or more tactile outputs determined based on an amount or speed of rotation of the rotatable input element caused by the first input; and

in accordance with a determination that the currently-displayed portion of the user interface includes a second type of content different from the first type of content, the tactile output corresponding to the navigation includes a second type of tactile output sequence that includes one or more tactile outputs determined based on an amount of movement of predefined units of content on the display, and while navigating through the user interface, generating the tactile output comprises generating the tactile output in response to a movement of a first predefined unit of content into alignment on the display.

18. The non-transitory computer-readable storage medium of claim 17, wherein the first type of tactile output sequence is different from the second type of tactile output sequence.

19. The non-transitory computer-readable storage medium of claim 17, wherein:

the first type of tactile output sequence is determined independently of the movement of content in the user interface.

20. The non-transitory computer-readable storage medium of claim 17, wherein the predefined units of content correspond to visually distinguished content elements within the content.

21. The non-transitory computer-readable storage medium of claim 17, wherein the user interface does not include content that is the second type of content.

22. The non-transitory computer-readable storage medium of claim 17, wherein the user interface does not include content that is the first type of content.

23. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

generating, via the one or more tactile output generators, tactile output corresponding to the navigation through the user interface, further including;

in accordance with a determination that the user interface is displaying a terminal portion of the first type of content, the tactile output corresponding to the navigation includes a third type of tactile output sequence, different from the first type of tactile output sequence, indicating that the content is at the terminal portion; and

in accordance with a determination that the user interface is not displaying a terminal portion of the first type of content, the tactile output portion corresponding to the navigation does not include the third type of tactile output sequence.

24. The non-transitory computer-readable storage medium of claim 17, wherein, in accordance with the determination that the user interface includes the second type of content, and:

in accordance with a determination that the predefined units of content are of a first type, the tactile output has a first amplitude; and

in accordance with a determination that the predefined units of content are of a second type different from the first type, the tactile output has a second amplitude smaller than the first amplitude.

25. The non-transitory computer-readable storage medium of claim 17, wherein the number of tactile outputs generated in the first type of tactile output sequence corresponds to a speed of the first input, wherein the first input is a rotational input on the rotatable input element.

26. The non-transitory computer-readable storage medium of claim 17, including, while navigating through the user interface, in accordance with the determination that the currently-displayed portion of the user interface includes the second type of content, generating the tactile output comprises generating the tactile output in response a movement of a first predefined unit of content out of alignment on the display.

27. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

displaying, on the display, a second user interface different from the user interface;

while displaying the second user interface, detecting, via the rotatable input element, a second input; and

in response to detecting the second input;

in accordance with a determination that the second input does not cause a navigation of the second user interface, forgoing generating, via the one or more tactile output generators, a tactile output; and

in accordance with a determination that the second input causes a navigation of the second user interface, generating, via the one or more tactile output generators, the tactile output.

28. The non-transitory computer-readable storage medium of claim 27, wherein the second user interface corresponds to a notification, and wherein the notification replaces display of the user interface.

29. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting, via a second input element different from the rotatable input element, a second input; and

in response to detecting the second input;

navigating through the user interface; and

forgoing generating;

via the one or more tactile output generators, the tactile output corresponding to the navigation through the user interface.

30. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

in response to detecting the first input;

generating audio output associated with the tactile output corresponding to the navigation through the user interface, including;

in accordance with the determination that the currently-displayed portion of the user interface includes the first type of content, the audio output includes a first type of audio output sequence that is associated with the first type of tactile output sequence; and

in accordance with the determination that the currently-displayed portion of the user interface includes the second type of content, the audio output includes a second type of audio output sequence that is associated with the second type of tactile output sequence.

31. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

in accordance with a determination that an event triggering a notification is detected while not detecting input via the rotatable input element, generating a tactile output corresponding to the notification; and

in accordance with a determination that the event triggering the notification is detected while detecting input via the rotatable input element, forgoing generating the tactile output corresponding to the notification.

32. The non-transitory computer-readable storage medium of claim 18, wherein the one or more programs further include instructions for:

in accordance with a determination that an event triggering a notification is detected while detecting the first input, forgoing generating a tactile output corresponding to the notification until predefined criteria are met; and

in response to a determination that the predetermined criteria have been met, generating the tactile output corresponding to the notification.

33. A method, comprising:

at an electronic device with a display, a rotatable input element, and one or more tactile output generators;

displaying, on the display, a user interface;

while displaying the user interface, detecting, via the rotatable input element, a first input; and

in response to detecting the first input;

navigating through the user interface, wherein navigating through the user interface comprises;

moving a first portion of the user interface off of the display such that the first portion of the user interface is no longer visible on the display; and

while moving the first portion of the user interface off of the display, concurrently moving a second portion of the user interface onto the display such that the second portion of the user interface becomes visible on the display; and

generating, via the one or more tactile output generators, tactile output corresponding to the navigation through the user interface, including;

in accordance with a determination that a currently-displayed portion of the user interface includes a first type of content, the tactile output corresponding to the navigation includes a first type of tactile output sequence that includes one or more tactile outputs determined based on an amount or speed of rotation of the rotatable input element caused by the first input; and

in accordance with a determination that the currently-displayed portion of the user interface includes a second type of content different from the first type of content, the tactile output corresponding to the navigation includes a second type of tactile output sequence that includes one or more tactile outputs determined based on an amount of movement of predefined units of content on the display, and while navigating through the user interface, generating the tactile output comprises generating the tactile output in response to a movement of a first predefined unit of content into alignment on the display.

34. The method of claim 33, wherein the first type of tactile output sequence is different from the second type of tactile output sequence.

35. The method of claim 33, wherein:

the first type of tactile output sequence is determined independently of the movement of content in the user interface.

36. The method of claim 33, wherein the predefined units of content correspond to visually distinguished content elements within the content.

37. The method of claim 33, wherein the user interface does not include content that is the second type of content.

38. The method of claim 33, wherein the user interface does not include content that is the first type of content.

39. The method of claim 33, further comprising:

generating, via the one or more tactile output generators, tactile output corresponding to the navigation through the user interface, further including;

in accordance with a determination that the user interface is displaying a terminal portion of the firm type of content, the tactile output corresponding to the navigation includes a third type of tactile output sequence, different from the first type of tactile output sequence, indicating that the content is at the terminal portion; and

in accordance with a determination that the user interface is not displaying a terminal portion of the first type of content, the tactile output portion corresponding to the navigation does not include the third type of tactile output sequence.

40. The method of claim 33, wherein, in accordance with the determination that the user interface includes the second type of content, and:

in accordance with a determination that the predefined units of content are of a first type, the tactile output has a first amplitude; and

in accordance with a determination that the predefined units of content are of a second type different from the first type, the tactile output has a second amplitude smaller than the first amplitude.

41. The method of claim 33, wherein the number of tactile outputs generated in the first type of tactile output sequence corresponds to a speed of the first input, wherein the first input is a rotational input on the rotatable input element.

42. The method of claim 33, including, while navigating through the user interface, in accordance with the determination that the currently-displayed portion of the user interface includes the second type of content, generating the tactile output comprises generating the tactile output in response a movement of a first predefined unit of content out of alignment on the display.

43. The method of claim 33, further comprising:

displaying, on the display, a second user interface different from the user interface;

while displaying the second user interface, detecting, via the rotatable input element, a second input; and

in response to detecting the second input;

in accordance with a determination that the second input does not cause a navigation of the second user interface, forgoing generating, via the one or more tactile output generators, a tactile output; and

in accordance with a determination that the second input causes a navigation of the second user interface, generating, via the one or more tactile output generators, the tactile output.

44. The method of claim 43, wherein the second user interface corresponds to a notification, and wherein the notification replaces display of the user interface.

45. The method of claim 33, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting, via a second input element different from the rotatable input element, a second input; and

in response to detecting the second input;

navigating through the user interface; and

forgoing generating, via the one or more tactile output generators, the tactile output corresponding to the navigation through the user interface.

46. The method of claim 33, further comprising:

in response to detecting the first input;

generating audio output associated with the tactile output corresponding to the navigation through the user interface, including;

in accordance with the determination that the currently-displayed portion of the user interface includes the first type of content, the audio output includes a first type of audio output sequence that is associated with the first type of tactile output sequence; and

in accordance with the determination that the currently-displayed portion of the user interface includes the second type of content, the audio output includes a second type of audio output sequence that is associated with the second type of tactile output sequence.

47. The method of claim 33, further comprising:

in accordance with a determination that an event triggering a notification is detected while not detecting input via the rotatable input element, generating a tactile output corresponding to the notification; and

in accordance with a determination that the event triggering the notification is detected while detecting input via the rotatable input element, forgoing generating the tactile output corresponding to the notification.

48. The method of claim 33, further comprising:

in accordance with a determination that an event triggering a notification is detected while detecting the first input, forgoing generating a tactile output corresponding to the notification until predefined criteria are met; and

in response to a determination that the predetermined criteria have been met, generating the tactile output corresponding to the notification.