Content-based tactile outputs

• US 10,928,907 B2
• Filed: 09/28/2018
• Issued: 02/23/2021
• Est. Priority Date: 09/11/2018
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Moussette, Camille, Bloom, David H., Butcher, Gary Ian, Edwards, Dylan Ross, Fennis, Jules K., Gleeson, Brian T., He, Miao, Sundstrom, Matthew J.
• Primary Examiner(s): Casillas, Roland J
• Application Number:
  US16/147,413
• Publication Number:
  US 20200081539A1
• Time in Patent Office: 879 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present disclosure generally relates to content-based tactile outputs. In some embodiments, user interfaces associated with content-based tactile outputs are described. In some embodiments, user interfaces associated with end-of-content tactile outputs are described. In some embodiments, user interfaces associated with moving a user interface in response to different types of input are described. In some embodiments, user interfaces associated with adjustable item-based tactile outputs are described. In some embodiments, user interfaces associated with input velocity-based tactile outputs are described.

Claims

1. An electronic device, comprising:

a touch-sensitive display;

a rotatable input element;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a user interface;

while displaying the user interface, detecting a first portion of a respective input at the device;

in response to detecting a first portion of the respective input, moving a user interface object across the display of the device in accordance with the movement of the respective input; and

after detecting the first portion of the respective input, detecting a second portion of the respective input at the device; and

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by more than a first threshold amount of distance on the display, moving the user interface object to a respective position on the display;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by less than the first threshold amount of distance on the display, forgoing moving the user interface object to the respective position on the display;

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by more than a second threshold amount of distance on the display that is less than the first threshold amount of distance on the display, moving the user interface object to the respective position on the display; and

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display, forgoing moving the user interface object to the respective position on the display.

2. The electronic device of claim 1, wherein the one or more programs further include instructions for:

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by less than the first threshold amount of distance on the display, moving the user interface object back in an opposite direction.

3. The electronic device of claim 1, wherein the one or more programs further include instructions for:

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display, moving the user interface object back in an opposite direction.

4. The electronic device of claim 1, wherein the electronic device includes a tactile output generator.

5. The electronic device of claim 1, wherein the electronic device includes one or more tactile output generators that generate localized tactile outputs directed to the rotatable input element and one or more separate tactile output generators that generate tactile outputs for the electronic device that are not specifically directed to the rotatable input element.

6. The electronic device of claim 5, wherein the one or more tactile output generators are configured to generate audio outputs.

7. The electronic device of claim 5, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting a second input directed to the rotatable input element; and

in response to detecting the second input directed to the rotatable input element, forgoing generating, via the one or more tactile output generators, tactile output corresponding to rotation of the rotatable input element.

8. The electronic device of claim 5, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting a third input directed to the rotatable input element; and

in response to detecting the third input directed to the rotatable input element;

in accordance with a determination that the third input includes rotation of the rotatable input element without a press of the rotatable input element, generating, via the one or more input devices, tactile output corresponding to rotation of the rotatable input element; and

in accordance with a determination that the third input includes rotation of the rotatable input element and a press of the rotatable input element, forging generating, via the one or more tactile output generators, the tactile output corresponding to rotation of the rotatable input element.

9. The electronic device of claim 1, wherein the one or more programs further include instructions for:

in response to detecting the second portion of the respective input;

in accordance with the determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input meets criteria for moving the user interface object to the respective position on the display, moving the user interface object to the respective position on the display in conjunction with generating a tactile output corresponding to the movement of the user interface object; and

in accordance with the determination that the respective input includes movement of a contact on the touch-sensitive display that meets criteria for moving the user interface object to the respective position on the display, moving the user interface object to the respective position on the display without generating the tactile output.

10. The electronic device of claim 9, wherein an amplitude of the tactile output is based on a size of the user interface object.

11. The electronic device of claim 9, wherein the tactile output corresponding to the movement of the user interface object to the respective position on the display comprise a tactile output sequence having a first predetermined frequency range that is different from a second predetermined frequency range corresponding to a tactile output sequence associated with displaying a notification on the display.

12. The electronic device of claim 1, wherein the one or more programs further include instructions for:

repeating the updating of the user interface in response to detecting subsequent inputs of the plurality of inputs, the plurality of inputs including;

at least one input that includes movement of a contact on the touch-sensitive display, wherein the movement moves the user interface object across the display by more than the first threshold amount;

at least one input that includes movement of a contact on the touch-sensitive display, wherein the movement moves the user interface object across the display by less than the first threshold amount;

at least one input that includes rotational input directed to the rotatable input element, wherein the rotational input moves the user interface object across the display by more than the second threshold amount; and

at least one input that includes rotational input directed to the rotatable input element, wherein the rotational input moves the user interface object across the display by less than the second threshold amount.

13. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a touch-sensitive display and a rotatable input element, the one or more programs including instructions for:

displaying, on the display, a user interface;

while displaying the user interface, detecting a first portion of a respective input at the device;

in response to detecting a first portion of the respective input, moving a user interface object across the display of the device in accordance with the movement of the respective input; and

after detecting the first portion of the respective input, detecting a second portion of the respective input at the device; and

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by more than a first threshold amount of distance on the display, moving the user interface object to a respective position on the display;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by less than the first threshold amount of distance on the display, forgoing moving the user interface object to the respective position on the display;

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by more than a second threshold amount of distance on the display that is less than the first threshold amount of distance on the display, moving the user interface object to the respective position on the display; and

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display, forgoing moving the user interface object to the respective position on the display.

14. The non-transitory computer-readable storage medium of claim 13, wherein the one or more programs further include instructions for:

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by less than the first threshold amount of distance on the display, moving the user interface object back in an opposite direction.

15. The non-transitory computer-readable storage medium of claim 13, wherein the one or more programs further include instructions for:

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display, moving the user interface object back in an opposite direction.

16. The non-transitory computer-readable storage medium of claim 13, wherein the electronic device includes a tactile output generator.

17. The non-transitory computer-readable storage medium of claim 13, wherein the electronic device includes one or more tactile output generators that generate localized tactile outputs directed to the rotatable input element and one or more separate tactile output generators that generate tactile outputs for the electronic device that are not specifically directed to the rotatable input element.

18. The non-transitory computer-readable storage medium of claim 17, wherein the one or more tactile output generators are configured to generate audio outputs.

19. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting a second input directed to the rotatable input element; and

in response to detecting the second input directed to the rotatable input element, forgoing generating, via the one or more tactile output generators, tactile output corresponding to rotation of the rotatable input element.

20. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further include instructions for:

while displaying the user interface, detecting a third input directed to the rotatable input element; and

in response to detecting the third input directed to the rotatable input element;

in accordance with a determination that the third input includes rotation of the rotatable input element without a press of the rotatable input element, generating, via the one or more input devices, tactile output corresponding to rotation of the rotatable input element; and

in accordance with a determination that the third input includes rotation of the rotatable input element and a press of the rotatable input element, forging generating, via the one or more tactile output generators, the tactile output corresponding to rotation of the rotatable input element.

21. The non-transitory computer-readable storage medium of claim 13, wherein the one or more programs further include instructions for:

in response to detecting the second portion of the respective input;

in accordance with the determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input meets criteria for moving the user interface object to the respective position on the display, moving the user interface object to the respective position on the display in conjunction with generating a tactile output corresponding to the movement of the user interface object; and

in accordance with the determination that the respective input includes movement of a contact on the touch-sensitive display that meets criteria for moving the user interface object to the respective position on the display, moving the user interface object to the respective position on the display without generating the tactile output.

22. The non-transitory computer-readable storage medium of claim 21, wherein an amplitude of the tactile output is based on a size of the user interface object.

23. The non-transitory computer-readable storage medium of claim 21, wherein the tactile output corresponding to the movement of the user interface object to the respective position on the display comprise a tactile output sequence having a first predetermined frequency range that is different from a second predetermined frequency range corresponding to a tactile output sequence associated with displaying a notification on the display.

24. The non-transitory computer-readable storage medium of claim 13, wherein the one or more programs further include instructions for:

repeating the updating of the user interface in response to detecting subsequent inputs of the plurality of inputs, the plurality of inputs including;

at least one input that includes movement of a contact on the touch-sensitive display, wherein the movement moves the user interface object across the display by more than the first threshold amount;

at least one input that includes movement of a contact on the touch-sensitive display, wherein the movement moves the user interface object across the display by less than the first threshold amount;

at least one input that includes rotational input directed to the rotatable input element, wherein the rotational input moves the user interface object across the display by more than the second threshold amount; and

at least one input that includes rotational input directed to the rotatable input element, wherein the rotational input moves the user interface object across the display by less than the second threshold amount.

25. A method, comprising:

at an electronic device with a touch-sensitive display and a rotatable input element;

displaying, on the display, a user interface;

while displaying the user interface, updating the user interface responsive to a plurality of inputs detected at the device including, for a respective input;

detecting a first portion of the respective input of the plurality of inputs at the device;

in response to detecting a first portion of the respective input, moving a user interface object across the display of the device in accordance with the movement of the respective input;

after detecting the first portion of the respective input, detecting a second portion of the respective input at the device; and

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by more than a first threshold amount of distance on the display, moving the user interface object to a respective position on the display;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by less than the first threshold amount of distance on the display, forgoing moving the user interface object to the respective position on the display;

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by more than a second threshold amount of distance on the display that is less than the first threshold amount of distance on the display, moving the user interface object to the respective position on the display; and

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display, forgoing moving the user interface object to the respective position on the display;

repeating the updating of the user interface in response to detecting subsequent inputs of the plurality of inputs, the plurality of inputs including;

at least one input that includes movement of a contact on the touch-sensitive display, wherein the movement moves the user interface object across the display by more than the first threshold amount of distance on the display;

at least one input that includes movement of a contact on the touch-sensitive display, wherein the movement moves the user interface object across the display by less than the first threshold amount of distance on the display;

at least one input that includes rotational input directed to the rotatable input element, wherein the rotational input moves the user interface object across the display by more than the second threshold amount of distance on the display; and

at least one input that includes rotational input directed to the rotatable input element, wherein the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display.

26. The method of claim 25, further comprising:

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes movement of a contact on the touch-sensitive display and that the movement moves the user interface object across the display by less than the first threshold amount of distance on the display, moving the user interface object back in an opposite direction.

27. The method of claim 25, further comprising:

in response to detecting the second portion of the respective input;

in accordance with a determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input moves the user interface object across the display by less than the second threshold amount of distance on the display, moving the user interface object back in an opposite direction.

28. The method of claim 25, wherein the electronic device includes a tactile output generator.

29. The method of claim 25, wherein the electronic device includes one or more tactile output generators that generate localized tactile outputs directed to the rotatable input element and one or more separate tactile output generators that generate tactile outputs for the electronic device that are not specifically directed to the rotatable input element.

30. The method of claim 29, wherein the one or more tactile output generators are configured to generate audio outputs.

31. The method of claim 29, further comprising:

while displaying the user interface, detecting a second input directed to the rotatable input element; and

in response to detecting the second input directed to the rotatable input element, forgoing generating, via the one or more tactile output generators, tactile output corresponding to rotation of the rotatable input element.

32. The method of claim 29, further comprising:

while displaying the user interface, detecting a third input directed to the rotatable input element; and

in response to detecting the third input directed to the rotatable input element;

in accordance with a determination that the third input includes rotation of the rotatable input element without a press of the rotatable input element, generating, via the one or more input devices, tactile output corresponding to rotation of the rotatable input element; and

in accordance with a determination that the third input includes rotation of the rotatable input element and a press of the rotatable input element, forging generating, via the one or more tactile output generators, the tactile output corresponding to rotation of the rotatable input element.

33. The method of claim 25, further comprising:

in response to detecting the second portion of the respective input;

in accordance with the determination that the respective input includes rotational input directed to the rotatable input element and that the rotational input meets criteria for moving the user interface object to the respective position on the display, moving the user interface object to the respective position on the display in conjunction with generating a tactile output corresponding to the movement of the user interface object; and

in accordance with the determination that the respective input includes movement of a contact on the touch-sensitive display that meets criteria for moving the user interface object to the respective position on the display, moving the user interface object to the respective position on the display without generating the tactile output.

34. The method of claim 33, wherein an amplitude of the tactile output is based on a size of the user interface object.

35. The method of claim 33, wherein the tactile output corresponding to the movement of the user interface object to the respective position on the display comprise a tactile output sequence having a first predetermined frequency range that is different from a second predetermined frequency range corresponding to a tactile output sequence associated with displaying a notification on the display.