Devices, Methods, and Graphical User Interfaces for Processing Intensity Information Associated with Touch Inputs

• US 20170357358A1
• Filed: 07/11/2017
• Published: 12/14/2017
• Est. Priority Date: 06/12/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Teutschler, Sophia, Breen, Stephen R., Kocienda, Kenneth L.
• Granted Patent: US 10,095,343 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An electronic device detects a change in intensity of an input at a location corresponding to a first user interface element associated with a user-interaction behavior model; generates, with an application-independent software module, output associated with the first user interface element determined in accordance with the change in intensity of the input and the user-interaction behavior model, including a first user-interaction component behavior and a second user-interaction component behavior; detects a change in intensity of an input at a location corresponding to a second user interface element associated with a subset of the user-interaction component behaviors; obtains, from the application-independent software module, an indication of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior; and updates, based on the indication, an appearance of the second user interface element based on the first user-interaction component behavior.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, one or more sensors to detect intensity of contacts with the touch-sensitive surface;

while displaying a first user interface element on the display, detecting a first sequence of one or more inputs that includes detecting a change in intensity of an input on the touch-sensitive surface at a location that corresponds to the first user interface element, wherein the first user interface element is associated with a user-interaction behavior model for responding to the change in intensity of inputs, wherein the user-interaction behavior model is composed of a plurality of user-interaction component behaviors;

in response to detecting the first sequence of one or more inputs, generating, with an application-independent software module, output at the device that is associated with the first user interface element that is determined in accordance with the change in intensity of the input and the user-interaction behavior model, including a first user-interaction component behavior and a second user-interaction component behavior that is distinct from the first user-interaction component behavior;

after generating the output that is associated with the first user interface element, displaying, on the display, a second user interface element that is associated with a first subset of the user-interaction component behaviors in the user-interaction behavior model;

while displaying the second user interface element on the display, detecting a second sequence of inputs that includes detecting a change in intensity of an input on the touch-sensitive surface at a location that corresponds to the second user interface element; and

in response to detecting the second sequence of inputs;

obtaining, from the application-independent software module, an indication of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior; and

updating, based on the indication from the application-independent software module of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior, an appearance of the second user interface element on the display based on the first user-interaction component behavior.

2. The method of claim 1, including:

in response to detecting the second sequence of inputs;

forgoing updating of the appearance of the second user interface element on the display based on the second user-interaction component behavior.

3. The method of claim 1, wherein the conditions associated with the first user-interaction component behavior include intensity criteria and/or timing criteria.

4. The method of claim 1, including:

in response to detecting the second sequence of inputs;

in accordance with a determination that the change in intensity of the input has not met the conditions associated with the first user-interaction component behavior, forgoing updating of the appearance of the second user interface element on the display based on the first user-interaction component behavior.

5. The method of claim 1, wherein the first user-interaction component behavior defines one or more tactile outputs to be output by one or more tactile output devices.

6. The method of claim 1, wherein the first user-interaction component behavior includes one or more animation curves based on which the appearance of the second user interface element on the display is updated.

7. The method of claim 1, wherein updating the appearance of the second user interface element includes displaying a third user interface element that is distinct from the second user interface element, and the first user-interaction component behavior defines whether the third user interface element is to remain on display in response to the input in the second sequence of inputs ceases to be detected.

8. The method of claim 1, wherein the first user-interaction component behavior includes a predefined animation.

9. The method of claim 1, including:

receiving an update to the user-interaction behavior model, wherein the update modifies the first user-interaction component behavior and the modified first user-interaction component behavior is different from the first user-interaction component behavior before modification; and

,

subsequent to receiving the update to the user-interaction behavior model, in response to detecting a sequence of inputs, updating, based on the indication from the application-independent software module of whether the change in intensity of the input has met conditions associated with the modified first user-interaction component behavior, an appearance of the second user interface element on the display based on the modified first user-interaction component behavior.

10. The method of claim 1, wherein:

updating the appearance of the second user interface element on the display based on the first user-interaction component behavior includes changing, using the application-independent software module, the appearance of the second user interface element from a first display state to a second display state that is distinct from the first display state; and

the first display state and the second display state are defined by a software application associated with the second user interface element.

11. The method of claim 1, including:

displaying, on the display, a fourth user interface element that is associated with a second subset of the user-interaction component behaviors in the user-interaction behavior model.

12. The method of claim 11, wherein the second subset of the user-interaction component behaviors in the user-interaction behavior model is distinct from the first subset of the user-interaction component behaviors.

13. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors for detecting intensity of contacts with the touch-sensitive surface;

one or more processors;

memory storing application software, an application-independent software module that is available for use by a plurality of software applications on the electronic device, and instructions, configured to be executed by the one or more processors, for;

while displaying a first user interface element on the display, detecting a first sequence of one or more inputs that includes detecting a change in intensity of an input on the touch-sensitive surface at a location that corresponds to the first user interface element, wherein the first user interface element is associated with a user-interaction behavior model for responding to the change in intensity of inputs, wherein the user-interaction behavior model is composed of a plurality of user-interaction component behaviors;

in response to detecting the first sequence of one or more inputs, generating, with the application-independent software module, output at the device that is associated with the first user interface element that is determined in accordance with the change in intensity of the input and the user-interaction behavior model, including a first user-interaction component behavior and a second user-interaction component behavior that is distinct from the first user-interaction component behavior;

after generating the output that is associated with the first user interface element, displaying, on the display, a second user interface element that is associated with a first subset of the user-interaction component behaviors in the user-interaction behavior model;

while displaying the second user interface element on the display, detecting a second sequence of inputs that includes detecting a change in intensity of an input on the touch-sensitive surface at a location that corresponds to the second user interface element; and

in response to detecting the second sequence of inputs;

obtaining, from the application-independent software module, an indication of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior; and

updating, based on the indication from the application-independent software module of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior, an appearance of the second user interface element on the display based on the first user-interaction component behavior.

14. The device of claim 13, wherein the memory stores instructions, configured to be executed by the one or more processors, for:

in response to detecting the second sequence of inputs;

forgoing updating of the appearance of the second user interface element on the display based on the second user-interaction component behavior.

15. The device of claim 13, wherein the conditions associated with the first user-interaction component behavior include intensity criteria and/or timing criteria.

16. The device of claim 13, wherein the memory stores instructions, configured to be executed by the one or more processors, for:

in response to detecting the second sequence of inputs;

in accordance with a determination that the change in intensity of the input has not met the conditions associated with the first user-interaction component behavior, forgoing updating of the appearance of the second user interface element on the display based on the first user-interaction component behavior.

17. A non-transitory computer readable storage medium storing application software;

an application-independent software module that is available for use by a plurality of software applications on an electronic device with a display, a touch-sensitive surface, and one or more sensors for detecting intensity of contacts with the touch-sensitive surface; and

instructions, which, when executed by the electronic device, cause the electronic device to;

while displaying a first user interface element on the display, detect a first sequence of one or more inputs that includes detecting a change in intensity of an input on the touch-sensitive surface at a location that corresponds to the first user interface element, wherein the first user interface element is associated with a user-interaction behavior model for responding to the change in intensity of inputs, wherein the user-interaction behavior model is composed of a plurality of user-interaction component behaviors;

in response to detecting the first sequence of one or more inputs, generate, with an application-independent software module, output at the device that is associated with the first user interface element that is determined in accordance with the change in intensity of the input and the user-interaction behavior model, including a first user-interaction component behavior and a second user-interaction component behavior that is distinct from the first user-interaction component behavior;

after generating the output that is associated with the first user interface element, display, on the display, a second user interface element that is associated with a first subset of the user-interaction component behaviors in the user-interaction behavior model;

while displaying the second user interface element on the display, detect a second sequence of inputs that includes detecting a change in intensity of an input on the touch-sensitive surface at a location that corresponds to the second user interface element; and

in response to detecting the second sequence of inputs;

obtain, from the application-independent software module, an indication of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior; and

update, based on the indication from the application-independent software module of whether the change in intensity of the input has met conditions associated with the first user-interaction component behavior, an appearance of the second user interface element on the display based on the first user-interaction component behavior.

18. The computer readable storage medium of claim 17, wherein the memory also stores instructions, which, when executed by the electronic device, cause the electronic device to:

in response to detecting the second sequence of inputs;

forgo updating of the appearance of the second user interface element on the display based on the second user-interaction component behavior.

19. The computer readable storage medium of claim 17, wherein the conditions associated with the first user-interaction component behavior include intensity criteria and/or timing criteria.

20. The computer readable storage medium of claim 17, wherein the memory also stores instructions, which, when executed by the electronic device, cause the electronic device to:

in response to detecting the second sequence of inputs;

in accordance with a determination that the change in intensity of the input has not met the conditions associated with the first user-interaction component behavior, forgo updating of the appearance of the second user interface element on the display based on the first user-interaction component behavior.