Device, method, and user interface for processing intensity of touch contacts

• US 9,645,669 B2
• Filed: 09/29/2015
• Issued: 05/09/2017
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Ledet, Raleigh J., Dixon, Ryan S., Beck, Nils T., Wells, Nicole M.
• Primary Examiner(s): SHENG, TOM V
• Application Number:
  US14/869,225
• Publication Number:
  US 20160259471A1
• Time in Patent Office: 588 Days
• Field of Search: 345173
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An electronic device includes a touch-sensitive surface. The electronic device includes one or more sensors to detect intensity of contacts with the touch-sensitive surface. The device detects a first touch input on the touch-sensitive surface, and, in response to detecting the first touch input on the touch-sensitive surface, determines a first intensity applied by the first touch input on the touch-sensitive surface. The device identifies a first intensity model identifier from a plurality of predefined intensity model identifiers, and, in accordance with the first intensity applied by the first touch input on the touch-sensitive surface and one or more thresholds associated with the first intensity model identifier, determines a first touch characterization parameter. Subsequent to determining the first touch characterization parameter, the device sends first touch information to the first software application. The first touch information includes the first intensity model identifier and the first touch characterization parameter.

Claims

1. A method, comprising:

at an electronic device with a touch-sensitive surface, wherein the electronic device includes a contact motion module and one or more sensors to detect intensity of contacts with the touch-sensitive surface and the electronic device stores a first software application that is independent from the contact motion module;

displaying a user interface that includes a first display region of the first software application and a second display region of the first software application;

while displaying the user interface;

detecting a first touch input on the touch-sensitive surface;

in response to detecting the first touch input at a location on the touch-sensitive surface that corresponds to the first display region of the user interface;

determining, at the contact motion module, a first intensity applied by the first touch input on the touch-sensitive surface;

identifying a first intensity model identifier, associated with the first display region of the user interface, from a plurality of predefined intensity model identifiers, wherein the first intensity model identifier is associated with a first set of intensity thresholds having a first number of thresholds, and the plurality of intensity model identifiers includes a second intensity model identifier associated with the second display region of the user interface, the second intensity model identifier associated with a second set of intensity thresholds having a second number of thresholds that is different from the first number of thresholds;

in accordance with the first intensity applied by the first touch input on the touch-sensitive surface and the first set of intensity thresholds associated with the first intensity model identifier, determining, at the contact motion module, a first touch characterization parameter; and

,

subsequent to determining the first touch characterization parameter, sending first touch information to the first software application, wherein the first touch information includes the first intensity model identifier and the first touch characterization parameter; and

at the first software application, updating the user interface displayed on the display based on the first touch characterization parameter, wherein the first touch characterization parameter is different from the first intensity applied by the first touch input.

2. The method of claim 1, including:

in response to detecting the first touch input on the touch-sensitive surface, generating a tactile output in accordance with the intensity applied by the first touch input on the touch-sensitive surface and the one or more thresholds associated with the first intensity model identifier.

3. The method of claim 1, including:

receiving one or more instructions from the first software application to generate a tactile output; and

,

in response to receiving the one or more instructions from the software application, generating the tactile output in accordance with the one or more instructions from the software application.

4. The method of claim 1, including:

while continuing to detect the first touch input on the touch-sensitive surface;

receiving one or more instructions to use an intensity model that corresponds to the second intensity model identifier that is distinct from the first intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the second intensity model identifier;

determining, at the contact motion module, a second intensity applied by the first touch input on the touch-sensitive surface; and

processing the first touch input based on the second intensity model identifier.

5. The method of claim 4, including:

while continuing to detect the first touch input on the touch-sensitive surface;

subsequent to processing the first touch input based on the second intensity model identifier, receiving one or more instructions to use an intensity model that corresponds to a third intensity model identifier that is distinct from the first intensity model identifier and the second intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the third intensity model identifier;

determining, at the contact motion module, a third intensity applied by the first touch input on the touch-sensitive surface; and

processing the first touch input based on the third intensity model identifier.

6. The method of claim 4, including:

determining, at the contact motion module, that the first touch input has ceased to be detected on the touch-sensitive surface; and

,

subsequent to determining that the first touch input has ceased to be detected on the touch-sensitive surface;

detecting a second touch input on the touch-sensitive surface that is separate from the first touch input; and

processing the second touch input based on the first intensity model identifier.

7. The method of claim 4, wherein processing the touch input based on the second intensity model identifier includes:

in accordance with the second intensity applied by the touch input on the touch-sensitive surface and the second set of intensity thresholds associated with the second intensity model identifier, determining, at the contact module, a second touch characterization parameter, wherein the second touch characterization parameter is distinct from the first touch characterization parameter; and

,

subsequent to determining the second touch characterization parameter, sending second touch information to the first software application, wherein the second touch information includes the second intensity model identifier and the second touch characterization parameter.

8. The method of claim 4, wherein processing the touch input based on the second intensity model identifier includes:

foregoing generation of a tactile output in accordance with the second intensity failing to satisfy the second set of intensity thresholds associated with the second intensity model identifier, wherein the electronic device is configured to generate a tactile output in accordance with the second intensity satisfying at least one intensity threshold of the second set of intensity thresholds associated with the first second intensity model identifier.

9. The method of claim 1, including:

subsequent to detecting the first touch input, receiving one or more instructions to use an intensity model that corresponds to the second intensity model identifier that is distinct from the first intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the second intensity model identifier;

detecting a second touch input on the touch-sensitive surface;

in response to detecting the second touch input on the touch-sensitive surface, determining, at the contact motion module, a second intensity applied by the second touch input on the touch-sensitive surface; and

processing the second touch input based on the second intensity model identifier.

10. The method of claim 1, including:

sending a stream of intensity events to the first software application, each intensity event corresponding to an intensity applied by the touch input at a corresponding time.

11. The method of claim 1, including selecting a set of thresholds, from a plurality of sets of thresholds, in accordance with the identified intensity model identifier, and determining the touch characterization parameter in accordance with the selected set of thresholds.

12. The method of claim 1, including identifying one or more intensity ranges, in accordance with the identified intensity model identifier, and determining a touch characterization parameter in accordance with the one or more identified intensity ranges.

13. The method of claim 1, wherein identifying the first intensity model identifier includes identifying the first software application as corresponding to the touch input and identifying an intensity model identifier registered by the first software application as the first intensity model identifier.

14. An electronic device, comprising:

a touch-sensitive surface;

a contact motion module;

one or more sensors to detect intensity of contacts with the touch-sensitive surface;

one or more processors; and

memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors and a first software application that is independent from the contact motion module, the one or more programs including instructions for;

displaying a user interface that includes a first display region of the first software application and a second display region of the first software application;

while displaying the user interface;

detecting a first touch input on the touch-sensitive surface;

in response to detecting the first touch input at a location on the touch-sensitive surface that corresponds to the first display region of the user interface;

determining, at the contact motion module, a first intensity applied by the first touch input on the touch-sensitive surface;

identifying a first intensity model identifier, associated with the first display region of the user interface, from a plurality of predefined intensity model identifiers, wherein the first intensity model identifier is associated with a first set of intensity thresholds having a first number of thresholds, and the plurality of intensity model identifiers includes a second intensity model identifier associated with the second display region of the user interface, the second intensity model identifier associated with a second set of intensity thresholds having a second number of thresholds that is different from the first number of thresholds;

in accordance with the first intensity applied by the first touch input on the touch-sensitive surface and the first set of intensity thresholds associated with the first intensity model identifier, determining, at the contact motion module, a first touch characterization parameter; and

,

subsequent to determining the first touch characterization parameter, sending first touch information to the first software application, wherein the first touch information includes the first intensity model identifier and the first touch characterization parameter; and

at the first software application, updating the user interface displayed on the display based on the first touch characterization parameter, wherein the first touch characterization parameter is different from the first intensity applied by the first touch input.

15. The electronic device of claim 14, wherein the one or more programs further include instructions for:

in response to detecting the first touch input on the touch-sensitive surface, generating a tactile output in accordance with the intensity applied by the first touch input on the touch-sensitive surface and the one or more thresholds associated with the first intensity model identifier.

16. The electronic device of claim 14, wherein the one or more programs include instructions for:

receiving one or more instructions from the first software application to generate a tactile output; and

,

in response to receiving the one or more instructions from the software application, generating the tactile output in accordance with the one or more instructions from the software application.

17. The electronic device of claim 14, wherein the one or more programs further include instructions for:

while continuing to detect the first touch input on the touch-sensitive surface;

receiving one or more instructions to use an intensity model that corresponds to the second intensity model identifier that is distinct from the first intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the second intensity model identifier;

determining, at the contact motion module, a second intensity applied by the first touch input on the touch-sensitive surface; and

processing the first touch input based on the second intensity model identifier.

18. The electronic device of claim 17, wherein the one or more programs further include instructions for:

while continuing to detect the first touch input on the touch-sensitive surface;

subsequent to processing the first touch input based on the second intensity model identifier, receiving one or more instructions to use an intensity model that corresponds to a third intensity model identifier that is distinct from the first intensity model identifier and the second intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the third intensity model identifier;

determining, at the contact motion module, a third intensity applied by the first touch input on the touch-sensitive surface; and

processing the first touch input based on the third intensity model identifier.

19. The electronic device of claim 17, wherein the one or more programs further include instructions for:

determining, at the contact motion module, that the first touch input has ceased to be detected on the touch-sensitive surface; and

,

subsequent to determining that the first touch input has ceased to be detected on the touch-sensitive surface;

detecting a second touch input on the touch-sensitive surface that is separate from the first touch input; and

processing the second touch input based on the first intensity model identifier.

20. The electronic device of claim 17, wherein the one or more programs further include instructions for:

in accordance with the second intensity applied by the touch input on the touch- sensitive surface and the second set of intensity thresholds associated with the second intensity model identifier, determining, at the contact module, a second touch characterization parameter, wherein the second touch characterization parameter is distinct from the first touch characterization parameter; and

,

subsequent to determining the second touch characterization parameter, sending second touch information to the first software application, wherein the second touch information includes the second intensity model identifier and the second touch characterization parameter.

21. The electronic device of claim 17, wherein processing the touch input based on the second intensity model identifier includes:

foregoing generation of a tactile output in accordance with the second intensity failing to satisfy the second set of intensity thresholds associated with the second intensity model identifier, wherein the electronic device is configured to generate a tactile output in accordance with the second intensity satisfying at least one intensity threshold of the second set of intensity thresholds associated with the second intensity model identifier.

22. The electronic device of claim 14, wherein the one or more programs further include instructions for:

subsequent to detecting the first touch input, receiving one or more instructions to use an intensity model that corresponds to the second intensity model identifier that is distinct from the first intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the second intensity model identifier;

detecting a second touch input on the touch-sensitive surface;

in response to detecting the second touch input on the touch-sensitive surface, determining, at the contact motion module, a second intensity applied by the second touch input on the touch-sensitive surface; and

processing the second touch input based on the second intensity model identifier.

23. The electronic device of claim 14, wherein the one or more programs further include instructions for:

sending a stream of intensity events to the first software application, each intensity event corresponding to an intensity applied by the touch input at a corresponding time.

24. The electronic device of claim 14, the one or more programs further include instructions for selecting a set of thresholds, from a plurality of sets of thresholds, in accordance with the identified intensity model identifier, and determining the touch characterization parameter in accordance with the selected set of thresholds.

25. The electronic device of claim 14, wherein the one or more programs further include instructions for identifying one or more intensity ranges, in accordance with the identified intensity model identifier, and determining a touch characterization parameter in accordance with the one or more identified intensity ranges.

26. The electronic device of claim 14, wherein identifying the first intensity model identifier includes identifying the first software application as corresponding to the touch input and identifying an intensity model identifier registered by the first software application as the first intensity model identifier.

27. A non-transitory computer readable storage medium storing one or more programs, the one or more programs including instructions, which, when executed by an electronic device with a touch-sensitive surface, a contact motion module, a first software application that is independent from the contact motion module, and one or more sensors to detect intensity of contacts with the touch-sensitive surface, cause the device to:

display a user interface that includes a first display region of the first software application and a second display region of the first software application;

while displaying the user interface;

detect a first touch input on the touch-sensitive surface;

in response to detecting the first touch input at a location on the touch-sensitive surface that corresponds to the first display region of the user interface;

determine, at the contact motion module, a first intensity applied by the first touch input on the touch-sensitive surface;

identify a first intensity model identifier, associated with the first display region of the user interface, from a plurality of predefined intensity model identifiers, wherein the first intensity model identifier is associated with a first set of intensity thresholds having a first number of thresholds, and the plurality of intensity model identifiers includes a second intensity model identifier associated with the second display region of the user interface, the second intensity model identifier associated with a second set of intensity thresholds having a second number of thresholds that is different from the first number of thresholds;

in accordance with the first intensity applied by the first touch input on the touch-sensitive surface and the first set of intensity thresholds associated with the first intensity model identifier, determine, at the contact motion module, a first touch characterization parameter; and

,

subsequent to determining the first touch characterization parameter, send first touch information to a first software application, wherein the first touch information includes the first intensity model identifier and the first touch characterization parameter; and

at the first software application, update the user interface displayed on the display based on the first touch characterization parameter, wherein the first touch characterization parameter is different from the first intensity applied by the first touch input.

28. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

in response to detecting the first touch input on the touch-sensitive surface, generating a tactile output in accordance with the intensity applied by the first touch input on the touch-sensitive surface and the one or more thresholds associated with the first intensity model identifier.

29. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

receiving one or more instructions from the first software application to generate a tactile output; and

,

in response to receiving the one or more instructions from the software application, generating the tactile output in accordance with the one or more instructions from the software application.

30. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

while continuing to detect the first touch input on the touch-sensitive surface;

receiving one or more instructions to use an intensity model that corresponds to the second intensity model identifier that is distinct from the first intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the second intensity model identifier;

determining, at the contact motion module, a second intensity applied by the first touch input on the touch-sensitive surface; and

processing the first touch input based on the second intensity model identifier.

31. The non-transitory computer readable storage medium of claim 30, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

while continuing to detect the first touch input on the touch-sensitive surface;

subsequent to processing the first touch input based on the second intensity model identifier, receiving one or more instructions to use an intensity model that corresponds to a third intensity model identifier that is distinct from the first intensity model identifier and the second intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the third intensity model identifier;

determining, at the contact motion module, a third intensity applied by the first touch input on the touch-sensitive surface; and

processing the first touch input based on the third intensity model identifier.

32. The non-transitory computer readable storage medium of claim 30, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

determining, at the contact motion module, that the first touch input has ceased to be detected on the touch-sensitive surface; and

,

subsequent to determining that the first touch input has ceased to be detected on the touch-sensitive surface;

detecting a second touch input on the touch-sensitive surface that is separate from the first touch input; and

processing the second touch input based on the first intensity model identifier.

33. The non-transitory computer readable storage medium of claim 30, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

in accordance with the second intensity applied by the touch input on the touch-sensitive surface and the second set of intensity thresholds associated with the second intensity model identifier, determining, at the contact module, a second touch characterization parameter, wherein the second touch characterization parameter is distinct from the first touch characterization parameter; and

,

subsequent to determining the second touch characterization parameter, sending second touch information to the first software application, wherein the second touch information includes the second intensity model identifier and the second touch characterization parameter.

34. The non-transitory computer readable storage medium of claim 30, wherein processing the touch input based on the second intensity model identifier includes:

foregoing generation of a tactile output in accordance with the second intensity failing to satisfy the second set of intensity thresholds associated with the second intensity model identifier, wherein the electronic device is configured to generate a tactile output in accordance with the second intensity satisfying at least one intensity threshold of the second set of intensity thresholds associated with the second intensity model identifier.

35. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

subsequent to detecting the first touch input, receiving one or more instructions to use an intensity model that corresponds to the second intensity model identifier that is distinct from the first intensity model identifier; and

,

subsequent to receiving the one or more instructions to use the intensity model that corresponds to the second intensity model identifier;

detecting a second touch input on the touch-sensitive surface;

in response to detecting the second touch input on the touch-sensitive surface, determining, at the contact motion module, a second intensity applied by the second touch input on the touch-sensitive surface; and

processing the second touch input based on the second intensity model identifier.

36. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include:

sending a stream of intensity events to the first software application, each intensity event corresponding to an intensity applied by the touch input at a corresponding time.

37. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include selecting a set of thresholds, from a plurality of sets of thresholds, in accordance with the identified intensity model identifier, and determining the touch characterization parameter in accordance with the selected set of thresholds.

38. The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions, which, when executed by the electronic device, cause the device to perform operations that include identifying one or more intensity ranges, in accordance with the identified intensity model identifier, and determining a touch characterization parameter in accordance with the one or more identified intensity ranges.

39. The non-transitory computer readable storage medium of claim 27, wherein identifying the first intensity model identifier includes identifying the first software application as corresponding to the touch input and identifying an intensity model identifier registered by the first software application as the first intensity model identifier.