Devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button

• US 10,228,765 B2
• Filed: 09/22/2016
• Issued: 03/12/2019
• Est. Priority Date: 09/06/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Chaudhri, Imran A., Bauer, Sebastian J., Moussette, Camille, Mouilleseaux, Jean-Pierre M., Cordier, Madeleine S., Kopin, Joshua B.
• Primary Examiner(s): Lee, Justin S
• Application Number:
  US15/273,464
• Publication Number:
  US 20180067622A1
• Time in Patent Office: 901 Days
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1671 Special purpose buttons or auxiliary keyboards, e.g. retractable mini keypads, keypads or buttons that remain accessible at closed laptop G06F1/1666 takes precedence
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0227 Cooperation and interconnection of the input arrangement with other functional units of a computer G06F3/023 - G06F3/037 take precedence
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

An electronic device: while displaying a user interface, detects an input sequence that includes detecting an increase in a characteristic intensity of a contact on a home button. In response, the device determines whether the increase is above a first intensity threshold and whether a change in the characteristic intensity proximate to a time when the characteristic intensity increases above the first intensity threshold has a first or a second value for an intensity-change metric. If the increase is above the threshold and the change has the first value, the device performs a first operation that changes the user interface displayed on the display; and generates a first discrete tactile output that corresponds to the increase. If the increase is above the threshold and the change has the second value, the device performs the first operation and generates a second discrete tactile output that corresponds to the increase.

Claims

1. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an electronic device with a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors to detect intensities of contacts with a home button of the device, cause the device to:

display a user interface on the display;

while displaying the user interface, detect an input sequence on the home button that includes detecting a first press input on the home button, wherein detecting the first press input includes detecting an increase in a characteristic intensity of a contact on the home button; and

in response to detecting the first press input on the home button;

in accordance with a determination that the first press input includes an increase in the characteristic intensity of the contact above a first intensity threshold, and that a change in the characteristic intensity of the contact proximate to a time when the characteristic intensity of the contact increases above the first intensity threshold has a first value for an intensity-change metric;

perform a first operation that changes the user interface displayed on the display; and

generate, via the one or more tactile output generators, a first discrete tactile output that corresponds to the increase in the characteristic intensity of the contact above the first intensity threshold; and

in accordance with a determination that the first press input includes an increase in the characteristic intensity of the contact above the first intensity threshold, and that the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity-change metric, different from the first value of the intensity-change metric;

perform the first operation that changes the user interface displayed on the display; and

generate, via the one or more tactile output generators, a second discrete tactile output that corresponds to the increase in the characteristic intensity of the contact above the first intensity threshold and is different from the first discrete tactile output.

2. The computer-readable storage medium of claim 1, wherein:

the first discrete tactile output and the second discrete tactile output have a same waveform; and

the first discrete tactile output and the second discrete tactile output have different amplitudes.

3. The computer-readable storage medium of claim 1, wherein the first discrete tactile output stops while the characteristic intensity of the contact is maintained above the first intensity threshold.

4. The computer-readable storage medium of claim 1, wherein the second tactile output stops while the characteristic intensity of the contact is maintained above the first intensity threshold.

5. The computer-readable storage medium of claim 1, wherein the first tactile output is generated for a first range of values of the intensity-change metric.

6. The computer-readable storage medium of claim 5, wherein the second tactile output is generated for a second range of values of the intensity-change metric.

7. The computer-readable storage medium of claim 1, wherein:

detecting the input sequence on the home button further includes detecting a first release input on the home button, following the first press input on the home button, wherein detecting the first release input includes detecting a decrease in the characteristic intensity of the contact on the home button; and

the programs further comprise instructions that cause the device to;

in response to detecting the first release input on the home button;

in accordance with a determination that the first release input includes a decrease in the characteristic intensity of the contact below a second intensity threshold, and that a change in the characteristic intensity of the contact proximate to a time when the characteristic intensity of the contact decreases below the second intensity threshold has a third value for the intensity-change metric;

generate, via the one or more tactile output generators, a third discrete tactile output that corresponds to the decrease in the characteristic intensity of the contact below the second intensity threshold; and

in accordance with a determination that the first release input includes a decrease in the characteristic intensity of the contact below the second intensity threshold, and that the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact decreases below the second intensity threshold has a fourth value for the intensity-change metric, different from the third value of the intensity-change metric;

generate, via the one or more tactile output generators, a fourth discrete tactile output that corresponds to the decrease in the characteristic intensity of the contact below the second intensity threshold and is different from the third discrete tactile output.

8. The computer-readable storage medium of claim 7, wherein:

generating the first and second tactile outputs includes applying a first modification to a base tactile output pattern in accordance with the first and second values of the intensity-change metric, respectively; and

generating the third and fourth tactile outputs includes applying a second modification, distinct from the first modification, to the base tactile output pattern in accordance with the third and fourth values of the intensity-change metric, respectively.

9. The computer-readable storage medium of claim 7, wherein the second intensity threshold is different from the first intensity threshold.

10. The computer-readable storage medium of claim 1, wherein the first discrete tactile output and the second discrete tactile output are generated from a base haptic output pattern that is associated with a currently selected tactile output setting from a plurality of different tactile output settings for the home button.

11. The computer-readable storage medium of claim 1, wherein the home button is persistently displayed at a respective location or located at a persistent location on the device that is separate from the display.

12. The computer-readable storage medium of claim 1, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact over time.

13. The computer-readable storage medium of claim 1, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact measured at a time that the characteristic intensity of the contact reaches a relevant threshold intensity.

14. The computer-readable storage medium of claim 1, wherein:

detecting the input sequence includes detecting a second press input on the home button, wherein detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button;

the programs further comprise instructions that cause the device to, in response to detecting the second press input;

in accordance with a determination, based on an amount of time between a first point in time that corresponds to the first press input and a second point in time that corresponds to the second press input, that the first press input and the second press input are part of a predefined input pattern;

perform a second operation associated with the predefined input pattern, wherein the second operation is different from the first operation; and

provide, via the one or more tactile output generators, a fifth discrete tactile output, distinct from the first and second tactile outputs.

15. The computer-readable storage medium of claim 1, wherein:

detecting the input sequence includes detecting a second press input on the home button, wherein detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button;

the programs further comprise instructions that cause the device to;

in response to detecting the first press input, provide a first audio output concurrently with a respective one of the first and second tactile outputs that was generated in response to the first press input; and

in response to detecting the second press input;

in accordance with a determination, based on an amount of time between a first point in time that corresponds to the first press input and a second point in time that corresponds to the second press input, that the first press input and the second press input are part of a predefined input pattern;

perform a second operation associated with the input pattern, wherein the second operation is different from the first operation;

provide, via the one or more tactile output generators, a fifth discrete tactile output, wherein the fifth tactile output is identical to the respective one of the first and second tactile outputs that was generated for the first press input; and

provide a second audio output concurrently with the fifth discrete tactile output, wherein the second audio output and the first audio output have different audio output patterns.

16. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

in response to detecting the first press input on the home button;

change the user interface from a first user interface to a second user interface, without regard to the value of the intensity-change metric that corresponds to the first press input.

17. A method, comprising:

at an electronic device with a touch-sensitive surface, a display, and one or more tactile output generators for generating tactile outputs, wherein the device includes one or more sensors to detect intensities of contacts with a home button of the device;

displaying a user interface on the display;

while displaying the user interface, detecting an input sequence on the home button that includes detecting a first press input on the home button, wherein detecting the first press input includes detecting an increase in a characteristic intensity of a contact on the home button; and

in response to detecting the first press input on the home button;

in accordance with a determination that the first press input includes an increase in the characteristic intensity of the contact above a first intensity threshold, and that a change in the characteristic intensity of the contact proximate to a time when the characteristic intensity of the contact increases above the first intensity threshold has a first value for an intensity-change metric;

performing a first operation that changes the user interface displayed on the display; and

generating, via the one or more tactile output generators, a first discrete tactile output that corresponds to the increase in the characteristic intensity of the contact above the first intensity threshold; and

in accordance with a determination that the first press input includes an increase in the characteristic intensity of the contact above the first intensity threshold, and that the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity-change metric, different from the first value of the intensity-change metric;

performing the first operation that changes the user interface displayed on the display; and

generating, via the one or more tactile output generators, a second discrete tactile output that corresponds to the increase in the characteristic intensity of the contact above the first intensity threshold and is different from the first discrete tactile output.

19. The method of claim 17, wherein:

the first discrete tactile output and the second discrete tactile output have a same waveform; and

the first discrete tactile output and the second discrete tactile output have different amplitudes.

20. The method of claim 17, wherein the first discrete tactile output stops while the characteristic intensity of the contact is maintained above the first intensity threshold.

21. The method of claim 17, wherein the second tactile output stops while the characteristic intensity of the contact is maintained above the first intensity threshold.

22. The method of claim 17, wherein the first tactile output is generated for a first range of values of the intensity-change metric.

23. The method of claim 22, wherein the second tactile output is generated for a second range of values of the intensity-change metric.

24. The method of claim 17, wherein:

detecting the input sequence on the home button further includes detecting a first release input on the home button, following the first press input on the home button, wherein detecting the first release input includes detecting a decrease in the characteristic intensity of the contact on the home button; and

the programs further comprise instructions that cause the device to;

in response to detecting the first release input on the home button;

in accordance with a determination that the first release input includes a decrease in the characteristic intensity of the contact below a second intensity threshold, and that a change in the characteristic intensity of the contact proximate to a time when the characteristic intensity of the contact decreases below the second intensity threshold has a third value for the intensity-change metric;

generate, via the one or more tactile output generators, a third discrete tactile output that corresponds to the decrease in the characteristic intensity of the contact below the second intensity threshold; and

in accordance with a determination that the first release input includes a decrease in the characteristic intensity of the contact below the second intensity threshold, and that the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact decreases below the second intensity threshold has a fourth value for the intensity-change metric, different from the third value of the intensity-change metric;

generate, via the one or more tactile output generators, a fourth discrete tactile output that corresponds to the decrease in the characteristic intensity of the contact below the second intensity threshold and is different from the third discrete tactile output.

25. The method of claim 24, wherein:

generating the first and second tactile outputs includes applying a first modification to a base tactile output pattern in accordance with the first and second values of the intensity-change metric, respectively; and

generating the third and fourth tactile outputs includes applying a second modification, distinct from the first modification, to the base tactile output pattern in accordance with the third and fourth values of the intensity-change metric, respectively.

26. The method of claim 24, wherein the second intensity threshold is different from the first intensity threshold.

27. The method of claim 17, wherein the first discrete tactile output and the second discrete tactile output are generated from a base haptic output pattern that is associated with a currently selected tactile output setting from a plurality of different tactile output settings for the home button.

28. The method of claim 17, wherein the home button is persistently displayed at a respective location or located at a persistent location on the device that is separate from the display.

29. The method of claim 17, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact over time.

30. The method of claim 17, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact measured at a time that the characteristic intensity of the contact reaches a relevant threshold intensity.

31. The method of claim 17, wherein:

detecting the input sequence includes detecting a second press input on the home button, wherein detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button;

the method further includes;

in response to detecting the second press input;

in accordance with a determination, based on an amount of time between a first point in time that corresponds to the first press input and a second point in time that corresponds to the second press input, that the first press input and the second press input are part of a predefined input pattern;

performing a second operation associated with the predefined input pattern, wherein the second operation is different from the first operation; and

providing, via the one or more tactile output generators, a fifth discrete tactile output, distinct from the first and second tactile outputs.

32. The method of claim 17, wherein:

detecting the input sequence includes detecting a second press input on the home button, wherein detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button;

the method further includes;

in response to detecting the first press input, providing a first audio output concurrently with a respective one of the first and second tactile outputs that was generated in response to the first press input; and

in response to detecting the second press input;

in accordance with a determination, based on an amount of time between a first point in time that corresponds to the first press input and a second point in time that corresponds to the second press input, that the first press input and the second press input are part of a predefined input pattern;

performing a second operation associated with the input pattern, wherein the second operation is different from the first operation;

providing, via the one or more tactile output generators, a fifth discrete tactile output, wherein the fifth tactile output is identical to the respective one of the first and second tactile outputs that was generated for the first press input; and

providing a second audio output concurrently with the fifth discrete tactile output, wherein the second audio output and the first audio output have different audio output patterns.

33. The method of claim 17, including:

in response to detecting the first press input on the home button;

changing the user interface from a first user interface to a second user interface, without regard to the value of the intensity-change metric that corresponds to the first press input.

18. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more tactile output generators for generating tactile outputs;

one or more sensors to detect intensities of contacts with a home button of the device;

one or more processors; and

memory storing one or more programs configured for execution by the one or more processors, the one or more programs including instructions for;

displaying a user interface on the display;

while displaying the user interface, detecting an input sequence on the home button that includes detecting a first press input on the home button, wherein detecting the first press input includes detecting an increase in a characteristic intensity of a contact on the home button; and

in response to detecting the first press input on the home button;

in accordance with a determination that the first press input includes an increase in the characteristic intensity of the contact above a first intensity threshold, and that a change in the characteristic intensity of the contact proximate to a time when the characteristic intensity of the contact increases above the first intensity threshold has a first value for an intensity-change metric;

performing a first operation that changes the user interface displayed on the display; and

generating, via the one or more tactile output generators, a first discrete tactile output that corresponds to the increase in the characteristic intensity of the contact above the first intensity threshold; and

in accordance with a determination that the first press input includes an increase in the characteristic intensity of the contact above the first intensity threshold, and that the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity-change metric, different from the first value of the intensity-change metric;

performing the first operation that changes the user interface displayed on the display; and

generating, via the one or more tactile output generators, a second discrete tactile output that corresponds to the increase in the characteristic intensity of the contact above the first intensity threshold and is different from the first discrete tactile output.

34. The electronic device of claim 18, wherein:

the first discrete tactile output and the second discrete tactile output have a same waveform; and

the first discrete tactile output and the second discrete tactile output have different amplitudes.

35. The electronic device of claim 18, wherein the first discrete tactile output stops while the characteristic intensity of the contact is maintained above the first intensity threshold.

36. The electronic device of claim 18, wherein the second tactile output stops while the characteristic intensity of the contact is maintained above the first intensity threshold.

37. The electronic device of claim 18, wherein the first tactile output is generated for a first range of values of the intensity-change metric.

38. The electronic device of claim 37, wherein the second tactile output is generated for a second range of values of the intensity-change metric.

39. The electronic device of claim 18, wherein:

detecting the input sequence on the home button further includes detecting a first release input on the home button, following the first press input on the home button, wherein detecting the first release input includes detecting a decrease in the characteristic intensity of the contact on the home button; and

the programs further comprise instructions for;

in response to detecting the first release input on the home button;

in accordance with a determination that the first release input includes a decrease in the characteristic intensity of the contact below a second intensity threshold, and that a change in the characteristic intensity of the contact proximate to a time when the characteristic intensity of the contact decreases below the second intensity threshold has a third value for the intensity-change metric;

generating, via the one or more tactile output generators, a third discrete tactile output that corresponds to the decrease in the characteristic intensity of the contact below the second intensity threshold; and

in accordance with a determination that the first release input includes a decrease in the characteristic intensity of the contact below the second intensity threshold, and that the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact decreases below the second intensity threshold has a fourth value for the intensity-change metric, different from the third value of the intensity-change metric;

generating, via the one or more tactile output generators, a fourth discrete tactile output that corresponds to the decrease in the characteristic intensity of the contact below the second intensity threshold and is different from the third discrete tactile output.

40. The electronic device of claim 39, wherein:

generating the first and second tactile outputs includes applying a first modification to a base tactile output pattern in accordance with the first and second values of the intensity-change metric, respectively; and

generating the third and fourth tactile outputs includes applying a second modification, distinct from the first modification, to the base tactile output pattern in accordance with the third and fourth values of the intensity-change metric, respectively.

41. The electronic device of claim 39, wherein the second intensity threshold is different from the first intensity threshold.

42. The electronic device of claim 18, wherein the first discrete tactile output and the second discrete tactile output are generated from a base haptic output pattern that is associated with a currently selected tactile output setting from a plurality of different tactile output settings for the home button.

43. The electronic device of claim 18, wherein the home button is persistently displayed at a respective location or located at a persistent location on the device that is separate from the display.

44. The electronic device of claim 18, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact over time.

45. The electronic device of claim 18, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact measured at a time that the characteristic intensity of the contact reaches a relevant threshold intensity.

46. The electronic device of claim 18, wherein:

detecting the input sequence includes detecting a second press input on the home button, wherein detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button;

the programs further comprise instructions for;

in response to detecting the second press input;

in accordance with a determination, based on an amount of time between a first point in time that corresponds to the first press input and a second point in time that corresponds to the second press input, that the first press input and the second press input are part of a predefined input pattern;

performing a second operation associated with the predefined input pattern, wherein the second operation is different from the first operation; and

providing, via the one or more tactile output generators, a fifth discrete tactile output, distinct from the first and second tactile outputs.

47. The electronic device of claim 18, wherein:

detecting the input sequence includes detecting a second press input on the home button, wherein detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button;

the programs further comprise instructions for;

in response to detecting the first press input, providing a first audio output concurrently with a respective one of the first and second tactile outputs that was generated in response to the first press input; and

in response to detecting the second press input;

in accordance with a determination, based on an amount of time between a first point in time that corresponds to the first press input and a second point in time that corresponds to the second press input, that the first press input and the second press input are part of a predefined input pattern;

performing a second operation associated with the input pattern, wherein the second operation is different from the first operation;

providing, via the one or more tactile output generators, a fifth discrete tactile output, wherein the fifth tactile output is identical to the respective one of the first and second tactile outputs that was generated for the first press input; and

providing a second audio output concurrently with the fifth discrete tactile output, wherein the second audio output and the first audio output have different audio output patterns.

48. The electronic device of claim 18, the programs further comprising instructions for:

in response to detecting the first press input on the home button;

changing the user interface from a first user interface to a second user interface, without regard to the value of the intensity-change metric that corresponds to the first press input.