Devices, methods, and graphical user interfaces for providing haptic feedback

• US 10,175,759 B2
• Filed: 09/22/2016
• Issued: 01/08/2019
• Est. Priority Date: 06/12/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Chaudhri, Imran A., Bauer, Sebastian J., Alonso Ruiz, Marcos, Verweij, Hugo D., Butcher, Gary I., Moussette, Camille, Mouilleseaux, Jean-Pierre M., Cordier, Madeleine S., Kopin, Joshua B., Fennis, Jules K.
• Primary Examiner(s): Nabi, Reza
• Application Number:
  US15/273,688
• Publication Number:
  US 20170357319A1
• Time in Patent Office: 838 Days
• Field of Search: 715702
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails

Abstract

An electronic device with a touch-sensitive surface, a display, and tactile output generator(s) displays a user interface including an object and predetermined snap positions. The device detects a first portion of an input by a contact on the object to select the object. In response to detecting the object selection, the device visually indicates the selection and generates a first tactile output. While the object is selected, the device detects a movement of the contact as the second portion of the input by the contact. According to the contact movement, the device moves the object. After detecting the second portion and while the object is proximate to a predetermined snap position, the device detects a third portion of the input by the contact to drop off the object. In response, the device visually indicates the deselection, moves the object to the predetermined snap position; and generates a second tactile output.

Claims

1. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more tactile output generators for generating tactile outputs associated with physical displacement of the electronic device or a component of the electronic device, cause the device to:

display a user interface on the display, wherein the user interface includes a first object and a plurality of predetermined object snap positions;

detect a first portion of an input by a contact on the touch-sensitive surface at a location that corresponds to the first object in the user interface;

in response to detecting the first portion of the input by the contact, and in accordance with a determination that the first portion of the input meets selection criteria;

visually indicate selection of the first object; and

generate a first tactile output in conjunction with visually indicating selection of the first object;

while the first object is selected, detect a second portion of the input by the contact on the touch-sensitive surface, wherein detecting the second portion of the input includes detecting movement of the contact across the touch-sensitive surface;

in response to detecting the second portion of the input by the contact, move the first object on the user interface in accordance with the movement of the contact;

after detecting the second portion of the input, while the first object is proximate to a first predetermined object snap position, detect a third portion of the input by the contact on the touch sensitive surface; and

in response to detecting the third portion of the input by the contact, and in accordance with a determination that the third portion of the input meets drop-off criteria;

visually indicate deselection of the first object;

move the first object to the first predetermined object snap position, wherein moving the first object to the first predetermined object snap position includes movement of the first object settling into the first predetermined object snap position; and

generate a second tactile output that is synchronized with the movement of the first object settling into the first predetermined object snap position.

2. The computer readable storage medium of claim 1, wherein the selection criteria require that a characteristic intensity of the contact exceeds a first intensity threshold and that the contact is maintained for at least a predetermined threshold amount of time in order for the selection criteria to be met.

3. The computer readable storage medium of claim 1, wherein the selection criteria require that a characteristic intensity of the contact exceeds a first intensity threshold and a second intensity threshold above the first intensity threshold.

4. The computer readable storage medium of claim 1, wherein a second tactile output pattern of the second tactile output is different from a first tactile output pattern of the first tactile output.

5. The computer readable storage medium of claim 1, wherein the first tactile output is generated concurrently with visually indicating the selection of the first object.

6. The computer readable storage medium of claim 1, wherein the second tactile output is generated concurrently with arrival of the first object at the first predetermined object snap position.

7. The computer readable storage medium of claim 1, wherein:

detecting the movement of the contact across the touch-sensitive surface includes detecting that the contact has moved to a threshold location in proximity to an edge of the display;

moving the first object on the user interface in accordance with the movement of the contact includes moving the first object to the threshold location in proximity to the edge of the display in accordance with the movement of the contact; and

the one or more programs further comprise instructions that cause the device to;

shift the user interface relative to the first object on the display, such that a previously un-displayed portion of the user interface is displayed underneath the first object; and

generate a third tactile output in conjunction with shifting the user interface relative to the first object on the display.

8. The computer readable storage medium of claim 1, wherein:

detecting the movement of the contact across the touch-sensitive surface includes detecting that the contact has moved to a threshold location in proximity to a second predetermined object snap position; and

moving the first object on the user interface in accordance with the movement of the contact includes;

in response to detecting that the contact has moved to the threshold location in proximity to the second predetermined object snap position, moving the first object, relative to the threshold location, to the second predetermined object snap position; and

generating a third tactile output in conjunction with moving the first object to the second predetermined object snap position.

9. The computer readable storage medium of claim 1, wherein:

before the first object is moved to the first predetermined snap location, the user interface includes a second object located at the first predetermined snap position, and the user interface includes a second predetermined snap position adjacent to the first predetermined snap position; and

the one or more programs further comprise instructions that cause the device to;

move the first object toward the first predetermined snap position;

in accordance with a determination that the first object is within a threshold range of the first predetermined snap position, move the second object from the first predetermined snap position to the second predetermined object snap position; and

generate a fourth tactile output in conjunction with moving the second object to the second predetermined snap position.

10. The computer readable storage medium of claim 9, wherein:

the third portion of the input includes lift-off of the contact; and

moving the first object toward the first predetermined snap position includes continuing movement of the first object toward the first predetermined snap position after the lift-off of the contact.

11. The computer readable storage medium of claim 1, wherein the first tactile output has a higher amplitude than the second tactile output.

12. The computer readable storage medium of claim 1, wherein the first tactile output has a same waveform as the second tactile output.

13. The computer readable storage medium of claim 1, the one or more programs further comprising instructions that cause the device to:

detect a second input by a second contact on the touch-sensitive surface at a location that corresponds to a third snap position in the user interface; and

in accordance with a determination that the second input meets item creation criteria;

display a new object in the user interface; and

generate a fifth tactile output in conjunction with displaying the new object in the user interface.

14. The computer readable storage medium of claim 13, the one or more programs further comprising instructions that cause the device to:

detect termination of the second input, including detecting lift-off of the second contact;

in response to detecting the lift-off of the second contact;

display a second user interface for entering information related to the new object;

in accordance with a determination that the second input includes movement of the second contact before the lift-off of the second contact, generate a sixth tactile output; and

in accordance with a determination that the second input does not include movement of the second contact before the lift-off of the second contact, forgo generation of the sixth tactile output.

15. The computer readable storage medium of claim 1, the one or more programs further comprising instructions that cause the device to:

in response to detecting the first portion of the input by the contact, and in accordance with a determination that the first portion of the input does not meet the selection criteria, scroll content displayed in the user interface in response to detecting movement of the contact across the touch-sensitive surface.

16. The computer readable storage medium of claim 1, wherein:

the user interface is a calendar interface,

the plurality of predetermined snap positions correspond to a plurality of dates, and

the first object includes a representation of a calendar entry.

17. The computer readable storage medium of claim 1, wherein:

the user interface is an application launch user interface that includes a plurality of application icons that correspond to different applications of a plurality of applications,

the plurality of predetermined snap positions correspond to a plurality of positions for displaying application icons, and

the first object includes a first application icon that corresponds to a first application of the plurality of applications.

18. The computer readable storage medium of claim 1, wherein:

the user interface is a weather forecast user interface that includes a plurality of weather items that correspond to different geographical locations of a plurality of geographical locations and include an indication of the weather at a corresponding geographical location,

the plurality of predetermined snap positions correspond to a plurality of positions for displaying weather items, and

the first object includes a first weather item of the plurality of weather items.

19. A method, comprising:

at an electronic device with a touch-sensitive surface, a display, and one or more tactile output generators for generating tactile outputs associated with physical displacement of the electronic device or a component of the electronic device;

displaying a user interface on the display, wherein the user interface includes a first object and a plurality of predetermined object snap positions;

detecting a first portion of an input by a contact on the touch-sensitive surface at a location that corresponds to the first object in the user interface;

in response to detecting the first portion of the input by the contact, and in accordance with a determination that the first portion of the input meets selection criteria;

visually indicating selection of the first object; and

generating a first tactile output in conjunction with visually indicating selection of the first object;

while the first object is selected, detecting a second portion of the input by the contact on the touch-sensitive surface, wherein detecting the second portion of the input includes detecting movement of the contact across the touch-sensitive surface;

in response to detecting the second portion of the input by the contact, moving the first object on the user interface in accordance with the movement of the contact;

after detecting the second portion of the input, while the first object is proximate to a first predetermined object snap position, detecting a third portion of the input by the contact on the touch sensitive surface; and

in response to detecting the third portion of the input by the contact, and in accordance with a determination that the third portion of the input meets drop-off criteria;

visually indicating deselection of the first object;

moving the first object to the first predetermined object snap position, wherein moving the first object to the first predetermined object snap position includes movement of the first object settling into the first predetermined object snap position; and

generating a second tactile output that is synchronized with the movement of the first object settling into the first predetermined object snap position.

20. The method of claim 19, wherein the selection criteria require that a characteristic intensity of the contact exceeds a first intensity threshold and that the contact is maintained for at least a predetermined threshold amount of time in order for the selection criteria to be met.

21. The method of claim 19, wherein the selection criteria require that a characteristic intensity of the contact exceeds a first intensity threshold and a second intensity threshold above the first intensity threshold.

22. The method of claim 19, wherein a second tactile output pattern of the second tactile output is different from a first tactile output pattern of the first tactile output.

23. The method of claim 19, wherein the first tactile output is generated concurrently with visually indicating the selection of the first object.

24. The method of claim 19, wherein the second tactile output is generated concurrently with arrival of the first object at the first predetermined object snap position.

25. The method of claim 19, wherein:

detecting the movement of the contact across the touch-sensitive surface includes detecting that the contact has moved to a threshold location in proximity to an edge of the display;

moving the first object on the user interface in accordance with the movement of the contact includes moving the first object to the threshold location in proximity to the edge of the display in accordance with the movement of the contact; and

the method further includes;

shifting the user interface relative to the first object on the display, such that a previously un-displayed portion of the user interface is displayed underneath the first object; and

generating a third tactile output in conjunction with shifting the user interface relative to the first object on the display.

26. The method of claim 19, wherein:

detecting the movement of the contact across the touch-sensitive surface includes detecting that the contact has moved to a threshold location in proximity to a second predetermined object snap position; and

moving the first object on the user interface in accordance with the movement of the contact includes;

in response to detecting that the contact has moved to the threshold location in proximity to the second predetermined object snap position, moving the first object, relative to the threshold location, to the second predetermined object snap position; and

generating a third tactile output in conjunction with moving the first object to the second predetermined object snap position.

27. The method of claim 19, wherein:

before the first object is moved to the first predetermined snap location, the user interface includes a second object located at the first predetermined snap position, and the user interface includes a second predetermined snap position adjacent to the first predetermined snap position; and

the method further includes;

moving the first object toward the first predetermined snap position;

in accordance with a determination that the first object is within a threshold range of the first predetermined snap position, moving the second object from the first predetermined snap position to the second predetermined object snap position; and

generating a fourth tactile output in conjunction with moving the second object to the second predetermined snap position.

28. The method of claim 27, wherein:

the third portion of the input includes lift-off of the contact; and

moving the first object toward the first predetermined snap position includes continuing movement of the first object toward the first predetermined snap position after the lift-off of the contact.

29. The method of claim 19, wherein the first tactile output has a higher amplitude than the second tactile output.

30. The method of claim 19, wherein the first tactile output has a same waveform as the second tactile output.

31. The method of claim 19, including:

detecting a second input by a second contact on the touch-sensitive surface at a location that corresponds to a third snap position in the user interface; and

in accordance with a determination that the second input meets item creation criteria;

displaying a new object in the user interface; and

generating a fifth tactile output in conjunction with displaying the new object in the user interface.

32. The method of claim 31, including:

detecting termination of the second input, including detecting lift-off of the second contact;

in response to detecting the lift-off of the second contact;

displaying a second user interface for entering information related to the new object;

in accordance with a determination that the second input includes movement of the second contact before the lift-off of the second contact, generating a sixth tactile output; and

in accordance with a determination that the second input does not include movement of the second contact before the lift-off of the second contact, forgoing generation of the sixth tactile output.

33. The method of claim 19, including:

in response to detecting the first portion of the input by the contact, and in accordance with a determination that the first portion of the input does not meet the selection criteria, scrolling content displayed in the user interface in response to detecting movement of the contact across the touch-sensitive surface.

34. The method of claim 19, wherein:

the user interface is a calendar interface,

the plurality of predetermined snap positions correspond to a plurality of dates, and

the first object includes a representation of a calendar entry.

35. The method of claim 19, wherein:

the user interface is an application launch user interface that includes a plurality of application icons that correspond to different applications of a plurality of applications,

the plurality of predetermined snap positions correspond to a plurality of positions for displaying application icons, and

the first object includes a first application icon that corresponds to a first application of the plurality of applications.

36. The method of claim 19, wherein:

the user interface is a weather forecast user interface that includes a plurality of weather items that correspond to different geographical locations of a plurality of geographical locations and include an indication of the weather at a corresponding geographical location,

the plurality of predetermined snap positions correspond to a plurality of positions for displaying weather items, and

the first object includes a first weather item of the plurality of weather items.

37. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more tactile output generators for generating tactile outputs associated with physical displacement of the electronic device or a component of the electronic device;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a user interface on the display, wherein the user interface includes a first object and a plurality of predetermined object snap positions;

detecting a first portion of an input by a contact on the touch-sensitive surface at a location that corresponds to the first object in the user interface;

in response to detecting the first portion of the input by the contact, and in accordance with a determination that the first portion of the input meets selection criteria;

visually indicating selection of the first object; and

generating a first tactile output in conjunction with visually indicating selection of the first object;

while the first object is selected, detecting a second portion of the input by the contact on the touch-sensitive surface, wherein detecting the second portion of the input includes detecting movement of the contact across the touch-sensitive surface;

in response to detecting the second portion of the input by the contact, moving the first object on the user interface in accordance with the movement of the contact;

after detecting the second portion of the input, while the first object is proximate to a first predetermined object snap position, detecting a third portion of the input by the contact on the touch sensitive surface; and

in response to detecting the third portion of the input by the contact, and in accordance with a determination that the third portion of the input meets drop-off criteria;

visually indicating deselection of the first object;

moving the first object to the first predetermined object snap position, wherein moving the first object to the first predetermined object snap position includes movement of the first object settling into the first predetermined object snap position; and

generating a second tactile output that is synchronized with the movement of the first object settling into the first predetermined object snap position.

38. The electronic device of claim 37, wherein the selection criteria require that a characteristic intensity of the contact exceeds a first intensity threshold and that the contact is maintained for at least a predetermined threshold amount of time in order for the selection criteria to be met.

39. The electronic device of claim 37, wherein the selection criteria require that a characteristic intensity of the contact exceeds a first intensity threshold and a second intensity threshold above the first intensity threshold.

40. The electronic device of claim 37, wherein a second tactile output pattern of the second tactile output is different from a first tactile output pattern of the first tactile output.

41. The electronic device of claim 37, wherein the first tactile output is generated concurrently with visually indicating the selection of the first object.

42. The electronic device of claim 37, wherein the second tactile output is generated concurrently with arrival of the first object at the first predetermined object snap position.

43. The electronic device of claim 37, wherein:

detecting the movement of the contact across the touch-sensitive surface includes detecting that the contact has moved to a threshold location in proximity to an edge of the display;

moving the first object on the user interface in accordance with the movement of the contact includes moving the first object to the threshold location in proximity to the edge of the display in accordance with the movement of the contact; and

the one or more programs further include instructions for;

shifting the user interface relative to the first object on the display, such that a previously un-displayed portion of the user interface is displayed underneath the first object; and

generating a third tactile output in conjunction with shifting the user interface relative to the first object on the display.

44. The electronic device of claim 37, wherein:

detecting the movement of the contact across the touch-sensitive surface includes detecting that the contact has moved to a threshold location in proximity to a second predetermined object snap position; and

moving the first object on the user interface in accordance with the movement of the contact includes;

in response to detecting that the contact has moved to the threshold location in proximity to the second predetermined object snap position, moving the first object, relative to the threshold location, to the second predetermined object snap position; and

generating a third tactile output in conjunction with moving the first object to the second predetermined object snap position.

45. The electronic device of claim 37, wherein:

before the first object is moved to the first predetermined snap location, the user interface includes a second object located at the first predetermined snap position, and the user interface includes a second predetermined snap position adjacent to the first predetermined snap position; and

the one or more programs further include instructions for;

moving the first object toward the first predetermined snap position;

in accordance with a determination that the first object is within a threshold range of the first predetermined snap position, moving the second object from the first predetermined snap position to the second predetermined object snap position; and

generating a fourth tactile output in conjunction with moving the second object to the second predetermined snap position.

46. The electronic device of claim 45, wherein:

the third portion of the input includes lift-off of the contact; and

moving the first object toward the first predetermined snap position includes continuing movement of the first object toward the first predetermined snap position after the lift-off of the contact.

47. The electronic device of claim 37, wherein the first tactile output has a higher amplitude than the second tactile output.

48. The electronic device of claim 37, wherein the first tactile output has a same waveform as the second tactile output.

49. The electronic device of claim 37, the one or more programs further including instructions for:

detecting a second input by a second contact on the touch-sensitive surface at a location that corresponds to a third snap position in the user interface; and

in accordance with a determination that the second input meets item creation criteria;

displaying a new object in the user interface; and

generating a fifth tactile output in conjunction with displaying the new object in the user interface.

50. The electronic device of claim 49, the one or more programs further including instructions for:

detecting termination of the second input, including detecting lift-off of the second contact;

in response to detecting the lift-off of the second contact;

displaying a second user interface for entering information related to the new object;

in accordance with a determination that the second input includes movement of the second contact before the lift-off of the second contact, generating a sixth tactile output; and

in accordance with a determination that the second input does not include movement of the second contact before the lift-off of the second contact, forgoing generation of the sixth tactile output.

51. The electronic device of claim 37, the one or more programs further including instructions for:

in response to detecting the first portion of the input by the contact, and in accordance with a determination that the first portion of the input does not meet the selection criteria, scrolling content displayed in the user interface in response to detecting movement of the contact across the touch-sensitive surface.

52. The electronic device of claim 37, wherein:

the user interface is a calendar interface,

the plurality of predetermined snap positions correspond to a plurality of dates, and

the first object includes a representation of a calendar entry.

53. The electronic device of claim 37, wherein:

the user interface is an application launch user interface that includes a plurality of application icons that correspond to different applications of a plurality of applications,

the plurality of predetermined snap positions correspond to a plurality of positions for displaying application icons, and

the first object includes a first application icon that corresponds to a first application of the plurality of applications.

54. The electronic device of claim 37, wherein:

the user interface is a weather forecast user interface that includes a plurality of weather items that correspond to different geographical locations of a plurality of geographical locations and include an indication of the weather at a corresponding geographical location,

the plurality of predetermined snap positions correspond to a plurality of positions for displaying weather items, and

the first object includes a first weather item of the plurality of weather items.