Electronic touch communication

• US 9,846,508 B2
• Filed: 08/28/2015
• Issued: 12/19/2017
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Anzures, Freddy Allen, Chaudhri, Imran, Dye, Alan C., Ive, Jonathan P., Kerr, Duncan Robert, King, Nicholas V., Lynch, Kevin, Novick, Gregory, Preston, Daniel Trent, Jenkins, Monica, Yang, Lawrence Y.
• Primary Examiner(s): Lu, Hua
• Application Number:
  US14/839,918
• Publication Number:
  US 20160062574A1
• Time in Patent Office: 844 Days
• Field of Search: None
• CPC Class Codes: F16M 13/00 Other supports for positioning apparatus or articles heads thereof F16M11/02 ; undercarriages thereof F16M11/20 ; adapted to be stuck in the ground A45F3/44 ; sockets or holders for poles or posts E04H12/22; Means for steadying hand-held apparatus or articles supports for measuring instruments G01D11/30; supports for casings of remote control switching devices H01H9/025
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/20 Drawing from basic elements, e.g. lines or circles
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04M 1/72439 for image or video messaging

Abstract

Touch inputs such as single-finger contacts and multiple-finger contacts are detected at an electronic device and translated into electronic touch communications for playback at an external electronic device.

Claims

1. A method comprising:

at an electronic device with a touch-sensitive display;

detecting a user input and in response to detecting the user input, displaying a plurality of affordances representing contacts;

detecting user selection of a displayed affordance representing a contact;

in response to detecting user selection of the displayed affordance, replacing the display of the plurality of affordances with a display of contact information identifying a selected contact, the selected contact represented by the selected affordance;

detecting a touch on the touch-sensitive display while displaying the contact information;

in response to detecting the touch;

displaying a drawing area, wherein the drawing area is responsive to touch input;

detecting a first touch input in the drawing area representing a first stroke, wherein the first stroke has characteristic kinematics;

displaying a visual representation, in the drawing area, representing a shape of the first stroke; and

sending data representing the shape of the first stroke and data indicating the characteristic kinematics of the first stroke to an external device associated with the selected contact, wherein the data triggers the external device to display a visual representation of the first stroke with the characteristic kinematics.

2. The method according to claim 1, further comprising:

determining whether a first predetermined duration of time has passed after the first touch input, and

wherein sending data representing the first stroke comprises sending the data in response to determining that the first predetermined duration has passed.

3. The method according to claim 2, further comprising:

before the first predetermined duration has passed, detecting a second touch input in the on-screen drawing area representing a second stroke, where the first and second strokes are separated by an intervening amount of time; and

sending data to the external device associated with the second stroke and the intervening amount of time.

4. The method according to claim 3, wherein sending the data triggers the external device to display a visual representation of the first stroke, followed by a pause of the intervening amount of time, and then display a visual representation of the second stroke.

5. The method according to claim 3, wherein the second, third, and fourth predetermined durations of time are the same duration.

6. The method according to claim 1, further comprising:

fading out the displayed visual representation of the first stroke after the first stroke has been received for a second predetermined duration of time.

7. The method according to claim 6,

wherein a stroke has a beginning and an end, and

wherein fading out the visual representation of a stroke comprises fading out a corresponding beginning of the visual representation before fading out a corresponding end of the visual representation.

8. The method according to claim 1, wherein sending the data triggers the external device to:

display an indication of the receiving of the data, and

display an affordance, wherein the affordance when selected causes the external device to display a visual representation of the first stroke.

9. The method according to claim 8, further comprising:

fading out the visual representation of a stroke after determining the visual representation has been displayed for a third predetermined duration of time.

10. The method according to claim 1, wherein sending the data triggers the external device to display a visual representation of the first stroke.

11. The method according to claim 1, further comprising:

receiving data from the external device, the data representing a third touch input detected by the external device, the third touch input representing a third stroke;

displaying a visual representation of the third stroke in the drawing area at the electronic device.

12. The method according to claim 11, further comprising:

fading out the visual representation of the third stroke after a fourth predetermined duration of time.

13. The method according to claim 1, further comprising:

displaying a color-picker affordance in the drawing area, wherein the color-picker affordance has a color indicating a currently selected color,

wherein displaying the visual representation of the first stroke comprises displaying the visual representation in the currently selected color; and

in response to detecting a selection of the color-picker affordance, displaying a plurality of color affordances representing colors.

14. The method according to claim 13, wherein the plurality of color affordances include affordances representing previously-selected colors.

15. The method according to claim 13, further comprising:

in response to detecting a selection of a color affordance of the displayed plurality of color affordances, displaying a color palette.

16. The method according to claim 15, wherein the color palette comprises a plurality of portions having different colors, the method further comprising:

in response to detecting a selection of a portion of the color palette corresponding to a selected color;

displaying the drawing area; and

updating the color-picker affordance displayed in the drawing area such that the color-picker affordance is displayed with the selected color, and

wherein sending data representing the first stroke to the external device comprises sending data representing the selected color.

17. The method according to claim 1, wherein the electronic device comprises a rotatable input mechanism, the method further comprising:

at the electronic device;

while displaying the plurality of affordances representing contacts, detecting user input representing movement of the rotatable input mechanism;

in response to detecting the user input;

zooming the display of the plurality of user-designated contacts, wherein zooming the display comprises changing the size of contacts being displayed.

18. The method according to claim 1, wherein zooming the display comprises changing the number of contacts being displayed.

19. The method according to claim 1, wherein the touch-sensitive display comprises one or more sensors to detect the intensity of touches on the touch-sensitive display, the method further comprising:

while displaying the drawing area, detecting a touch on the touch-sensitive display, wherein the touch has a characteristic intensity;

determining whether the characteristic intensity exceeds a predetermined threshold intensity;

in response to a determination that the characteristic intensity exceeds the predetermined threshold intensity;

displaying a call affordance, wherein the call affordance, when selected, causes the electronic device to initiate a call to the external device associated with the contact; and

in response to a determination that the characteristic intensity does not exceed the predetermined threshold intensity, sending data representing the touch to the external device.

20. The method according to claim 1, wherein the touch-sensitive display comprises one or more sensors to detect the intensity of touches on the touch-sensitive display, the method further comprising:

while displaying the drawing area, detecting a touch on the touch-sensitive display, wherein the touch has a characteristic intensity;

determining whether the characteristic intensity exceeds a predetermined threshold intensity;

in response to a determination that the characteristic intensity exceeds the predetermined threshold intensity;

displaying a text affordance, wherein the text affordance, when selected, causes the electronic device to initiate a message addressed to the external device associated with the contact; and

in response to a determination that the characteristic intensity does not exceed the predetermined threshold intensity, sending data representing the touch to the external device.

21. The method according to claim 1, further comprising:

while displaying contact information identifying the selected contact, displaying a call affordance, wherein the call affordance, when selected, causes the electronic device to initiate a call to the external device associated with the selected contact.

22. The method according to claim 1, further comprising:

while displaying contact information identifying the selected contact, displaying a text affordance, wherein the text affordance, when selected, causes the electronic device to initiate a message addressed to the external device associated with the selected contact.

23. The method according to claim 1,

wherein displaying the plurality of affordances representing contacts comprises displaying a plurality of affordances representing user-designated contacts, user-designated contacts being a subset of contacts accessible to the electronic device.

24. The method according to claim 1,

wherein the electronic device comprises a depressible input mechanism separate from the touch-sensitive display, and

wherein detecting user input comprises detecting activation of the depressible input mechanism.

25. The method according to claim 1, wherein the electronic device comprises a depressible input mechanism and a microphone, the method further comprising:

while displaying the drawing area, detecting an activation of the depressible input mechanism;

in response to detecting the activation;

recording an audio message based on input received from the microphone while the depressible input mechanism remains depressed;

detecting a release of the depressible input mechanism; and

in response to detecting the release;

ceasing to record the audio message and sending the recorded audio message to the external device associated with the selected contact.

26. An electronic device, comprising:

a touch-sensitive display;

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

detecting a user input and in response to detecting the user input, displaying a plurality of affordances representing contacts;

detecting user selection of a displayed affordance representing a contact;

in response to detecting user selection of the displayed affordance, replacing the display of the plurality of affordances with a display of contact information identifying a selected contact, the selected contact represented by the selected affordance;

detecting a touch on the touch-sensitive display while displaying the contact information;

in response to detecting the touch;

displaying a drawing area, wherein the drawing area is responsive to touch input;

detecting a first touch input in the drawing area representing a first stroke, wherein the first stroke has characteristic kinematics;

displaying a visual representation, in the drawing area, representing a shape of the first stroke; and

sending data representing the shape of the first stroke and data indicating the characteristic kinematics of the first stroke to an external device associated with the selected contact, wherein the data triggers the external device to display a visual representation of the first stroke with the characteristic kinematics.

27. The electronic device of claim 26, the one or more programs further including instructions for:

determining whether a first predetermined duration of time has passed after the first touch input, and

wherein sending data representing the first stroke comprises sending the data in response to determining that the first predetermined duration has passed.

28. The electronic device of claim 27, the one or more programs further including instructions for:

before the first predetermined duration has passed, detecting a second touch input in the on- screen drawing area representing a second stroke, where the first and second strokes are separated by an intervening amount of time; and

sending data to the external device associated with the second stroke and the intervening amount of time.

29. The electronic device of claim 26, the one or more programs further including instructions for:

fading out the displayed visual representation of the first stroke after the first stroke has been received for a second predetermined duration of time.

30. The electronic device of claim 29,

wherein a stroke has a beginning and an end, and

wherein fading out the visual representation of a stroke comprises fading out a corresponding beginning of the visual representation before fading out a corresponding end of the visual representation.

31. The electronic device of claim 26, the one or more programs further including instructions for:

receiving data from the external device, the data representing a third touch input detected by the external device, the third touch input representing a third stroke;

displaying a visual representation of the third stroke in the drawing area at the electronic device.

32. The method according to claim 31, further comprising:

fading out the visual representation of the third stroke after a fourth predetermined duration of time.

33. The electronic device of claim 26, the one or more programs further including instructions for:

displaying a color-picker affordance in the drawing area, wherein the color-picker affordance has a color indicating a currently selected color,

wherein displaying the visual representation of the first stroke comprises displaying the visual representation in the currently selected color; and

in response to detecting a selection of the color-picker affordance, displaying a plurality of color affordances representing colors.

34. The electronic device of claim 33, wherein the plurality of color affordances include affordances representing previously-selected colors.

35. The electronic device of claim 33, the one or more programs further including instructions for:

in response to detecting a selection of a color affordance of the displayed plurality of color affordances, displaying a color palette.

36. The electronic device of claim 35, wherein the color palette comprises a plurality of portions having different colors, the one or more programs further including instructions for:

in response to detecting a selection of a portion of the color palette corresponding to a selected color;

displaying the drawing area; and

updating the color-picker affordance displayed in the drawing area such that the color-picker affordance is displayed with the selected color, and

wherein sending data representing the first stroke to the external device comprises sending data representing the selected color.

37. The electronic device of claim 26, wherein the electronic device further comprises a rotatable input mechanism, the one or more programs further including instructions for:

at the electronic device;

while displaying the plurality of affordances representing contacts, detecting user input representing movement of the rotatable input mechanism;

in response to detecting the user input;

zooming the display of the plurality of user-designated contacts, wherein zooming the display comprises changing the size of contacts being displayed.

38. The electronic device of claim 26, wherein zooming the display comprises changing the number of contacts being displayed.

39. The electronic device of claim 26, wherein the touch-sensitive display comprises one or more sensors to detect the intensity of touches on the touch-sensitive display, the one or more programs further including instructions for:

while displaying the drawing area, detecting a touch on the touch-sensitive display, wherein the touch has a characteristic intensity;

determining whether the characteristic intensity exceeds a predetermined threshold intensity;

in response to a determination that the characteristic intensity exceeds the predetermined threshold intensity;

displaying a call affordance, wherein the call affordance, when selected, causes the electronic device to initiate a call to the external device associated with the contact; and

in response to a determination that the characteristic intensity does not exceed the predetermined threshold intensity, sending data representing the touch to the external device.

40. The electronic device of claim 26, wherein the touch-sensitive display comprises one or more sensors to detect the intensity of touches on the touch-sensitive display, the one or more programs further including instructions for:

while displaying the drawing area, detecting a touch on the touch-sensitive display, wherein the touch has a characteristic intensity;

determining whether the characteristic intensity exceeds a predetermined threshold intensity;

in response to a determination that the characteristic intensity exceeds the predetermined threshold intensity;

displaying a text affordance, wherein the text affordance, when selected, causes the electronic device to initiate a message addressed to the external device associated with the contact; and

in response to a determination that the characteristic intensity does not exceed the predetermined threshold intensity, sending data representing the touch to the external device.

41. The electronic device of claim 26, the one or more programs further including instructions for:

while displaying contact information identifying the selected contact, displaying a call affordance, wherein the call affordance, when selected, causes the electronic device to initiate a call to the external device associated with the selected contact.

42. The electronic device of claim 26, the one or more programs further including instructions for:

while displaying contact information identifying the selected contact, displaying a text affordance, wherein the text affordance, when selected, causes the electronic device to initiate a message addressed to the external device associated with the selected contact.

43. The electronic device of claim 26,

wherein displaying the plurality of affordances representing contacts comprises displaying a plurality of affordances representing user-designated contacts, user-designated contacts being a subset of contacts accessible to the electronic device.

44. The electronic device of claim 26, wherein the electronic device comprises a depressible input mechanism and a microphone, the one or more programs further including instructions for:

while displaying the drawing area, detecting an activation of the depressible input mechanism;

in response to detecting the activation;

recording an audio message based on input received from the microphone while the depressible input mechanism remains depressed;

detecting a release of the depressible input mechanism; and

in response to detecting the release;

ceasing to record the audio message and sending the recorded audio message to the external device associated with the selected contact.

45. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a touch-sensitive display, cause the electronic device to:

detect a user input and in response to detecting the user input, displaying a plurality of affordances representing contacts;

detect user selection of a displayed affordance representing a contact;

in response to detecting user selection of the displayed affordance, replace the display of the plurality of affordances with a display of contact information identifying a selected contact, the selected contact represented by the selected affordance;

detect a touch on the touch-sensitive display while displaying the contact information;

in response to detecting the touch;

display a drawing area, wherein the drawing area is responsive to touch input;

detect a first touch input in the drawing area representing a first stroke, wherein the first stroke has characteristic kinematics;

display a visual representation, in the drawing area, representing a shape of the first stroke; and

send data representing the shape of the first stroke and data indicating the characteristic kinematics of the first stroke to an external device associated with the selected contact, wherein the data triggers the external device to display a visual representation of the first stroke with the characteristic kinematics.

46. The non-transitory computer-readable storage medium of claim 45, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

determine whether a first predetermined duration of time has passed after the first touch input, and

wherein sending data representing the first stroke comprises sending the data in response to determining that the first predetermined duration has passed.

47. The non-transitory computer-readable storage medium of claim 46, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

before the first predetermined duration has passed, detect a second touch input in the on-screen drawing area representing a second stroke, where the first and second strokes are separated by an intervening amount of time; and

send data to the external device associated with the second stroke and the intervening amount of time.

48. The non-transitory computer-readable storage medium of claim 45, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

fade out the displayed visual representation of the first stroke after the first stroke has been received for a second predetermined duration of time.

49. The non-transitory computer-readable storage medium of claim 48,

wherein a stroke has a beginning and an end, and

wherein fading out the visual representation of a stroke comprises fading out a corresponding beginning of the visual representation before fading out a corresponding end of the visual representation.

50. The non-transitory computer-readable storage medium of claim 45, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

receive data from the external device, the data representing a third touch input detected by the external device, the third touch input representing a third stroke;

display a visual representation of the third stroke in the drawing area at the electronic device.

51. The non-transitory computer-readable storage medium of claim 50, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

fade out the visual representation of the third stroke after a fourth predetermined duration of time.

52. The non-transitory computer-readable storage medium of claim 45, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

display a color-picker affordance in the drawing area, wherein the color-picker affordance has a color indicating a currently selected color,

wherein displaying the visual representation of the first stroke comprises displaying the visual representation in the currently selected color; and

in response to detecting a selection of the color-picker affordance, display a plurality of color affordances representing colors.

53. The non-transitory computer-readable storage medium of claim 52, wherein the plurality of color affordances include affordances representing previously-selected colors.

54. The non-transitory computer-readable storage medium of claim 52, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

in response to detecting a selection of a color affordance of the displayed plurality of color affordances, display a color palette.

55. The non-transitory computer-readable storage medium of claim 54, wherein the color palette comprises a plurality of portions having different colors, and wherein the storage medium further comprises instructions, which when executed by the one or more processors, cause the electronic device to:

in response to detecting a selection of a portion of the color palette corresponding to a selected color;

display the drawing area; and

update the color-picker affordance displayed in the drawing area such that the color-picker affordance is displayed with the selected color, and

wherein sending data representing the first stroke to the external device comprises sending data representing the selected color.

56. The non-transitory computer-readable storage medium of claim 45, wherein the electronic device comprises a rotatable input mechanism, and wherein the storage medium further comprises instructions, which when executed by the one or more processors, cause the electronic device to:

at the electronic device;

while displaying the plurality of affordances representing contacts, detect user input representing movement of the rotatable input mechanism;

in response to detecting the user input;

zoom the display of the plurality of user-designated contacts, wherein zooming the display comprises changing the size of contacts being displayed.

57. The non-transitory computer readable storage medium of claim 45, wherein zooming the display comprises changing the number of contacts being displayed.

58. The non-transitory computer-readable storage medium of claim 45, wherein the touch-sensitive display comprises one or more sensors to detect the intensity of touches on the touch-sensitive display, and wherein the storage medium further comprises instructions, which when executed by the one or more processors, cause the electronic device to:

while displaying the drawing area, detect a touch on the touch-sensitive display, wherein the touch has a characteristic intensity;

determine whether the characteristic intensity exceeds a predetermined threshold intensity;

in response to a determination that the characteristic intensity exceeds the predetermined threshold intensity;

display a call affordance, wherein the call affordance, when selected, causes the electronic device to initiate a call to the external device associated with the contact; and

in response to a determination that the characteristic intensity does not exceed the predetermined threshold intensity, send data representing the touch to the external device.

59. The non-transitory computer-readable storage medium of claim 45, wherein the touch-sensitive display comprises one or more sensors to detect the intensity of touches on the touch-sensitive display, and wherein the storage medium further comprises instructions, which when executed by the one or more processors, cause the electronic device to:

while displaying the drawing area, detect a touch on the touch-sensitive display, wherein the touch has a characteristic intensity;

determine whether the characteristic intensity exceeds a predetermined threshold intensity;

in response to a determination that the characteristic intensity exceeds the predetermined threshold intensity;

display a text affordance, wherein the text affordance, when selected, causes the electronic device to initiate a message addressed to the external device associated with the contact; and

in response to a determination that the characteristic intensity does not exceed the predetermined threshold intensity, send data representing the touch to the external device.

60. The non-transitory computer-readable storage medium of claim 45, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

while displaying contact information identifying the selected contact, display a call affordance, wherein the call affordance, when selected, causes the electronic device to initiate a call to the external device associated with the selected contact.

61. The non-transitory computer-readable storage medium of claim 45, further comprising instructions, which when executed by the one or more processors, cause the electronic device to:

while displaying contact information identifying the selected contact, display a text affordance, wherein the text affordance, when selected, causes the electronic device to initiate a message addressed to the external device associated with the selected contact.

62. The non-transitory computer-readable storage medium of claim 45,

wherein displaying the plurality of affordances representing contacts comprises displaying a plurality of affordances representing user-designated contacts, user-designated contacts being a subset of contacts accessible to the electronic device.

63. The non-transitory computer-readable storage medium of claim 45, wherein the electronic device comprises a depressible input mechanism and a microphone, and wherein the storage medium further comprises instructions, which when executed by the one or more processors, cause the electronic device to:

while displaying the drawing area, detect an activation of the depressible input mechanism;

in response to detecting the activation;

record an audio message based on input received from the microphone while the depressible input mechanism remains depressed;

detect a release of the depressible input mechanism; and

in response to detecting the release;

cease to record the audio message and send the recorded audio message to the external device associated with the selected contact.