Electronic communication based on user input and determination of active execution of application for playback

• US 10,788,927 B2
• Filed: 01/31/2019
• Issued: 09/29/2020
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Anzures, Freddy Allen, Chaudhri, Imran, Dye, Alan C., Ive, Jonathan P., Kerr, Duncan Robert, King, Nicholas V., Lynch, Kevin, Novick, Gregory, Preston, Daniel Trent, Jenkins, Monica, Yang, Lawrence Y.
• Primary Examiner(s): Molina, Hugo
• Application Number:
  US16/263,929
• Publication Number:
  US 20190163319A1
• Time in Patent Office: 607 Days
• CPC Class Codes: F16M 13/00 Other supports for positioning apparatus or articles heads thereof F16M11/02 ; undercarriages thereof F16M11/20 ; adapted to be stuck in the ground A45F3/44 ; sockets or holders for poles or posts E04H12/22; Means for steadying hand-held apparatus or articles supports for measuring instruments G01D11/30; supports for casings of remote control switching devices H01H9/025
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/20 Drawing from basic elements, e.g. lines or circles
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04M 1/72439 for image or video messaging

Abstract

A device includes a touch-sensitive display, one or more processors, and memory storing one or more programs including instructions for receiving data from an external device representing user input received over a duration of time at the external device. The programs may include instructions for determining whether the electronic device is actively executing an application for playback. The programs may further include instructions for in accordance with a determination that the electronic device is not actively executing an application for playback: displaying an indication of the receiving of the data; and displaying an affordance, wherein the affordance when selected launches the application for playback and causes the electronic device to playback the received data according to the duration of time of the user input.

Claims

1. A method comprising:

at an electronic device with a touch-sensitive display and configured to communicate with an external device;

receiving data from the external device representing user input received over a duration of time at the external device, the data including kinematic information;

determining whether the electronic device is actively executing an application for playback;

in accordance with a determination that the electronic device is actively executing an application for playback, playing back the received data on the electronic device according to the kinematic information, wherein a duration of playback of the received data on the electronic device is determined based on the duration of time of the user input received at the external device; and

in accordance with a determination that the electronic device is not actively executing an application for playback;

displaying an indication of the receiving of the data; and

displaying an affordance, wherein the affordance when selected launches the application for playback and causes the electronic device to playback the received data on the electronic device according to the kinematic information, wherein a duration of playback of the received data on the electronic device is determined based on the duration of time of the user input received at the external device.

2. The method of claim 1, further comprising:

in accordance with a determination that the electronic device is not actively executing the application for playback, providing haptic output in response to receiving the data.

3. The method of claim 1, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a single-finger touch input on the external device, displaying a visual representation of the single-finger touch input on a screen of the electronic device corresponding to a position on the external device where the single-finger touch input was detected.

4. The method of claim 3, wherein the visual representation comprises one or more circles, ellipses, and/or ovals.

5. The method of claim 3, wherein the visual representation comprises two or more concentric circles, ellipses, and/or ovals.

6. The method of claim 3, further comprising:

fading out the visual representation after a predetermined amount of time.

7. The method of claim 1, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a multiple-finger touch input on the external device, displaying a visual indicator for the duration of the multiple-finger touch input.

8. The method of claim 7, wherein the visual indicator is an image.

9. The method of claim 7, wherein the visual indicator is an animated image.

10. The method of claim 7, wherein the visual indicator is an animated image of a pulsing heart.

11. The method of claim 7, further comprising:

providing haptic output while displaying the visual indicator.

12. The method of claim 1, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a double-tap on the external device;

displaying an identification of a user associated with the external device; and

providing a haptic output while displaying the identification.

13. The method of claim 1, wherein playing back the received data further comprises:

in accordance with a determination that the user input is an audio recording recorded using a microphone of the external device, playing the audio recording.

14. The method of claim 1, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a swipe contact on the external device representing a stroke, displaying a visual representation of the stroke.

15. The method of claim 14, further comprising:

fading out the stroke after a predetermined duration of time.

16. The method of claim 1, wherein the user input received over the duration of time at the external device includes a speed;

and wherein playing back the received data further comprises;

playing back the received data according to the speed of the user input.

17. The method of claim 1, wherein the user input received over the duration of time at the external device includes a velocity;

and wherein playing back the received data further comprises;

playing back the received data according to the velocity of the user input.

18. An electronic device configured to communicate with an external device, comprising:

a touch-sensitive display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

receiving data from the external device representing user input received over a duration of time at the external device, the data including kinematic information;

determining whether the electronic device is actively executing an application for playback;

in accordance with a determination that the electronic device is actively executing an application for playback, playing back the received data on the electronic device according to the kinematic information, wherein a duration of playback of the received data on the electronic device is determined based on the duration of time of the user input received at the external device; and

in accordance with a determination that the electronic device is not actively executing an application for playback;

displaying an indication of the receiving of the data; and

displaying an affordance, wherein the affordance when selected launches the application for playback and causes the electronic device to playback the received data on the electronic device according to the kinematic information, wherein a duration of playback of the received data on the electronic device is determined based on the duration of time of the user input received at the external device.

19. The electronic device of claim 18, wherein the one or more programs further include instructions for:

in accordance with a determination that the electronic device is not actively executing the application for playback, providing haptic output in response to receiving the data.

20. The electronic device of claim 18, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a single-finger touch input on the external device, displaying a visual representation of the single-finger touch input on a screen of the electronic device corresponding to a position on the external device where the single-finger touch input was detected.

21. The electronic device of claim 20, wherein the visual representation comprises one or more circles, ellipses, and/or ovals.

22. The electronic device of claim 20, wherein the visual representation comprises two or more concentric circles, ellipses, and/or ovals.

23. The electronic device of claim 20, wherein the one or more programs further include instructions for:

fading out the visual representation after a predetermined amount of time.

24. The electronic device of claim 18, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a multiple-finger touch input on the external device, displaying a visual indicator for the duration of the multiple-finger touch input.

25. The electronic device of claim 24, wherein the visual indicator is an image.

26. The electronic device of claim 24, wherein the visual indicator is an animated image.

27. The electronic device of claim 24, wherein the visual indicator is an animated image of a pulsing heart.

28. The electronic device of claim 24, wherein the one or more programs further include instructions for:

providing haptic output while displaying the visual indicator.

29. The electronic device of claim 18, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a double-tap on the external device;

displaying an identification of a user associated with the external device; and

providing a haptic output while displaying the identification.

30. The electronic device of claim 18, wherein playing back the received data further comprises:

in accordance with a determination that the user input is an audio recording recorded using a microphone of the external device, playing the audio recording.

31. The electronic device of claim 18, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a swipe contact on the external device representing a stroke, displaying a visual representation of the stroke.

32. The electronic device of claim 31, wherein the one or more programs further include instructions for:

fading out the stroke after a predetermined duration of time.

33. The electronic device of claim 18, wherein the user input received over the duration of time at the external device includes a speed;

and wherein playing back the received data further comprises;

playing back the received data according to the speed of the user input.

34. The electronic device of claim 18, wherein the user input received over the duration of time at the external device includes a velocity;

and wherein playing back the received data further comprises;

playing back the received data according to the velocity of the user input.

35. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a touch-sensitive display and configured to communicate with an external device, the one or more programs including instructions for:

receiving data from the external device representing user input received over a duration of time at the external device, the data including kinematic information;

determining whether the electronic device is actively executing an application for playback;

in accordance with a determination that the electronic device is actively executing an application for playback, playing back the received data on the electronic device according to the kinematic information, wherein a duration of playback of the received data on the electronic device is determined based on the duration of time of the user input received at the external device; and

in accordance with a determination that the electronic device is not actively executing an application for playback;

displaying an indication of the receiving of the data; and

displaying an affordance, wherein the affordance when selected launches the application for playback and causes the electronic device to playback the received data on the electronic device according to the kinematic information, wherein a duration of playback of the received data on the electronic device is determined based on the duration of time of the user input received at the external device.

36. The non-transitory computer-readable storage medium of claim 35, wherein the one or more programs further include instructions for:

in accordance with a determination that the electronic device is not actively executing the application for playback, providing haptic output in response to receiving the data.

37. The non-transitory computer-readable storage medium of claim 35, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a single-finger touch input on the external device, displaying a visual representation of the single-finger touch input on a screen of the electronic device corresponding to a position on the external device where the single-finger touch input was detected.

38. The non-transitory computer-readable storage medium of claim 37, wherein the visual representation comprises one or more circles, ellipses, and/or ovals.

39. The non-transitory computer-readable storage medium of claim 37, wherein the visual representation comprises two or more concentric circles, ellipses, and/or ovals.

40. The non-transitory computer-readable storage medium of claim 37, wherein the one or more programs further include instructions for:

fading out the visual representation after a predetermined amount of time.

41. The non-transitory computer-readable storage medium of claim 35, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a multiple-finger touch input on the external device, displaying a visual indicator for the duration of the multiple-finger touch input.

42. The non-transitory computer-readable storage medium of claim 41, wherein the visual indicator is an image.

43. The non-transitory computer-readable storage medium of claim 41, wherein the visual indicator is an animated image.

44. The non-transitory computer-readable storage medium of claim 41, wherein the visual indicator is an animated image of a pulsing heart.

45. The non-transitory computer-readable storage medium of claim 41, wherein the one or more programs further include instructions for:

providing haptic output while displaying the visual indicator.

46. The non-transitory computer-readable storage medium of claim 35, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a double-tap on the external device;

displaying an identification of a user associated with the external device; and

providing a haptic output while displaying the identification.

47. The non-transitory computer-readable storage medium of claim 35, wherein playing back the received data further comprises:

in accordance with a determination that the user input is an audio recording recorded using a microphone of the external device, playing the audio recording.

48. The non-transitory computer-readable storage medium of claim 35, wherein playing back the received data further comprises:

in accordance with a determination that the user input is a swipe contact on the external device representing a stroke, displaying a visual representation of the stroke.

49. The non-transitory computer-readable storage medium of claim 48, wherein the one or more programs further include instructions for:

fading out the stroke after a predetermined duration of time.

50. The non-transitory computer-readable storage medium of claim 35, wherein the user input received over the duration of time at the external device includes a speed;

and wherein playing back the received data further comprises;

playing back the received data according to the speed of the user input.

51. The non-transitory computer-readable storage medium of claim 35, wherein the user input received over the duration of time at the external device includes a velocity;

and wherein playing back the received data further comprises;

playing back the received data according to the velocity of the user input.