Message user interfaces for capture and transmittal of media and location content

• US 9,207,835 B1
• Filed: 09/30/2014
• Issued: 12/08/2015
• Est. Priority Date: 05/31/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Yang, Lawrence Y., Garcia, Roberto, Wood, Justin, Kandangath, Anil K., Macomber, Kyle S., Lee, Woo-Ram, Tu, Xiaoyuan, Morales Viv, scar
• Primary Examiner(s): Kujundzic, Dino
• Application Number:
  US14/503,386
• Publication Number:
  US 20150346912A1
• Time in Patent Office: 434 Days
• Field of Search: 715/727
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: H04L 51/04 : Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/046 : Interoperability with other network applications or services
• CPC Class Codes: H04L 51/08 : Annexed information, e.g. attachments
• CPC Class Codes: H04L 51/10 : Multimedia information
• CPC Class Codes: H04L 51/222 : using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04L 51/234 : for tracking messages
• CPC Class Codes: H04L 51/42 : Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04M 1/72433 : for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 1/72439 : for image or video messaging
• CPC Class Codes: H04M 1/72454 : according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/52 : including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/633 : for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04W 4/02 : Services making use of location information

Abstract

A device provides user interfaces for capturing and sending media, such as audio, video, or images, from within a message application. The device detects a movement of the device and in response, plays or records an audio message. The device detects a movement of the device and in response, sends a recorded audio message. The device removes messages from a conversation based on expiration criteria. The device shares a location with one or more message participants in a conversation.

Claims

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, cause the electronic device to:

display, on the display, a representation of a first audio message in an audio format received from a first participant in a message conversation;

detect a request to play the first audio message;

in response to detecting the request, play the first audio message;

after playing the first audio message, detect a raising of the electronic device;

in response to detecting the raising of the electronic device while a criterion based on the first audio message is met, record a second audio message in an audio format for the message conversation; and

after recording the second audio message in an audio format, send the second audio message in an audio format to the first participant in the message conversation.

2. The non-transitory computer-readable storage medium according to claim 1, further comprising instructions to cause the electronic device to:

while recording the second audio message in an audio format, detect a lowering of the electronic device, and in response to detecting the lowering of the electronic device;

cease to record the second audio message in an audio format, and

send the recorded second audio message in an audio format to the first participant.

3. The non-transitory computer-readable storage medium according to claim 1, wherein the instructions to cause the electronic device to detect the request to play the first audio message comprise instructions to cause the electronic device to:

detect a separate raising of the electronic device while the representation of the first audio message in an audio format is displayed.

4. The non-transitory computer-readable storage medium according to claim 3, wherein the instructions to record the second audio message in an audio format for the message conversation comprises instructions to cause the electronic device to:

record the second audio message in an audio format for the message conversation, further in response to detecting a lowering of the electronic device after playing the first audio message and prior to detecting the separate raising of the electronic device.

5. The non-transitory computer-readable storage medium according to claim 1, wherein the instructions to cause the electronic device to detect the request to play the first audio message comprise instructions to cause the electronic device to:

detect a contact at a location on a touch-sensitive surface that corresponds to the location of the displayed representation of the first audio message in an audio format.

6. The non-transitory computer-readable storage medium according to claim 1, further comprising instructions to cause the electronic device to, after playing the first audio message, and prior to recording the second audio message in an audio format:

display, on the display, an affordance indicating the received first audio message in an audio format;

detect a swipe gesture on the displayed affordance; and

in response to detecting the swipe gesture, display an instruction instructing a user to raise the electronic device to record the second audio message.

7. The non-transitory computer-readable storage medium according to claim 6, wherein the affordance indicating the received first audio message is displayed on a lock screen.

8. The non-transitory computer-readable storage medium according to claim 7, further comprising instructions to cause the electronic device to:

in response to detecting the swipe gesture;

display, on the display, a reply affordance for replying to the received first audio message,

detect a selection of the reply affordance on the display, and

in response to detecting the selection of the reply affordance, display the instruction instructing the user to raise the electronic device to record the second audio message in an audio format.

9. The non-transitory computer-readable storage medium according to claim 6:

wherein the instructions to cause the electronic device to display an instruction instructing a user to raise the electronic device to record the second audio message in an audio format comprise instructions to cause the electronic device to display the instruction in a message compose field, and

the non-transitory computer-readable storage medium further comprises instructions to cause the electronic device to;

display a media affordance on the display;

detect a contact at a location on the touch-sensitive surface that corresponds to a location of the media affordance on the display;

in response to detecting the contact, record a second audio message in an audio format; and

after recording the second audio message in an audio format, send the second audio message in an audio format to the first participant.

10. The non-transitory computer-readable storage medium according to claim 9, further comprising instructions to cause the electronic device to:

detect a contact at a location on the touch-sensitive surface that corresponds to a location of the message entry field on the display; and

in response to detecting the contact at the location on the touch-sensitive surface that corresponds to the location of the message entry field, display a virtual keyboard on the display.

11. The non-transitory computer-readable storage medium according to claim 1, wherein the second audio message in an audio format expires based on an expiration criteria.

12. The non-transitory computer-readable storage medium according to claim 1, further comprising instructions to cause the electronic device to:

display a waveform image representing the first audio message in an audio format; and

change a color of at least a portion of the waveform image in response to detecting the request.

13. The non-transitory computer-readable storage medium according to claim 12, further comprising instructions to cause the electronic device to:

change a color of at least a portion of the waveform image while playing the first audio message, wherein the changed portion corresponds to the portion of the first audio message in an audio format that has been played.

14. The non-transitory computer-readable storage medium according to claim 1, further comprising instructions to cause the electronic device to:

display an indicator indicating whether the first audio message in an audio format has been played.

15. The non-transitory computer-readable storage medium according to claim 1, further comprising instructions to cause the electronic device to:

display a playback affordance,

cause playback of the first audio message upon selection of the playback affordance, and wherein the playback affordance has a color indicating whether the first audio message in an audio format has been played.

16. The non-transitory computer-readable storage medium according to claim 1, wherein:

the criterion based on the first audio message is met if the representation of the first audio message is displayed on the display of the electronic device.

17. The non-transitory computer-readable storage medium according to claim 1, wherein:

the criterion based on the first audio message is met if the first audio message was played by the electronic device within a predetermined time interval.

18. A method, comprising:

at an electronic device with a display;

displaying, on the display, a representation of a first audio message in an audio format received from a first participant in a message conversation;

detecting a request to play the first audio message;

in response to detecting the request, playing the first audio message;

after playing the first audio message, detecting a raising of the electronic device;

in response to detecting the raising of the electronic device while a criterion based on the first audio message is met, recording a second audio message in an audio format for the message conversation; and

after recording the second audio message in an audio format, sending the second in an audio format audio message to the first participant in the message conversation.

19. The method of claim 18, further comprising:

while recording the second audio message in an audio format, detecting a lowering of the electronic device, and in response to detecting the lowering of the electronic device;

ceasing to record the second audio message in an audio format, and

sending the recorded second audio message in an audio format to the first participant.

20. The method of claim 18, wherein detecting the request to play the first audio message comprises:

detecting a separate raising of the electronic device while the representation of the first audio message in an audio format is displayed.

21. The method of claim 20, wherein:

recording the second audio message in an audio format for the message conversation is further in response to detecting a lowering of the electronic device after playing the first audio message and prior to detecting the separate raising of the electronic device.

22. The method according to claim 18, wherein detecting the request to play the first audio message comprises:

detecting a contact at a location on a touch-sensitive surface that corresponds to the location of the displayed representation of the first audio message in an audio format.

23. The method of claim 18, further comprising:

after playing the first audio message, and prior to recording the second audio message in an audio format;

displaying, on the display, an affordance indicating the received first audio message in an audio format;

detecting a swipe gesture on the displayed affordance; and

in response to detecting the swipe gesture, display an instruction instructing a user to raise the electronic device to record the second audio message in an audio format.

24. The method according to claim 23, wherein the affordance indicating the received first audio message is displayed on a lock screen.

25. The method according to claim 24, further comprising:

in response to detecting the swipe gesture;

displaying, on the display, a reply affordance for replying to the received first audio message,

detecting a selection of the reply affordance on the display, and

in response to detecting the selection of the reply affordance, displaying the instruction instructing the user to raise the electronic device to record the second audio message in an audio format.

26. The method according to claim 23:

wherein displaying an instruction instructing a user to raise the electronic device to record the second audio message in an audio format comprises displaying the instruction in a message compose field, and

the method further comprising;

displaying a media affordance on the display;

detecting a contact at a location on the touch-sensitive surface that corresponds to a location of the media affordance on the display;

in response to detecting the contact, recording a second audio message in an audio format; and

after recording the second audio message in an audio format, sending the second audio message in an audio format to the first participant.

27. The method according to claim 26, further comprising:

detecting a contact at a location on the touch-sensitive surface that corresponds to a location of the message entry field on the display; and

in response to detecting the contact at the location on the touch-sensitive surface that corresponds to the location of the message entry field, displaying a virtual keyboard on the display.

28. The method according to claim 18, wherein the second audio message in an audio format expires based on an expiration criteria.

29. The method according to claim 18, further comprising:

displaying a waveform image representing the first audio message in an audio format; and

changing a color of at least a portion of the waveform image in response to detecting the request.

30. The method according to claim 29, further comprising:

changing a color of at least a portion of the waveform image while playing the first audio message, wherein the changed portion corresponds to the portion of the first audio message in an audio format that has been played.

31. The method according to claim 18, further comprising:

displaying an indicator indicating whether the first audio message in an audio format has been played.

32. The method according to claim 18, further comprising:

displaying a playback affordance, causing playback of the first audio message upon selection of the playback affordance, and wherein the playback affordance has a color indicating whether the first audio message in an audio format has been played.

33. The method of claim 18, wherein:

the criterion based on the first audio message is met if the representation of the first audio message is displayed on the display of the the electronic device.

34. The method of claim 18, wherein:

the criterion based on the first audio message is met if the first audio message was played by the electronic device within a predetermined time interval.

35. An electronic device, comprising:

a display;

a memory; and

a processor coupled to the display and the memory, the processor configured to;

display, on the display, a representation of a first audio message in an audio format received from a first participant in a message conversation;

detect a request to play the first audio message;

in response to detecting the request, play the first audio message;

after playing the first audio message, detect a raising of the electronic device;

in response to detecting the raising of the electronic device while a criterion based on the first audio message is met, record a second audio message in an audio format for the message conversation; and

after recording the second audio message in an audio format, send the second audio message in an audio format to the first participant in the message conversation.

36. The electronic device of claim 35, wherein the processor is further configured to:

while recording the second audio message in an audio format, detect a lowering of the electronic device, and in response to detecting the lowering of the electronic device;

cease to record the second audio message in an audio format, and

send the recorded second audio message in an audio format to the first participant.

37. The electronic device of claim 35, wherein detecting the request to play the first audio message comprises:

detecting a separate raising of the electronic device while the representation of the first audio message in an audio format is displayed.

38. The electronic device of claim 37, wherein:

recording the second audio message in an audio format for the message conversation is further in response to detecting a lowering of the electronic device after playing the first audio message and prior to detecting the separate raising of the electronic device.

39. The electronic device according to claim 35, wherein detecting the request to play the first audio message comprises:

detecting a contact at a location on a touch-sensitive surface that corresponds to the location of the displayed representation of the first audio message in an audio format.

40. The electronic device according to claim 35, wherein the processor is further configured to, after playing the first audio message, and prior to recording the second audio message in an audio format:

display, on the display, an affordance indicating the received first audio message in an audio format;

detect a swipe gesture on the displayed affordance; and

in response to detecting the swipe gesture, display an instruction instructing a user to raise the electronic device to record the second audio message.

41. The electronic device according to claim 40, wherein the affordance indicating the received first audio message is displayed on a lock screen.

42. The electronic device according to claim 41, wherein the processor is further configured to:

in response to detecting the swipe gesture;

display, on the display, a reply affordance for replying to the received first audio message,

detect a selection of the reply affordance on the display, and

in response to detecting the selection of the reply affordance, display the instruction instructing the user to raise the electronic device to record the second audio message in an audio format.

43. The electronic device according to claim 40:

wherein the instruction instructing a user to raise the electronic device to record the second audio message in an audio format is displayed in a message compose field, and wherein the processor is further configured to;

display a media affordance on the display;

detect a contact at a location on the touch-sensitive surface that corresponds to a location of the media affordance on the display;

in response to detecting the contact, record a second audio message in an audio format; and

after recording the second audio message in an audio format, send the second audio message in an audio format to the first participant.

44. The electronic device according to claim 43, wherein the processor is further configured to:

detect a contact at a location on the touch-sensitive surface that corresponds to a location of the message entry field on the display; and

in response to detecting the contact at the location on the touch-sensitive surface that corresponds to the location of the message entry field, display a virtual keyboard on the display.

45. The electronic device according to claim 35, wherein the second audio message in an audio format expires based on an expiration criteria.

46. The electronic device according to claim 35, wherein the processor is further configured to:

display a waveform image representing the first audio message in an audio format; and

change a color of at least a portion of the waveform image in response to detecting the request.

47. The electronic device according to claim 46, wherein the processor is further configured to:

change a color of at least a portion of the waveform image while playing the first audio message, wherein the changed portion corresponds to the portion of the first audio message in an audio format that has been played.

48. The electronic device according to claim 35, wherein the processor is further configured to:

display an indicator indicating whether the first audio message in an audio format has been played.

49. The electronic device according to claim 35, wherein the processor is further configured to:

display a playback affordance,

cause playback of the first audio message upon selection of the playback affordance, and

wherein the playback affordance has a color indicating whether the first audio message in an audio format has been played.

50. The method of claim 35, wherein:

the criterion based on the first audio message is met if the first audio message was played within a predetermined time interval.

51. The method of claim 35, wherein:

the criterion based on the first audio message is met if the first audio message was played by the electronic device within a predetermined time interval.