Message user interfaces for capture and transmittal of media and location content

• US 10,416,844 B2
• Filed: 10/30/2015
• Issued: 09/17/2019
• Est. Priority Date: 05/31/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Yang, Lawrence Y., Garcia, Roberto, Wood, Justin, Dellinger, Richard R., Chaudhri, Imran, Lindeman, Kevin J., Macomber, Kyle S.
• Primary Examiner(s): Kujundzic, Dino
• Application Number:
  US14/928,865
• Publication Number:
  US 20160054841A1
• Time in Patent Office: 1,418 Days
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: H04L 51/04 : Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/046 : Interoperability with other network applications or services
• CPC Class Codes: H04L 51/08 : Annexed information, e.g. attachments
• CPC Class Codes: H04L 51/10 : Multimedia information
• CPC Class Codes: H04L 51/222 : using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04L 51/234 : for tracking messages
• CPC Class Codes: H04L 51/42 : Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04M 1/72433 : for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 1/72439 : for image or video messaging
• CPC Class Codes: H04M 1/72454 : according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/52 : including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/633 : for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04W 4/02 : Services making use of location information

Abstract

A device provides user interfaces for capturing and sending media, such as audio, video, or images, from within a messaging application. The device displays a message conversation having a media affordance. Responsive to contact on the media affordance, the device displays a record affordance and a send affordance. Responsive to contact on the record affordance, the device begins to record a video. Responsive to contact on the send affordance, the device sends the recorded video to the participants of the message conversation.

Claims

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to record and send media content, the one or more programs comprising instructions for:

displaying, on the display, a media affordance and a message region for displaying messages sent between participants in a message conversation;

detecting a first input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the media affordance on the display;

in response to detecting the contact;

ceasing to display the media affordance and the message region; and

displaying a record affordance on the display;

detecting a second input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the record affordance on the display;

in response to detecting the second input, recording at least a portion of media content that includes visual media;

after recording the media content that includes the visual media, concurrently displaying a representation of the media content and a send affordance on the display without displaying the message region;

while the representation of the media content and the send affordance are concurrently displayed on the display without displaying the message region, detecting a third input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the send affordance on the display; and

in response to detecting the third input;

sending the media content to a participant, and

removing the send affordance from the display.

2. The non-transitory computer-readable storage medium according to claim 1, wherein the first input, the second input, and the third input are three separate contacts on the touch-sensitive surface.

3. The non-transitory computer-readable storage medium according to claim 1, wherein the first input is a contact on the touch-sensitive surface, and wherein the second input is a continuation of the contact on the touch-sensitive surface comprising movement of the contact from a location on the touch-sensitive surface corresponding to the location of the media affordance on the display to a location on the touch-sensitive surface corresponding to the location of the record affordance on the display.

4. The non-transitory computer-readable storage medium according to claim 3, wherein the first input on the touch-sensitive surface is at a first location on the touch-sensitive surface and the second input on the touch-sensitive surface is at a second location on the touch sensitive surface, and wherein the first location is different from the second location.

5. The non-transitory computer-readable storage medium according to claim 1, wherein the first input is a contact on the touch-sensitive surface, and wherein the second input is a separate contact on the touch-sensitive surface, and wherein the third input is a continuation of the separate contact on the touch-sensitive surface comprising movement of the contact from a location on the touch-sensitive surface corresponding to the location of the record affordance on the display to a location on the touch-sensitive surface corresponding to the location of the send affordance on the display.

6. The non-transitory computer-readable storage medium according to claim 1, wherein the one or more programs further comprise instructions for:

in response to detecting the third input, inserting a thumbnail representation of the media content into the displayed message conversation.

7. The non-transitory computer-readable storage medium according to claim 6, wherein the one or more programs further comprises instructions for:

displaying a bounded message area in the message conversation;

displaying a playback affordance in the bounded message area;

detecting a fourth input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the playback affordance on the display, and

in response to detecting the fourth input, displaying the media content within the boundaries of the bounded message area.

8. The non-transitory computer-readable storage medium according to claim 1, wherein the one or more programs further comprise instructions for:

while recording the media content, detecting a lift-off of the second contact; and

continuing to record the media content after the lift-off.

9. The non-transitory computer-readable storage medium according to claim 1, wherein the one or more programs further comprise instructions for:

while recording the media content, detecting a lift-off of the second contact; and

in response to detecting the lift-off, ceasing to record the media content.

10. The non-transitory computer-readable storage medium according to claim 9, wherein the one or more programs further comprise instructions for:

in response to detecting the lift-off, replacing the display of the record affordance with a display of a playback affordance for displaying the media content, the media content not yet sent to the participant.

11. The non-transitory computer-readable storage medium according to claim 1, wherein the one or more programs further comprise instructions for:

while recording the media content, displaying an indication of the length, in time, of the media content.

12. The non-transitory computer-readable storage medium according to claim 1, wherein the media content that is sent to the participant expires based on expiration criteria.

13. The non-transitory computer-readable storage medium according to claim 1, wherein the electronic device includes a camera sensor, and wherein the one or more programs further comprise instructions for:

subsequent to detecting the contact at the location on the touch-sensitive surface corresponding to a location of the media affordance, and prior to recording the at least portion of media content that includes visual media;

displaying a live preview of at least a portion of the field of view of the camera sensor of the electronic device.

14. A method, comprising:

at an electronic device with a touch-sensitive surface and a display;

displaying, on the display, a media affordance and a message region for displaying messages sent between participants in a message conversation;

detecting a first input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the media affordance on the display;

in response to detecting the contact;

ceasing to display the media affordance and the message region; and

displaying a record affordance on the display;

detecting a second input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the record affordance on the display;

in response to detecting the second input, recording at least a portion of media content that includes visual media;

after recording the media content that includes the visual media, concurrently displaying a representation of the media content and a send affordance on the display without displaying the message region;

while the representation of the media content and the send affordance are concurrently displayed on the display without displaying the message region, detecting a third input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the send affordance on the display; and

in response to detecting the third input;

sending the media content to a participant, and

removing the send affordance from the display.

15. The method according to claim 14, wherein the first input, the second input, and the third input are three separate contacts on the touch-sensitive surface.

16. The method according to claim 14, wherein the first input is a contact on the touch-sensitive surface, and wherein the second input is a continuation of the contact on the touch-sensitive surface comprising movement of the contact from a location on the touch-sensitive surface corresponding to the location of the media affordance on the display to a location on the touch-sensitive surface corresponding to the location of the record affordance on the display.

17. The method according to claim 16, wherein the first input on the touch-sensitive surface is at a first location on the touch-sensitive surface and the second input on the touch-sensitive surface is at a second location on the touch sensitive surface, and wherein the first location is different from the second location.

18. The method according to claim 14, wherein the first input is a contact on the touch-sensitive surface, and wherein the second input is a separate contact on the touch-sensitive surface, and wherein the third input is a continuation of the separate contact on the touch-sensitive surface comprising movement of the contact from a location on the touch-sensitive surface corresponding to the location of the record affordance on the display to a location on the touch-sensitive surface corresponding to the location of the send affordance on the display.

19. The method according to claim 14, further comprising:

in response to detecting the third input, inserting a thumbnail representation of the media content into the displayed message conversation.

20. The method according to claim 19, further comprising:

displaying a bounded message area in the message conversation;

displaying a playback affordance in the bounded message area;

detecting a fourth input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the playback affordance on the display, and

in response to detecting the fourth input, displaying the media content within the boundaries of the bounded message area.

21. The method according to claim 14, further comprising:

while recording the media content, detecting a lift-off of the second contact; and

continuing to record the media content after the lift-off.

22. The method according to claim 14, further comprising:

while recording the media content, detecting a lift-off of the second contact; and

in response to detecting the lift-off, ceasing to record the media content.

23. The method according to claim 22, further comprising:

in response to detecting the lift-off, replacing the display of the record affordance with a display of a playback affordance for displaying the media content, the media content not yet sent to the participant.

24. The method according to claim 14, further comprising:

while recording the media content, displaying an indication of the length, in time, of the media content.

25. The method according to claim 14, wherein the media content that is sent to the participant expires based on expiration criteria.

26. The method according to claim 14, wherein the electronic device includes a camera sensor, the method further comprising:

subsequent to detecting the contact at the location on the touch-sensitive surface corresponding to a location of the media affordance, and prior to recording the at least portion of media content that includes visual media;

displaying a live preview of at least a portion of the field of view of the camera sensor of the electronic device.

27. An electronic device, comprising:

a display;

a touch-sensitive surface;

a memory; and

a processor coupled to the display, the touch-sensitive surface, and the memory, the processor configured to;

display, on the display, a media affordance and a message region for displaying messages sent between participants in a message conversation;

detect a first input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the media affordance on the display;

in response to detecting the contact;

cease to display the media affordance and the message region; and

display a record affordance on the display;

detect a second input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the record affordance on the display;

in response to detecting the second input, record at least a portion of media content that includes visual media;

after recording the media content that includes the visual media, concurrently display a representation of the media content and a send affordance on the display without displaying the message region;

while the representation of the media content and the send affordance are concurrently displayed on the display without displaying the message region, detect a third input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the send affordance on the display; and

in response to detecting the third input;

send the media content to a participant, and

remove the send affordance from the display.

28. The electronic device according to claim 27, wherein the first input, the second input, and the third input are three separate contacts on the touch-sensitive surface.

29. The electronic device according to claim 27, wherein the first input is a contact on the touch-sensitive surface, and wherein the second input is a continuation of the contact on the touch-sensitive surface comprising movement of the contact from a location on the touch-sensitive surface corresponding to the location of the media affordance on the display to a location on the touch-sensitive surface corresponding to the location of the record affordance on the display.

30. The electronic device according to claim 29, wherein the first input on the touch-sensitive surface is at a first location on the touch-sensitive surface and the second input on the touch-sensitive surface is at a second location on the touch sensitive surface, and wherein the first location is different from the second location.

31. The electronic device according to claim 27, wherein the first input is a contact on the touch-sensitive surface, and wherein the second input is a separate contact on the touch-sensitive surface, and wherein the third input is a continuation of the separate contact on the touch-sensitive surface comprising movement of the contact from a location on the touch-sensitive surface corresponding to the location of the record affordance on the display to a location on the touch-sensitive surface corresponding to the location of the send affordance on the display.

32. The electronic device according to claim 27, wherein the processor is further configured to:

in response to detecting the third input, insert a thumbnail representation of the media content into the displayed message conversation.

33. The electronic device according to claim 32, wherein the processor is further configured to:

display a bounded message area in the message conversation;

display a playback affordance in the bounded message area;

detect a fourth input on the touch-sensitive surface that includes detecting a contact at a location on the touch-sensitive surface corresponding to a location of the playback affordance on the display, and

in response to detecting the fourth input, display the media content within the boundaries of the bounded message area.

34. The electronic device according to claim 27, wherein the processor is further configured to:

while recording the media content, detect a lift-off of the second contact; and

continue to record the media content after the lift-off.

35. The electronic device according to claim 27, wherein the processor is further configured to:

while recording the media content, detect a lift-off of the second contact; and

in response to detecting the lift-off, cease to record the media content.

36. The electronic device according to claim 35, wherein the processor is further configured to:

in response to detecting the lift-off, replace the display of the record affordance with a display of a playback affordance for displaying the media content, the media content not yet sent to the participant.

37. The electronic device according to claim 27, wherein the processor is further configured to:

while recording the media content, display an indication of the length, in time, of the media content.

38. The electronic device according to claim 27, wherein the media content that is sent to the participant expires based on expiration criteria.

39. The electronic device according to claim 27, wherein the electronic device includes a camera sensor, and wherein the processor is further configured to:

subsequent to detecting the contact at the location on the touch-sensitive surface corresponding to a location of the media affordance, and prior to recording the at least portion of media content that includes visual media;

display a live preview of at least a portion of the field of view of the camera sensor of the electronic device.