Devices, Methods, and Graphical User Interfaces for Messaging

• US 20170336960A1
• Filed: 09/21/2016
• Published: 11/23/2017
• Est. Priority Date: 05/18/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Chaudhri, Imran A., Anzures, Freddy A., Dellinger, Richard R., Griffin, Bradley W., Jon, Tiffany S., Karunamuni, Chanaka G., King, Nicholas V., Mohseni, Daamun, Pham, Hoan, Tyler, William M., Wan, Wan Si, Yerkes, Giancarlo
• Granted Patent: US 11,320,982 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 40/197 Version control for software G06F8/71
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04L 51/04 : Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/046 : Interoperability with other network applications or services
• CPC Class Codes: H04L 51/18 : Commands or executable codes
• CPC Class Codes: H04L 51/216 : Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/42 : Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04M 1/7243 : with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72436 : for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2250/22 : including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters

Abstract

An electronic device displays a messaging user interface on a display, the messaging user interface including a conversation transcript of a messaging session between a user of the electronic device and at least one other user, a keyboard, a message-input area, and a digital image affordance. While displaying the messaging user interface, the device detects an input that activates the digital image affordance. In response, the device replaces display of the keyboard with display of a plurality of digital images, the plurality of digital images including one or more digital images stored in memory and a live preview image from a digital camera. The device detects an input that selects the live image displayed within the plurality of digital images. In response, the device captures a digital image with the digital camera, while maintaining display of the conversation transcript.

Claims

1. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a digital camera, a touch-sensitive surface, and memory, cause the device to:

display a messaging user interface on the display, the messaging user interface including a conversation transcript of a messaging session between a user of the electronic device and at least one other user, a keyboard, a message-input area, and a digital image affordance;

while displaying the messaging user interface, detect an input that activates the digital image affordance;

in response to detecting the input that activates the digital image affordance, replace display of the keyboard with display of a plurality of digital images, the plurality of digital images including one or more digital images stored in the memory and a live preview image from the digital camera;

detect an input that selects the live image displayed within the plurality of digital images; and

,

in response to detecting that input that selects the live image, capture a digital image with the digital camera, while maintaining display of the conversation transcript.

2. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

after capturing the digital image;

display the digital image captured by the digital camera in the conversation transcript, and

transmit a representation of the captured digital image to one or more electronic devices that correspond to the at least one other user included in the messaging session, wherein the one or more electronic devices display the representation of the captured digital image in a conversation transcript that corresponds to the messaging session.

3. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

prior to displaying the digital image captured by the digital camera in the conversation transcript and transmitting a representation of the captured image;

display the digital image captured by the digital camera in the message input area;

while displaying the digital image captured by the digital camera in the message input area, detect an input that activates an image editing mode;

in response to detecting the input that activates the image editing mode, replace display of the messaging user interface with display of a digital photo editing user interface, wherein the digital image captured by the digital camera is displayed in the digital photo editing user interface;

while displaying the digital photo editing mode, detect an input that edits the digital photo captured by the digital camera;

in response to detecting the input that edits the digital photo captured by the digital camera, edit the digital image captured by the digital camera;

after editing the digital image captured by the digital camera, detect an input terminating the digital image editing mode; and

in response to detecting the input terminating the digital image editing mode, display the edited digital image captured by the digital camera in the message input area.

4. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

in response to detecting the input that selects the live preview image, and after capturing the digital image, display the digital image in the message-input area;

while displaying the digital image in the message-input area, detect input of a message in the message input area;

after detecting input of the message in the message-input area, detect an input that corresponds to a request to post contents of the message-input area to the messaging session, the contents including the digital image and the message; and

in response to detecting the input that corresponds to the request to post the contents of the message-input area to the messaging session;

display the digital image in the conversation transcript,

display the message in the conversation transcript, wherein the message partially overlaps the digital image in the conversation transcript, and

transmit a representation of the digital image and the message to one or more electronic devices that correspond to the at least one other user included in the messaging session, wherein the one or more electronic devices display the representation of the digital image and the message in a conversation transcript corresponding to the messaging session, wherein the message partially overlaps the representation of the digital image in the conversation transcript corresponding to the messaging session.

5. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

in response to detecting the input that selects the live image;

in accordance with a determination that the input that selects the live image meets one or more input-area-display, display the digital image captured by the digital camera in the message input area, and

in accordance with a determination that the input that selects the live image meets one or more transcript-area-display criteria;

display the digital image captured by the digital camera in the conversation transcript, and

send instructions, to one or more electronic devices that correspond to the at least one other user included in the messaging session, to display the digital image captured by the digital camera in a conversation transcript corresponding to the messaging session.

6. The computer-readable storage medium of claim 5, wherein:

the electronic device includes one or more sensors configured to detect intensities of contacts on the touch-sensitive surface;

detecting the input that selects the live image displayed within the plurality of digital images includes detecting a first contact at a location on the touch-sensitive surface that corresponds to display of the live image on the display;

the one or more transcript-area-display criteria require that a characteristic intensity of the first contact on the touch-sensitive surface meet a respective intensity threshold in order for the transcript-area-display criteria to be met; and

the one or more input-area-display criteria do not require that the characteristic intensity of the contact on the touch-sensitive surface meet the respective intensity threshold in order for the selection criteria to be met.

7. The computer-readable storage medium of claim 6, wherein the one or more input-area-display criteria are met upon detection of a tap gesture on the touch-sensitive surface.

8. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

prior to detecting the input that selects the live image displayed within the plurality of digital images;

detect a first portion of a second input that includes detecting an increase in a characteristic intensity of a second contact, at a location that corresponds to display of a first digital image within the plurality of digital images, above a preview intensity threshold;

in response to detecting the first portion of the second input, increase the size of the first digital image;

after increasing the size of the first digital image, detect a second portion of the second input that includes detecting a decrease in the characteristic intensity of the second contact below the preview intensity threshold; and

in response to detecting the second portion of the second input, decrease the size of the first digital image.

9. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

detect a user input including a first swipe gesture that starts while a focus selector is at a first location in the messaging user interface that corresponds to a first digital image in the plurality of digital images, the first swipe gesture moving the focus selector in a first direction;

in response to detecting the first swipe gesture, scroll display of the plurality of digital images in the first direction on the display, wherein the scrolling display includes ceasing to display digital images in the plurality of digital images that are scrolled off a first edge of the display and displaying new digital images in the plurality of digital images from a second edge of the display.

10. The computer-readable storage medium of claim 1, the programs further comprising instructions that cause the device to:

detect a user input including a second swipe gesture that starts while a focus selector is at a first location in the messaging user interface that corresponds to a first digital image in the plurality of digital images, the first swipe gesture moving the focus selector in a second direction;

in response to detecting the second swipe gesture, display a first affordance for the digital camera and a second affordance for a photo library.

11. The computer-readable storage medium of claim 10, the programs further comprising instructions that cause the device to:

while displaying the first affordance for the digital camera;

detect an input that activates the first affordance for the digital camera; and

in response to detecting the input that activates the first affordance for the digital camera, display a user interface for the digital camera over at least a portion of the messaging user interface.

12. The computer-readable storage medium of claim 10, the programs further comprising instructions that cause the device to:

while displaying the second affordance for the photo library;

detect an input that activates the second affordance for the photo library; and

in response to detecting the input that activates the second affordance for the photo library;

cease to display the plurality of digital images including one or more digital images stored in the memory and a live preview image from the digital camera and

display a plurality of digital images from a digital photo library; and

while displaying the plurality of digital images from the digital photo library;

detect an input that selects a digital image in the plurality of digital images from the digital photo library; and

in response to detecting the input that selects the digital image from the digital photo library;

display the digital image from the digital photo library in the conversation transcript, and

transmit a representation of the digital image from the digital photo library to one or more electronic devices that correspond to the at least one other user included in the messaging session, wherein the one or more electronic devices display the representation of the digital image from the digital photo library in a conversation transcript that corresponds to the messaging session.

13. The computer-readable storage medium of claim 10, wherein the one or more digital images stored in the memory, and displayed in response to detecting the input that activates the digital image affordance, consist of digital images captured during the messaging session.

14. A method, comprising:

at an electronic device having one or more processors, memory, a touch-sensitive surface, a digital camera, and a display;

displaying a messaging user interface on the display, the messaging user interface including a conversation transcript of a messaging session between a user of the electronic device and at least one other user, a keyboard, a message-input area, and a digital image affordance;

while displaying the messaging user interface, detecting an input that activates the digital image affordance;

in response to detecting the input that activates the digital image affordance, replacing display of the keyboard with display of a plurality of digital images, the plurality of digital images including one or more digital images stored in the memory and a live preview image from the digital camera;

detecting an input that selects the live image displayed within the plurality of digital images; and

,

in response to detecting that input that selects the live image, capturing a digital image with the digital camera, while maintaining display of the conversation transcript.

15. An electronic device, comprising:

a display;

a touch-sensitive surface;

a digital camera;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a messaging user interface on the display, the messaging user interface including a conversation transcript of a messaging session between a user of the electronic device and at least one other user, a keyboard, a message-input area, and a digital image affordance;

while displaying the messaging user interface, detecting an input that activates the digital image affordance;

in response to detecting the input that activates the digital image affordance, replacing display of the keyboard with display of a plurality of digital images, the plurality of digital images including one or more digital images stored in the memory and a live preview image from the digital camera;

detecting an input that selects the live image displayed within the plurality of digital images; and

,

in response to detecting that input that selects the live image, capturing a digital image with the digital camera, while maintaining display of the conversation transcript.