Voice communications with real-time status notifications

• US 9,419,935 B2
• Filed: 08/02/2013
• Issued: 08/16/2016
• Est. Priority Date: 08/02/2013
• Status: Active Grant

• Current Assignee: WhatsApp LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: WhatsApp LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Koum, Jan, Donohue, Michael B., Acton, Brian, Reed, Erik James, Stukalov, Dima
• Primary Examiner(s): Lowenberger, Aaron
• Application Number:
  US13/958,417
• Publication Number:
  US 20150040029A1
• Time in Patent Office: 1,110 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04W 4/06 Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
• CPC Class Codes: H04W 4/20 Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

A system, apparatus, graphical user interface and methods are provided for conducting electronic voice communications with status notifications. A user of a first portable device executing a communication application selects a multi-function control that automatically initiates an audio recording, which is automatically sent toward another participant of an active communication session when the control is released. The same multi-function control may be used to transmit a textual message. A representation of the recording is displayed on the user'"'"'s device, with an indicator that changes appearance when the other participant plays the recording. In addition, when one user initiates an audio recording that will be automatically sent to another user, the other user'"'"'s device is advised of the initiation of recording and displays that status for the other user.

Claims

1. An apparatus comprising:

a touch-screen display,

a microphone,

a memory and

one or more processors to execute one or more programs stored in the memory, to generate a graphical user interface comprising;

a conversation region displayed on the touch-screen display and populated with communications of a first conversation between the portable device and another device as the communications occur;

a selectable control displayed on the touch-screen display;

a header region that identifies an operator of the other device, and displays a status of a third device to indicate recording of audio when a new audio recording addressed to the portable device commences on the third device while the first conversation is displayed, wherein the third device is not a part of the first conversation;

wherein selection of the control in a first context commences creation of an audio recording and de-selection of the control initiates transmission of the audio recording toward the other device; and

wherein selection of the control in a second context initiates transmission of a textual message toward the other device.

2. The apparatus of claim 1, the graphical user interface further comprising:

a text entry window for composing the textual message;

wherein a form of the control changes automatically when text is entered in the text entry window.

3. The apparatus of claim 1, the graphical user interface further comprising a text entry window;

wherein the first context is characterized by absence of text in the text entry window; and

wherein the second context is characterized by presence of text in the text entry window.

4. The apparatus of claim 1, wherein:

selection of the control comprises pressing on the control; and

de-selection of the control comprises release of the control.

5. The apparatus of claim 1, wherein:

selection of the control for at least a predetermined duration of time causes recording of audio and further causes automatic transmission of the audio recording upon de-selection of the control; and

selection of the control for less than the predetermined duration of time causes automatic transmission of the textual message upon de-selection of the control.

6. The apparatus of claim 5, wherein the textual message was entered via a text entry window of the graphical user interface prior to said selection of the control for less than the predetermined duration of time.

7. The apparatus of claim 1, the graphical user interface further comprising, after transmission of the audio recording toward the other device:

in the conversation region, a representation of the audio recording;

wherein the representation has a first form prior to playing of the audio recording on the other device; and

wherein the representation has a second form after the audio recording is played on the other device.

8. The apparatus of claim 7, wherein the representation changes from the first form to the second form prior to completion of the playing of the audio recording on the other device.

9. The apparatus of claim 1, the graphical user interface further comprising:

a status field configured to display a status of the other device;

wherein the status changes to indicate recording of audio when a new audio recording addressed to the portable device commences on the other device.

10. The apparatus of claim 1, the graphical user interface further comprising:

during selection of the control in the first context, a visual alert regarding cancellation of the audio recording;

wherein movement away from the control during said selection of the control causes the audio recording to be cancelled.

11. A method, comprising:

at a portable device having a touch-screen display;

displaying on the touch-screen display a conversation region populated with communications of a first conversation between an operator of the device and an operator of another device;

displaying on the touch screen display a header region that identifies an operator of the other device, and displays a status of a third device to indicate recording of audio when a new audio recording addressed to the portable device commences on the third device while the conversation is displayed, wherein the third device is not a part of the conversation;

displaying a selectable control on the touch-screen display;

upon selection of the control in a first context commencing creation of the audio recording, and automatically transmitting the audio recording toward the other device upon de-selection of the control; and

upon selection of the control in a second context, initiating transmission of a textual message toward the other device.

12. The method of claim 11, wherein the conversation region is initially devoid of communications and is populated with communications between the operator of the device and the operator of the other device as the communications occur.

13. The method of claim 11, wherein the conversation region comprises one or more communications between the operator of the portable device and the operator of another device.

14. The method of claim 11, wherein:

the portable device further includes a microphone; and

initiating transmission of an audio recording toward the other device comprises;

activating the microphone to record the audio recording.

15. The method of claim 14, further comprising after transmitting the audio recording:

displaying in the conversation region a representation of the audio recording, wherein the representation includes a first feature indicating that the audio recording has not been played on the other device.

16. The method of claim 15, further comprising, after displaying the representation:

receiving a notification that playing of the audio recording commenced on the other device; and

altering the first feature to indicate that at least a portion of the audio recording has been played on the other device.

17. The method of claim 11, wherein initiating transmission of a textual message toward the other device comprises:

transmitting the textual message toward the other device upon de-selection of the control.

18. The method of claim 17, further comprising, prior to said transmitting:

displaying a text entry window on the touch-screen display; and

entering text in the text entry window corresponding to manipulation of device controls by the operator of the device.

19. The method of claim 18, further comprising, prior to said transmitting:

altering an appearance of the selectable control upon entry of the text in the text entry window.

20. The method of claim 11, wherein:

in the first context, no text has been entered in a text entry window displayed on the touch-screen display; and

in the second context, text has been entered in the text entry window.

21. The method of claim 11, further comprising:

displaying on the touch-screen display a status field configured to indicate a status of the other device;

wherein the status changes to indicate recording of audio when a new audio recording commences on the other device.

22. The method of claim 11, further comprising:

receiving a new recording from the other device;

commencing playback of the new recording via a first output component of the device in response to manipulation of a play control by the operator of the device; and

in response to detecting proximity of the operator of the device, switching playback of the new recording to a second output component.

23. The method of claim 11, further comprising, during selection of the control in the first context:

displaying on the touch-screen display, proximate to the control, a visual alert regarding cancellation of the audio recording.

24. The method of claim 23, further comprising, during selection of the control in the first context:

cancelling the audio recording in response to detection of movement away from the control in a direction of the alert.

25. A non-transitory computer-readable medium storing instructions that, when executed by a portable device having a touch-screen display, cause the device to:

display, on the touch-screen display, a conversation region populated with communications of a first conversation between an operator of the device and an operator of another device;

display, on the touch screen display, a header region that identifies an operator of the other device, and displays a status of a third device to indicate recording of audio when a new audio recording addressed to the portable device commences on the third device while the conversation is displayed, wherein the third device is not a part of the conversation;

display a selectable control on the touch-screen display;

upon selection of the control in a first context, commence creation of an audio recording, and upon de-selection of the control, initiate transmission of the audio recording toward the other device; and

upon selection of the control in a second context, initiate transmission of a textual message toward the other device.

26. A method of operating a portable device having a touch-screen display and a microphone, the method comprising:

displaying a conversation region on the touch-screen display, the conversation region being populated with communications of a first conversation between an operator of the portable device and an operator of another device as the communications occur;

displaying a text entry window on the touch-screen display;

displaying on the touch screen display a header region that identifies an operator of the other device, and displays a status of a third device to indicate recording of audio when a new audio recording addressed to the portable device commences on the third device while the first conversation is displayed, wherein the third device is not a part of the first conversation;

displaying a selectable control on the touch-screen display; and

upon selection of the selectable control;

if the control is selected for a predetermined duration of time ending at a first time;

commencing recording of audio with the microphone; and

transmitting the audio recording toward the other device upon de-selection of the control; and

if the control is selected for less than the predetermined duration of time, transmitting a textual message previously composed in the text entry window toward the other device.

27. A portable device, comprising:

a touch-screen display;

one or more processors; and

a memory storing instructions configured for execution by the one or more processors to;

display on the touch-screen display communications of a first conversation between an operator of the device and an operator of another device;

display on the touch screen display a header region that identifies an operator of the other device, and displays a status of a third device to indicate recording of audio when a new audio recording addressed to the portable device commences on the third device while the conversation is displayed, wherein the third device is not a part of the conversation;

display a selectable control on the touch-screen display;

upon selection of the control in a first context, commence creation of an audio recording, and upon de-selection of the control, initiate transmission of an audio recording toward the other device; and

upon selection of the control in a second context, initiate transmission of a textual message toward the other device.

28. The device of claim 27, further comprising a microphone.

29. The device of claim 27, further comprising instructions configured for execution by the one or more processors to:

display a text entry window for composing the textual message;

wherein a form of the control changes when text is entered in the text entry window.

30. The device of claim 27, further comprising instructions configured for execution by the one or more processors to:

display a text entry window on the touch-screen display;

wherein the first context includes absence of text in the text entry window; and

wherein the second context includes text in the text entry window.

31. The device of claim 27, wherein:

selection of the control for at least a predetermined duration of time causes recording of audio and further causes automatic transmission of the audio recording upon de-selection of the control; and

selection of the control for less than the predetermined duration of time causes automatic transmission of the textual message upon de-selection of the control.

32. The device of claim 27, further comprising instructions configured for execution by the one or more processors to:

display a representation of the audio recording;

wherein the representation has a first form prior to playing of the audio recording on the other device; and

wherein the representation has a second form after the audio recording is played on the other device.

33. The device of claim 27, further comprising instructions configured for execution by the one or more processors to:

display on the touch-screen display a status field configured to indicate a status of the other device;

wherein the status changes to indicate recording of audio when a new audio recording commences on the other device.

34. The device of claim 27, further comprising instructions configured for execution by the one or more processors to:

display on the touch-screen display, during selection of the control in the first context, a visual alert regarding cancellation of the audio recording;

wherein movement away from the control during said selection of the control causes the audio recording to be cancelled.