System and Method for Providing Multi-Modal Asynchronous Communication

• US 20140025757A1
• Filed: 07/23/2012
• Published: 01/23/2014
• Est. Priority Date: 07/23/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Haugen, Frances Bordwell, Marra, Gregory Matthew
• Granted Patent: US 9,385,981 B2
• Time in Patent Office: Days
• US Class Current: 709/206
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 65/1016 IP multimedia subsystem [IMS]
• CPC Class Codes: H04M 7/0048 where the text-based messaging service is a Short Message Service
• CPC Class Codes: H04W 84/045 using private Base Stations, e.g. femto Base Stations, home Node B

Abstract

Embodiments include receiving a first synchronous communication message in a first modality from a first user device. The method may further include generating a first asynchronous communication message in a second modality, based at least in part on the first synchronous communication message in the first modality, wherein the first modality differs from the second modality. The method may also include receiving a second asynchronous communication message in the second modality from a second user device. The method may further include generating a second asynchronous communication message in the first modality based at least in part on the second synchronous communication message in the second modality. The method may also include providing for display to the first user device, the second asynchronous message in the first modality. The method may further include providing for display to the second user device, the first asynchronous message in the second modality.

Claims

1. A computer-implemented method comprising:

receiving, using one or more computing devices, a first synchronous communication message in a first modality from a first user device;

generating, using the one or more computing devices, a first asynchronous communication message in a second modality, based at least in part on the first synchronous communication message in the first modality, wherein the first modality differs from the second modality;

receiving, using the using one or more computing devices, a second asynchronous communication message in the second modality from a second user device;

generating, using the one or more computing devices, a second synchronous communication message in the first modality based at least in part on the second asynchronous communication message in the second modality;

providing for display, using the one or more computing devices, to the first user device, the second synchronous message in the first modality; and

providing for display, using the one or more computing devices, to the second user device, the first asynchronous message in the second modality.

2. The computer-implemented method of claim 1, wherein the first user device and the second user device are coupled to an electronic communication session.

3. The computer-implemented method of claim 1, wherein the first modality is at least one of video-based and audio-based.

4. The computer-implemented method of claim 1, wherein the second modality is text-based.

5. The computer-implemented method of claim 1, further comprising:

receiving, at the one or more computing devices, at least one of a second synchronous communication message and a second asynchronous communication message.

6. The computer-implemented method of claim 2, further comprising:

transmitting, at the one or more computing devices, instructions configured to generate a display of at least one of synchronous communication message, the asynchronous communication message, the second synchronous communication message and the second asynchronous communication message.

7. The computer-implemented method of claim 1, further comprising:

converting, at the one or more computing devices, the received asynchronous communication message to an audio message.

8. The computer-implemented method of claim 7, further comprising:

transmitting, at the one or more computing devices, one or more instructions configured to output the audio message at the electronic communication session.

9. The computer-implemented method of claim 1, further comprising:

converting, at the one or more computing devices, at least one of a voice-based synchronous communication message and an audio-based synchronous communication message to a text-based message.

10. The computer-implemented method of claim 9, wherein the text-based message is included within a display associated with the electronic communication session.

11. The computer-implemented method of claim 1, further comprising:

storing at least one of the synchronous communication message and the asynchronous communication message.

12. The computer-implemented method of claim 1, further comprising:

transmitting, at the computing device, one or more instructions configured to display a static avatar corresponding to at least one participant of the electronic communication session.

13. The computer-implemented method of claim 1, wherein the electronic communication session is at least one of a web-based session configured to allow video-chat and a text messaging session.

14. A non-transitory processor readable storage medium having a plurality of instructions stored thereon that when executed by a processor, cause the processor to perform operations comprising:

receiving, using one or more computing devices, a first synchronous communication message in a first modality from a first user device;

generating, using the one or more computing devices, a first asynchronous communication message in a second modality, based at least in part on the first synchronous communication message in the first modality, wherein the first modality differs from the second modality;

receiving, using the using one or more computing devices, a second asynchronous communication message in the second modality from a second user device;

generating, using the one or more computing devices, a second synchronous communication message in the first modality based at least in part on the second asynchronous communication message in the second modality;

providing for display, using the one or more computing devices, to the first user device, the second synchronous message in the first modality; and

providing for display, using the one or more computing devices, to the second user device, the first asynchronous message in the second modality.

15. The non-transitory processor readable storage medium of claim 14, wherein the first user device and the second user device are coupled to an electronic communication session.

16. The non-transitory processor readable storage medium of claim 14, wherein the first modality is text-based.

17. The non-transitory processor readable storage medium of claim 14, wherein the second modality is video-based.

18. The non-transitory processor readable storage medium of claim 14, further comprising:

receiving, at the one or more computing devices, at least one of a second synchronous communication message and a second asynchronous communication message.

19. The non-transitory processor readable storage medium of claim 15, further comprising:

transmitting, at the computing device, instructions configured to generate a display of at least one of synchronous communication message, the asynchronous communication message, the second synchronous communication message and the second asynchronous communication message.

20. A computing system, comprising:

one or more processors configured to receive a first synchronous communication message in a first modality from a first user device, the one or more processors further configured to generate a first asynchronous communication message in a second modality, based at least in part on the first synchronous communication message in the first modality, wherein the first modality differs from the second modality, the one or more processors further configured to receive a second asynchronous communication message in the second modality from a second user device, the one or more processors further configured to generate a second synchronous communication message in the first modality based at least in part on the second asynchronous communication message in the second modality, the one or more processors further configured to provide for display to the first user device, the second synchronous message in the first modality, the one or more processors further configured to provide for display to the second user device, the first asynchronous message in the second modality.

21. The computing system of claim 20, wherein the one or more processors are further configured to convert the received asynchronous communication message to an audio message.

22. The computing system of claim 21, wherein the one or more processors are further configured to transmit one or more instructions configured to output the audio message at the electronic communication session.

23. The computing system of claim 20, wherein the one or more processors are further configured to convert at least one of a voice-based synchronous communication message and an audio-based synchronous communication message to a text-based message.

24. The computing system of claim 23, wherein the text-based message is included within a display.

25. The computing system of claim 20, wherein the one or more processors are further configured to store at least one of the synchronous communication message and the asynchronous communication message.