Selection of a link in a received message for speaking reply, which is converted into text form for delivery

• US 8,989,713 B2
• Filed: 11/22/2011
• Issued: 03/24/2015
• Est. Priority Date: 01/09/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Doulton, Daniel Michael
• Primary Examiner(s): Siddiqui, Kashif
• Application Number:
  US13/302,342
• Publication Number:
  US 20130165086A1
• Time in Patent Office: 1,218 Days
• Field of Search: 455/414.4, 455/412.1, 455/413, 455/417, 455/445, 455/466, 455/406, 379/88.11, 379/88.14, 379/88.16, 379/88.19
• US Class Current: 455/414.1
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/58 Message adaptation for wireless communication
• CPC Class Codes: H04M 15/10 Metering calls from calling party , i.e. A-party charged for the communication
• CPC Class Codes: H04M 15/68 Payment of value-added services
• CPC Class Codes: H04M 15/8221 Message based
• CPC Class Codes: H04M 15/844 Message, e.g. SMS
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2203/651 Text message transmission triggered by call automatic reactions in messaging within packet-switching networks H04L51/02
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/5322 for recording text messages
• CPC Class Codes: H04M 3/533 Voice mail systems
• CPC Class Codes: H04M 3/53308 Message originator indirectly connected to the message centre, e.g. after detection of busy or absent state of a called party
• CPC Class Codes: H04M 3/53316 Messaging centre selected by message originator
• CPC Class Codes: H04M 3/537 Arrangements for indicating the presence of a recorded message , whereby the presence information might include a preview or summary of the message
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements

Abstract

A link, called an X-Link™ and is placed in a message (SMS, MMS, email etc.) that is sent to a user and displayed on their device (e.g. mobile telephone). When the link is selected by the user, it connects the user'"'"'s device to a conversion system, enabling the user to speak a reply which is then converted to a text based reply message; the reply message is then sent to the original message sender (and/or another appropriate recipient). This approach enables a text message to be responded to by voice: it is an example of an asymmetric communication. There are many circumstances where this approach is very useful—for example if the message is a SMS and the recipient does not know how to respond using SMS, or is in an environment where it is difficult (perhaps when walking or driving).

Claims

1. A method of communication comprising:

receiving an audio message from a caller to a recipient;

transcribing the audio voice message to produce text;

providing a text message including the text and a link comprising information that links to a conversion system capable of converting speech to text and an identifier indicating a destination for a reply message, such that when the recipient selects the link, the recipient is connected to the conversion system to speak the reply message that is automatically transcribed into a reply text message and provided to the destination associated with the identifier; and

transmitting the text message to a mobile device of the recipient.

2. The method of claim 1 in which the text message is transmitted in a format selected from the group consisting of:

SMS, MMS, IM, and e-mail.

3. The method of claim 1, in which the identifier for the destination includes a telephone number, email address, IP address, IM address, and/or VoIP address.

4. The method of claim 1, in which the information that links to the conversion system is a service number.

5. The method of claim 1, in which the information that links to the conversion system comprises selectable text that, when selected, opens a voice channel to enable the reply to be stored for use by the conversion system.

6. The method of claim 1, further comprising:

receiving a communication to connect in response to the recipient selecting the link;

prompting the recipient to provide speech input subsequent to connecting;

receiving speech input from the recipient;

transcribing the speech input from the recipient to text; and

automatically transmitting a text message including the text to the destination identified by the identifier in the link.

7. The method of claim 6, wherein the speech input is transcribed, at least in part, using automatic speech recognition.

8. The method of claim 1, wherein the audio message is transcribed, at least in part, using automatic speech recognition.

9. The method of claim 1, wherein the destination associated with the identifier is a telephone number of the caller.

10. The method of claim 1, wherein the destination associated with the identifier is an electronic address.

11. At least one non-transitory computer readable medium storing instruction that, when executed by at least one processor, performs a method of communication comprising:

receiving an audio message from a caller to a recipient;

transcribing the audio voice message to produce text;

providing a text message including the text and a link comprising information that links to a conversion system capable of converting speech to text and an identifier indicating a destination for a reply message, such that when the recipient selects the link, the recipient is connected to the conversion system to speak the reply message that is automatically transcribed into a reply text message and provided to the destination associated with the identifier; and

transmitting the text message to a mobile device of the recipient.

12. The at least one non-transitory computer readable medium of claim 11, further comprising:

receiving a communication to connect in response to the recipient selecting the link;

prompting the recipient to provide speech input subsequent to connecting;

receiving speech input from the recipient;

transcribing the speech input from the recipient to text; and

automatically transmitting a text message including the text to the destination identified by the identifier in the link.

13. The at least one non-transitory computer readable medium of claim 12, wherein the speech input is transcribed, at least in part, using automatic speech recognition.

14. The at least one non-transitory computer readable medium of claim 11, wherein the audio message is transcribed, at least in part, using automatic speech recognition.

15. The at least one non-transitory computer readable medium of claim 11, wherein the destination associated with the identifier is a telephone number of the caller.

16. The at least one non-transitory computer readable medium of claim 11, wherein the destination associated with the identifier is an electronic address.

17. A system for communication comprising:

a conversion system configured to;

receive an audio message from a caller to a recipient;

transcribe the audio voice message to produce text;

provide a text message including the text and a link comprising information that links to the conversion system capable of converting speech to text and an identifier indicating a destination for a reply message, such that when the recipient selects the link, the recipient is connected to the conversion system to speak the reply message that is automatically transcribed into a reply text message and provided to the destination associated with the identifier; and

transmit the text message to a mobile device of the recipient.

18. The system of claim 17, wherein the conversion system is further configured to:

receive a communication to connect in response to the recipient selecting the link;

prompt the recipient to provide speech input subsequent to connecting;

receive speech input from the recipient;

transcribe the speech input from the recipient to text; and

automatically transmit a text message including the text to the destination identified by the identifier in the link.

19. The system of claim 18, wherein the speech input is transcribed, at least in part, using automatic speech recognition.

20. The system of claim 17, further comprising an automatic recognition system and wherein the audio message is transcribed, at least in part, using the automatic speech recognition system.

21. The system of claim 17, wherein the destination associated with the identifier is a telephone number of the caller.

22. The system of claim 17, wherein the destination associated with the identifier is an electronic address.