SMS MESSAGING WITH VOICE SYNTHESIS AND RECOGNITION

• US 20110173001A1
• Filed: 01/04/2011
• Published: 07/14/2011
• Est. Priority Date: 01/14/2010
• Status: Abandoned Application

• Current Assignee: Cleverspoke Incorporated
• Original Assignee: Cleverspoke Incorporated
• Inventors: Ford, Carl S., Guy, Edward Thomas III
• Application Number:
  US12/983,946
• Publication Number:
  US 20110173001A1
• Time in Patent Office: Days
• US Class Current: 704/246
• CPC Class Codes: G06F 40/157 using dictionaries or tables
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 51/58 Message adaptation for wireless communication
• CPC Class Codes: H04M 2201/39 using speech synthesis speech synthesis per se G10L13/00
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks

Abstract

When a subscriber'"'"'s phone is sent a SMS message from any other Public Switch Telephone Network user, a voice call to the subscriber'"'"'s phone is placed, and upon answering, the SMS message is translated into speech. A jargon translator is employed to convert SMS language into corresponding words. Once the message has been played, the subscriber receiving it may verbally request the opportunity to send a reply to the message by audibly speaking a response. The response is matched against an internal phrasebook to accurately transcribe the message. Transcription performance is improved by allowing each subscriber to provide a personal phrasebook which is combined with the internal one. However, if the spoken message is complex or not recognized, the message can be automatically relayed to a human agent for manual transcription.

Claims

1. An apparatus that provides a voice interaction service with SMS and text messages for subscribing voice terminals comprising:

a) a means for processing SMS messages sent to the subscribing mobile stations;

b) a SMS receiver which receives the processed SMS messages;

c) a data store which stores profiles for subscribers to the service, including their personal grammar and syntax preferences, recorded human voices and other sounds, and rules for controlling a voice recognition module;

d) a jargon engine which recognizes jargon such as abbreviations commonly used in text messaging and replaces such jargon with plain language;

e) a text-to-speech module, which assembles fragments of recorded human speech;

f) a voice recognition module, which is activated by subscribers'"'"' speech;

g) a call server which provides a means of sending a synthesized voice message or other messages to the subscribing mobile station through the signaling and control of an audio channel or call path; and

h) a control program connected to the SMS receiver, the data store, the jargon engine, the text-to-speech module, the call server and the voice recognition module, for (i) receiving a SMS message from the SMS Receiver;

(ii) analyzing and processing the SMS message by querying the data store subscriber profile record for translating jargon into plain text in the jargon engine;

iii) using the results of the query to replace any jargon with plain language via the jargon engine;

(iv) establishing a connection with the subscribing mobile station through the call server;

v) using the text-to-speech processor, once the subscribing mobile station answers the call, to read the processed message with the synthesized voice;

(vi) following the conversion of the text to speech, informing the call server to prompt the subscriber to vocalize a command;

(vii) informing the voice recognition module to collect any utterances received from the subscriber;

viii) further analyzing the received utterances by querying the data store record of the subscriber-specific rules for personal grammar and syntax preferences, to derive text therefrom; and

ix) receiving results from the voice recognition module indicating whether the results should be converted into an SMS message via the text to speech engine for transmission to its intended recipient or whether the results should be sent to a human agent for further processing into a SMS message.

2. Apparatus of claim 1 wherein the voice terminal is a mobile station.

3. Apparatus of claim 1 wherein the voice terminal is a Plain Old Telephone Service station

4. Apparatus of claim 1 wherein the control program, after it receives the results from the voice recognition module indicating that the results should be sent to a human agent for further processing into an SMS message, prompts the subscriber to send the results to a human agent.

5. Apparatus of claim 1 wherein the control program, after it receives the results from the voice recognition module indicating that the results should be converted into an SMS message prompts the subscriber to confirm the command before it transmits the results to its intended recipient,

6. Apparatus of claim 1 wherein the control program, after it receives the results from the voice recognition module indicating that the results should be converted into an SMS message, converts the results into an SMS message via the text to speech engine for transmission to its intended recipient.

7. Apparatus of claim 1 wherein the means for processing SMS messages sent to a subscribing mobile station is a Short Message Service Center of a Mobile Service Provider that delivers the SMS messages to the SMS Receiver.

8. Apparatus of claim 1 wherein the means for processing SMS messages sent to a subscribing mobile station is via an SMSC substitute for processing SMS messages.

9. Apparatus of claim 1 wherein the subscriber profile of claim 1 also includes a subscriber-specific personal jargon dictionary for translating SMS messaging abbreviations particular to the subscriber into plain language.

10. Apparatus of claim 1 wherein the jargon engine of claim 1 also recognizes and replaces jargon specific and particular to the subscriber.

11. Apparatus of claim 1 wherein the audio channel or call path may be via the PSTN or via a Sound Subsystem in an Entry Station.

12. Apparatus of claim 1 wherein subscriber may verbally request their message to be manually transcribed by directing their utterances by any means to an agent who transcribes and enters the text message on their behalf.

13. Apparatus of claim 1 wherein the received utterances are recognized as a command to call the originator of the SMS message instead of sending a response text message.

14. Apparatus of claim 1 wherein the received utterances are recognized as a command to send an SMS message to another destination.

15. Apparatus of claim 1 wherein additional SMS messages, which arrive while the audio channel to the mobile Station is established, are audibly transmitted to the mobile station using the same audio channel.

16. Apparatus of claim 1 wherein the apparatus can be conditionally activated.

17. Apparatus of claim 14 wherein the apparatus is conditionally activated based on the time of day.

18. Apparatus of claim 1 wherein the jargon engine may process the subscriber'"'"'s outgoing message and replace identified phrase with jargon.

19. Apparatus of claim 1 wherein the subscriber'"'"'s utterances are audibly transmitted to the sender of the first SMS message, instead of, or in addition to, the translated text.

20. A method for providing a voice interaction service with SMS and text messages for subscribing mobile stations comprising:

a) receiving a SMS message from the SMS Receiver;

b) analyzing and processing the SMS message by querying the data store subscriber profile record for translating jargon into plain text in the jargon engine;

c) using the results of the query to replace any jargon with plain language via the jargon engine;

d) establishing a connection with the subscribing mobile station through the call server;

e) using the text-to-speech processor, once the subscribing mobile station answers the call, to read the processed message with the synthesized voice;

f) following the conversion of the text to speech, informing the call server to prompt the subscriber to vocalize a command;

g) informing the voice recognition module to collect any utterances received from the subscriber;

h) further analyzing the received utterances by querying the data store record of the subscriber-specific rules for personal grammar and syntax preferences, to derive text therefrom; and

i) receiving results from the voice recognition module indicating whether the results should be converted into an SMS message via the text to speech engine for transmission to its intended recipient or whether the results should be sent to a human agent for further processing into a SMS message.