MULTIMEDIA AND TEXT MESSAGING WITH SPEECH-TO-TEXT ASSISTANCE

• US 20040176114A1
• Filed: 03/06/2003
• Published: 09/09/2004
• Est. Priority Date: 03/06/2003
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Northcutt, John W.
• Application Number:
  US10/248,982
• Publication Number:
  US 20040176114A1
• Time in Patent Office: Days
• US Class Current: 455/466
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails

Abstract

A system and method of creating a multi-media voice and text message on a mobile phone where the voice portion of the MMS message is a verbatim rendition of the text portion or a personalized description of the text portion. The mobile phone includes a messaging function responsive to voice and text input. The message composer accesses the mobile phone'"'"'s messaging function and speaks a message. The spoken message is recorded converted to a text message. If the message is personalized, the message composer records a second spoken message contextually related to the text message. Now, the text portion and the second spoken message are combined into an MMS message and sent to a recipient using the mobile phone'"'"'s messaging functions. There is also disclosed a system and method of creating an MMS message on a mobile phone utilizing canned messages and speech-to-text assistance to edit the canned message. The message composer accesses the mobile phone'"'"'s messaging function and inputs part of a message, either by voice or text. The mobile phone compares the input to a database and displays a list of text messages that closely match the input. The message composer selects one of the displayed text messages. This message is then featured in a text editing function so that it may be completed.

Claims

1. A method of creating a message on a mobile phone, the mobile phone including a messaging function responsive to voice and text input, the method comprising:

accessing the messaging function;

speaking a message using voice input;

recording the spoken message;

converting the spoken message to a text message; and

combining the text message and spoken message into an MMS message.

2. A method of creating a message on a mobile phone, the mobile phone including a messaging function responsive to voice and text input, the method comprising:

accessing the messaging function;

speaking a message using voice input;

converting the spoken message to a text message;

recording a second spoken message contextually related to the text message; and

combining the text message and the second spoken message into an MMS message.

3. A method of creating a message on a mobile phone, the mobile phone including a messaging function responsive to voice and text input, the method comprising:

accessing the messaging function;

inputting part of a message;

displaying a list of text messages that closely match the input wherein the text messages contain at least one open field;

selecting one of the displayed text messages; and

editing the selected text message.

4. The method of claim 3 wherein inputting part of a message is achieved using voice input.

5. The method of claim 4 further comprising converting the voice input to text.

6. The method of claim 3 wherein inputting part of a message is achieved using text input.

7. The method of claim 3 further comprising optionally adding a voice tag to the edited text message and combining the voice tag with the edited text message to form an MMS message.

8. The method of claim 3 further comprising optionally adding an image to the edited text message and combining the image with the edited text message to form an MMS message.

9. The method of claim 3 wherein editing the selected text message comprises:

(a) displaying the selected text message;

(b) receiving a voice input for an open field in the selected text message;

(c) converting the voice input to a text input;

(d) looking a match between the converted voice input and a database of text;

if there is a match, then

(e) determining if the match corresponds to a word, an image, or both;

if just a word or just an image, then

(f) filling the open field with the word or image;

if both, then

(g) selecting either the word or the image and filling the open field with the selection;

(h) checking for more open fields;

if there are more open fields, then

(i) returning to step (b), otherwise terminating the editing process,

if there is not a match, then

(j) finding the closest match in the database;

(k) prompting whether to use the closest match;

if using closest match, then

(l) filling the open field with the closest match;

(m) checking for more open fields and if there are more open fields, then returning to step (b), otherwise terminating the editing process,

if not using closest match, then

(o) prompting to add current text input to database;

(p) filling the open field with the current text input;

(q) checking for more open fields and if there are more open fields, then returning to step (b), otherwise terminating the editing process.

10. The method of claim 9 further comprising checking if the closest match found corresponds to the text input within tolerable limits.

11. The method of claim 10 wherein if the closest match found does not correspond to the text input within tolerable limits, prompting to add current text input to database.

12. The method of claim 9 further comprising editing the message further once all the open fields have been filled.

13. A system for creating a message on a mobile phone, the mobile phone including a messaging function responsive to voice and text input, the system comprising:

means for accessing the messaging function;

means for receiving a spoken message;

means for recording the spoken message;

means for converting the spoken message to a text message; and

means for combining the text message and spoken message into an MMS message.

14. A system for creating a message on a mobile phone, the mobile phone including a messaging function responsive to voice and text input, the system comprising:

means for accessing the messaging function;

means for receiving a spoken message;

means for converting the spoken message to a text message;

means for receiving and recording a second spoken message contextually related to the text message; and

means for combining the text message and the second spoken message into an MMS message.

15. A system for creating a message on a mobile phone, the mobile phone including a messaging function responsive to voice and text input, the system comprising:

means for accessing the messaging function;

means for inputting part of a message;

means for displaying a list of text messages that closely match the input wherein the text messages contain at least one open field;

means for selecting one of the displayed text messages; and

means for editing the selected text message.

16. The system of claim 15 wherein the means for inputting part of a message is a microphone that receives a voice input.

17. The system of claim 16 further comprising means for converting the voice input to text.

18. The system of claim 15 wherein the means for inputting part of a message is a keypad for text input.

20. The system of claim 15 further comprising means for adding an image to the edited text message and means for combining the image with the edited text message to form an MMS message.

21. The method of claim 15 wherein the means for editing the selected text message comprises:

means for displaying the selected text message;

means for receiving a voice input for an open field in the selected text message;

means for converting the voice input to a text input;

means for looking a match between the converted voice to text input and a database;

means for determining if a match corresponds to a word, an image, or both in the database;

means for selecting either a word or an image from the database;

means for filling the open field with a word or image;

means for finding a closest match in the database to the converted voice to text input;

means for prompting whether to use the closest match;

means for filling the open field with the closest match;

means for adding the converted voice to text input to the database;

means for filling the open field with the converted voice to text input;

means for checking for more open fields in the selected text;

means for returning control to the means for receiving a voice input for an open field in the selected text message; and

means for terminating the editing process.

22. The system of claim 21 further comprising means for checking if the closest match found corresponds to the text input within tolerable limits.

23. The system of claim 22 further comprising means for prompting to add current text input to database if the closest match found does not correspond to the text input within tolerable limits.

24. The method of claim 21 further comprising means for editing the message further once all the open fields have been filled.

19. The system of claim 115 further comprising means for adding a voice tag to the edited text message and means for combining the voice tag with the edited text message to form an MMS message.