Key usage and text marking in the context of a combined predictive text and speech recognition system

• US 20070100619A1
• Filed: 11/02/2005
• Published: 05/03/2007
• Est. Priority Date: 11/02/2005
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Purho, Juha
• Application Number:
  US11/265,736
• Publication Number:
  US 20070100619A1
• Time in Patent Office: Days
• US Class Current: 704/239
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2250/74 with voice recognition means

Abstract

A combined predictive speech and text recognition system. The present invention combines the functionality of text input programs with speech input and recognition systems. With the present invention, a user can both manually enter text and speak desired letters, words or phrases. The system receives and analyzes the provided information and provides one or more proposals for the completion of words or phrases. This process can be repeated until an adequate match is found.

Claims

1. A method of using text and speech information to predict a character string that is desired to be entered into an electronic device, comprising:

receiving a voice input from a user;

receiving designated text input from the user;

using a predictive model to generate at least one candidate character string based upon the voice input and the designated text input; and

exhibiting the at least one candidate character string to the user.

2. The method of claim 1, further comprising:

permitting the user to select a desired candidate character string from the at least one candidate character string; and

if the user is not satisfied with any of the at least one character string;

permitting the user to provide additional input,

using the predictive model to regenerate the at least one candidate character string based in part upon the additional input, and

exhibiting the regenerated at least one candidate character string to the user.

3. The method of claim 1, wherein an associated database of character strings is accessed to aid in the generation of the at least one candidate character string.

4. The method of claim 3, wherein the database comprises a dictionary.

5. The method of claim 1, further comprising:

before receiving the voice input, receiving an indication of the activation of a voice key; and

after receiving the voice input, receiving an indication of the deactivation of a voice key.

6. The method of claim 5, wherein the designated text input is highlighted by color, font, underlining or placing predetermined characters around the text when the voice key is activated to indicate an expected voice input from the user, and wherein the highlighting ends when the voice key is deactivated.

7. The method of claim 1, further comprising enabling the user to toggle among the exhibited at least one character string using a single key.

8. The method of claim 1, wherein the designated text input is designated by marking text appearing on a display.

9. The method of claim 8, wherein the text is marked by a process selected from the group consisting of underlining, highlighting, changing font, and placing predetermined characters around the text to be designated.

10. The method of claim 1, wherein the designated text input is designated by a process selected from the group consisting of examining text appearing before a cursor appearing on a display, examining text appearing after a cursor appearing on a display, and examining text appearing both before and after a cursor appearing on a display.

11. The method of claim 1, wherein each of the at least one character string comprises a word.

12. The method of claim 1, wherein each of the at least one character string comprises a phrase.

13. The method of claim 1, wherein each character of the at least one character string is selected from the group consisting of a number, a letter, a symbol, and a punctuation mark.

14. The method of claim 1, further comprising enabling the user to manipulate the at least one character string via voice input.

15. The method of claim 1, wherein the voice input includes the name of a character selected from the group consisting of a symbol and a number, and wherein the predictive model uses the actual character in generating the at least one candidate character string.

16. A computer program product for using text and speech information to predict a character string that is desired to be entered into an electronic device, comprising:

computer code for receiving a voice input from a user;

computer code for receiving designated text input from the user;

computer code for using a predictive model to generate at least one candidate character string based upon the voice input and the designated text input; and

computer code for exhibiting the at least one candidate character string to the user.

17. The computer program product of claim 16, further comprising:

computer code for permitting the user to select a desired candidate character string from the at least one candidate character string; and

computer code for, if the user is not satisfied with any of the at least one character string;

permitting the user to provide additional input,

using the predictive model to regenerate the at least one candidate character string based in part upon the additional input, and

exhibiting the regenerated at least one candidate character string to the user.

18. The computer program product of claim 16, wherein an associated database of character strings is accessed to aid in the generation of the at least one candidate character string.

19. The computer program product of claim 16, further comprising:

computer code for before receiving the voice input, receiving an indication of the activation of a voice key; and

computer code for after receiving the voice input, receiving an indication of the deactivation of a voice key.

20. The computer program product of claim 16, wherein the designated text input is designated by marking text appearing on a display.

21. The computer program product of claim 16, wherein the designated text input is designated by a process selected from the group consisting of examining text appearing before a cursor appearing on a display, examining text appearing after a cursor appearing on a display, and examining text appearing both before and after a cursor appearing on a display.

22. An electronic device, comprising:

a processor; and

a memory unit operatively connected to the processor and including;

computer code for receiving a voice input from a user;

computer code for receiving designated text input from the user;

computer code for using a predictive model to generate at least one candidate character string based upon the voice input and the designated text input; and

computer code for exhibiting the at least one candidate character string to the user.

23. The electronic device of claim 22, wherein the memory unit further comprises:

computer code for permitting the user to select a desired candidate character string from the at least one candidate character string; and

computer code for, if the user is not satisfied with any of the at least one character string;

permitting the user to provide additional input,

using the predictive model to regenerate the at least one candidate character string based in part upon the additional input, and

exhibiting the regenerated at least one candidate character string to the user.

24. The electronic device of claim 22, wherein an associated database of character strings is accessed to aid in the generation of the at least one candidate character string.

25. The electronic device of claim 22, wherein the memory unit further comprises:

computer code for before receiving the voice input, receiving an indication of the activation of a voice key; and

computer code for after receiving the voice input, receiving an indication of the deactivation of a voice key.

26. The electronic device of claim 22, wherein the designated text input is designated by marking text appearing on a display.

27. The electronic device of claim 22, wherein the designated text input is designated by a process selected from the group consisting of examining text appearing before a cursor appearing on a display, examining text appearing after a cursor appearing on a display, and examining text appearing both before and after a cursor appearing on a display.

28. An electronic device, comprising

a processor;

a display operatively connected to the processor; and

a memory unit operatively connected to the processor and including;

a speech recognition unit for accepting a voice input from a user;

a predictive text and speech engine in operative communication with the speech recognition unit, the predictive text and speech engine configured to generate at least one candidate character string based upon the voice input and designated text input for exhibition to the user on the display.