MOBILE TERMINAL AND MENU CONTROL METHOD THEREOF

• US 20090254351A1
• Filed: 06/16/2008
• Published: 10/08/2009
• Est. Priority Date: 04/08/2008
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kwak, Jea-Do, Shin, Jong-Ho, Youn, Jong-Keun
• Granted Patent: US 8,150,700 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

A mobile terminal including an input unit configured to receive an input to activate a voice recognition function on the mobile terminal, a memory configured to store information related to operations performed on the mobile terminal, and a controller configured to activate the voice recognition function upon receiving the input to activate the voice recognition function, to determine a meaning of an input voice instruction based on at least one prior operation performed on the mobile terminal and a language included in the voice instruction, and to provide operations related to the determined meaning of the input voice instruction based on the at least one prior operation performed on the mobile terminal and the language included in the voice instruction and based on a probability that the determined meaning of the input voice instruction matches the information related to the operations of the mobile terminal.

Claims

1. A mobile terminal, comprising:

an input unit configured to receive an input to activate a voice recognition function on the mobile terminal;

a memory configured to store information related to operations performed on the mobile terminal; and

a controller configured to activate the voice recognition function upon receiving the input to activate the voice recognition function, to determine a meaning of an input voice instruction based on at least one prior operation performed on the mobile terminal and a language included in the voice instruction, and to provide operations related to the determined meaning of the input voice instruction based on the at least one prior operation performed on the mobile terminal and the language included in the voice instruction and based on a probability that the determined meaning of the input voice instruction matches the information related to the operations of the mobile terminal.

2. The mobile terminal of claim 1, wherein the provided operations exclude intermediary operations such that a selection of a provided operation results in a function corresponding to the selected provided operation being executed without requiring a selection of the excluded intermediary operations.

3. The mobile terminal of claim 1, wherein the provided operations related to the determined meaning of the voice instruction include all operations having a probability greater than a predetermined threshold.

4. The mobile terminal of claim 3, wherein the predetermined threshold is set by a manufacturer of the terminal or by a user of the terminal.

5. The mobile terminal of claim 3, wherein the predetermined threshold is automatically selected based on a determined number of operations.

6. The mobile terminal of claim 1, wherein the controller is further configured to determine the meaning of the input voice instruction based on an operating state of the mobile terminal.

7. The mobile terminal of claim 1, wherein the provided operations related to the determined meaning of the input voice instruction include at least one menu option corresponding to the determined meaning of the input voice instruction.

8. The mobile terminal of claim 7, wherein the controller is further configured to output all menu options corresponding to the determined meaning of the input voice instruction that that have a probability that is higher than a predetermined threshold.

9. The mobile terminal of claim 8, wherein the controller is further configured to discriminately display a menu option corresponding to the determined meaning of the input voice instruction having a highest probability from other menus.

10. The mobile terminal of claim 9, wherein the controller discriminately displays the menu option corresponding to the determined meaning of the input voice instruction having the highest probability by differentially controlling at least one of a size, a display position, a color, a contrast, and highlight information of the menu option having the highest probability.

11. The mobile terminal of claim 1, wherein the input unit includes at least one of:

1) a touch soft button that is touched to activate the voice recognition function,

     2) a hard button that is pressed or manipulated to activate the voice recognition function,

     3) an arbitrary position of a touch screen included in the input unit that is touched to activate the voice recognition function,

     4) an impact sound that is input to activate the voice recognition function,

     5) a local area radio signal or a remote area radio signal, and

     6) a body information signal from a user.

12. The mobile terminal of claim 1, further comprising:

a first database configured to store voice or pronunciation information that is used by the controller to recognize the voice instruction;

a second database configured to store a word, a keyword or sentence information that is used by the controller to recognize the voice instruction;

a third database configured to store information related to functions or menus of the mobile terminal; and

a fourth database configured to store help information to be output to inform a user that the controller is attempting to determine a meaning of the recognized voice instruction.

13. The mobile terminal of claim 1, wherein the controller is further configured to output audio or video information indicating that the voice recognition function is in an activated state.

14. A method of controlling a mobile terminal, the method comprising:

receiving an input to activate a voice recognition function on the mobile terminal;

activating the voice recognition function upon receiving the input to activate the voice recognition function; and

providing operations related to a determined meaning of the input voice instruction based on at least one prior operation performed on the mobile terminal and a language included in the voice instruction and based on a probability that the determined meaning of the input voice instruction matches information related to the operations of the mobile terminal.

15. The method of claim 14, wherein the provided operations exclude intermediary operations such that a selection of a provided operation results in a function corresponding to the selected provided operation being executed without requiring a selection of the excluded intermediary operations.

16. The method of claim 14, wherein the provided operations related to the determined meaning of the voice instruction include all operations having a probability greater than a predetermined threshold.

17. The mobile terminal of claim 16, wherein the predetermined threshold is set by a manufacturer of the terminal or by a user of the terminal.

18. The method of claim 16, wherein the predetermined threshold is automatically selected based on a determined number of operations.

19. The method of claim 14, further comprising:

determining the meaning of the input voice instruction based on the at least one prior operation performed on the mobile terminal and the language included in the voice instruction.

20. The method of claim 19, further comprising:

determine the meaning of the input voice instruction based on an operating state of the mobile terminal.

21. The method of claim 20, wherein the provided operations related to the determined meaning of the input voice instruction include at least one menu option corresponding to the determined meaning of the input voice instruction.

22. The method of claim 21, further comprising:

outputting all menu options corresponding to the determined meaning of the input voice instruction that that have a probability that is higher than a predetermined threshold.

23. The method of claim 22, further comprising:

discriminately displaying a menu option corresponding to the determined meaning of the input voice instruction having a highest probability from other menus.

24. The method of claim 23, wherein the displaying step discriminately displays the menu option corresponding to the determined meaning of the input voice instruction having the highest probability by differentially controlling at least one of a size, a display position, a color, a contrast, and highlight information of the menu option having the highest probability.

25. The method of claim 14, wherein the inputting step comprises activating the voice recognition function using at least one of:

1) a touch soft button that is touched to activate the voice recognition function,

     2) a hard button that is pressed or manipulated to activate the voice recognition function,

     3) an arbitrary position of a touch screen included in the input unit that is touched to activate the voice recognition function,

     4) an impact sound that is input to activate the voice recognition function,

     5) a local area radio signal or a remote area radio signal, and

     6) a body information signal from a user.

26. The method of claim 14, further comprising:

outputting audio or video information indicating that the voice recognition function is in an activated state.