Mobile terminal and menu control method thereof

• US 8,958,848 B2
• Filed: 06/16/2008
• Issued: 02/17/2015
• Est. Priority Date: 04/08/2008
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Shin, Jong-Ho, Youn, Jong-Keun, Jung, Dae-Sung, Kim, Tae-Jun, Kwak, Jae-Do, Yu, Jae-Hoon, Joh, Jae-Min
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): WOO, KUO-KONG
• Application Number:
  US12/140,111
• Publication Number:
  US 20090253463A1
• Time in Patent Office: 2,437 Days
• Field of Search: 455/418, 455/563, 455/414, 455/186.1, 455/564, 704/246, 704/251, 704/275, 704/257, 704/9
• US Class Current: 455/563
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/0635 updating or merging of old and new templates; Mean values; Weighting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G10L 2025/783 based on threshold decision
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72448 with means for adapting the functionality of the device according to specific conditions
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold

Abstract

A mobile terminal including an input unit configured to receive an input to activate a voice recognition function on the mobile terminal and a memory configured to store multiple domains related to menus and operations of the mobile terminal. It further includes a controller configured to access a specific domain among the multiple domains included in the memory based on the received input to activate the voice recognition function, to recognize user speech based on a language model and an acoustic model of the accessed domain, and to determine at least one menu and operation of the mobile terminal based on the accessed specific domain and the recognized user speech.

Claims

1. A method of controlling a mobile terminal having a display, the method comprising:

activating a mode for detecting voice input in response to a touch input to a soft button displayed on the display or to a hard button on the mobile terminal, wherein the mode for detecting the voice input is deactivated if there is no voice input detected for a predetermined amount of time;

receiving a voice input associated with a calling operation of the mobile terminal;

displaying an indicator indicating the voice input is being recognized by the mobile terminal, wherein the indicator comprises a waveform shape;

executing the calling operation only if there is a single contact in a phonebook that matches a meaning of the received voice input;

if there is no single contact that matches the meaning of the received voice input, performing a learning process using keywords of the voice input for learning the meaning of the received voice input;

outputting a voice prompt based on the learned meaning of the received voice input prompting if the learned meaning of the received voice input should be saved in the phonebook as the single contact that matches the meaning of the received voice input; and

storing the single contact in the phonebook based on an affirmative received response to the voice prompt.

2. The method of claim 1, wherein the voice input is in a natural language.

3. The method of claim 1, wherein the mode for detecting the voice input is triggered in response to a short-range wireless signal or a long-range wireless signal.

4. The method of claim 1, further comprising:

receiving a user selection, in response to the voice prompt, via a first additional voice input or by a touching operation; and

receiving a second additional voice input from the user or displaying a list of options when the first additional voice input is disaffirmed by the user selection.

5. The method of claim 4, wherein a recognition rate for the voice input is updated based on the user selection with the recognition rate increasing if the user selection affirms the voice input.

6. The method of claim 5, wherein a pattern of using the mobile terminal is used to improve the recognition rate.

7. The method of claim 1, wherein the displaying the indicator comprises:

generating help information in a voice message or a text, the help information prompting a user to clarify the voice input if the voice input is not clear to the mobile terminal.

8. The method of claim 1, wherein the indicator further comprises text converted from the voice input.

9. The method of claim 1, further comprising:

determining a meaning of the voice input;

outputting a result value of the determined meaning, wherein the result value comprises a menu relating to a function or service corresponding to the determined meaning;

requesting a user of the mobile terminal to confirm whether the result value is accurate by selecting the menu; and

executing the menu when selected by the user.

10. A mobile terminal, comprising:

a wireless communication unit configured to provide wireless communication;

a display; and

a controller configured to;

activate a mode for detecting voice input in response to a touch input to a soft button displayed on the display or to a hard button on the mobile terminal, wherein the mode for detecting the voice input is deactivated if there is no voice input detected for a predetermined amount of time,

receive a voice input associated with a calling operation of the mobile terminal,

display an indicator on the display indicating the voice input is being recognized by the mobile terminal, wherein the indicator comprises a waveform shape,

execute the calling operation only if there is a single contact in a phonebook that matches a meaning of the received voice input,

if there is no single contact that matches the meaning of the received voice input, perform a learning process using keywords of the voice input for learning the meaning of the received voice input,

output a voice prompt based on the learned meaning of the received voice input prompting if the learned meaning of the received voice input should be saved in the phonebook as the single contact that matches the meaning of the received voice input, and

store the single contact in the phonebook based on an affirmative received response to the voice prompt.

11. The mobile terminal of claim 10, wherein the mode for detecting the voice input is triggered in response to a short-range wireless signal or a long-range wireless signal.

12. The mobile terminal of claim 10, wherein the controller is further configured to:

receive a user selection, in response to the voice prompt, via a first additional voice input or by a touching operation, and

receive a second additional voice input from the user or displaying a list of options when the first additional voice input is disaffirmed by the user selection.

13. The mobile terminal of claim 12, wherein a recognition rate for the voice input is updated based on the user selection with the recognition rate increasing if the user selection affirms the voice input.

14. The mobile terminal of claim 13, wherein a pattern of using the mobile terminal is used to improve the recognition rate.

15. The mobile terminal of claim 10, wherein the controller is further configured to:

generate help information in a voice message or a text, the help information prompting a user to clarify the voice input if the voice input is not clear to the mobile terminal.

16. The mobile terminal of claim 10, wherein the indicator further comprises text converted from the voice input.

17. The mobile terminal of claim 10, wherein the controller is further configured to:

determine a meaning of the voice input,

output a result value of the determined meaning, wherein the result value comprises a menu relating to a function or service corresponding to the determined meaning,

request a user of the mobile terminal to confirm whether the result value is accurate by selecting the menu, and

execute the menu when selected by the user.

18. The mobile terminal of claim 10, wherein the controller is further configured to activate or terminate the mode for detecting the voice input in response to a touch input, a double touch input, or a long touch input to the soft button.

19. The mobile terminal of claim 10, wherein the controller is further configured to activate the mode for detecting the voice input in response to a touch input, a double touch input, or a long touch input to the hard button.

20. The mobile terminal of claim 10, wherein the controller is further configured to activate the mode for detecting the voice input in response to at least one of a specific sound, a specific sound effect, a wireless signal, a hand gesture, or a body gesture.