Mobile terminal and menu control method thereof

• US 9,692,865 B2
• Filed: 09/30/2016
• Issued: 06/27/2017
• Est. Priority Date: 04/08/2008
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kwak, Jae-Do, Shin, Jong-Ho, Yu, Jae-Hoon, Jung, Dae-Sung, Kim, Tae-Jun, Youn, Jong-Keun, Joh, Jae-Min
• Primary Examiner(s): Timory, Kabir A
• Application Number:
  US15/282,523
• Publication Number:
  US 20170019515A1
• Time in Patent Office: 270 Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/0635 updating or merging of old and new templates; Mean values; Weighting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G10L 2025/783 based on threshold decision
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72448 with means for adapting the functionality of the device according to specific conditions
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold

Abstract

A mobile terminal including a wireless communication unit configured to provide wireless communication, a display, and a controller configured to, activate a mode for voice recognition in response to a touch input to a soft button displayed on the display or to a hard button on the mobile terminal, receive a first voice input associated with a phone call relating operation of the mobile terminal, display an indicator on the display indicating the voice input is being recognized by the mobile terminal, analyze the context of a voice command in the voice input, execute the call relating operation only if there is a single contact in a phonebook that matches the voice command in the first voice input, if there is no single contact that matches the voice command of the received voice input, display a plurality of candidates that is analyzed based on the voice command, receive a second input according to a plurality of candidates, and execute the call relating operation based on the second input.

Claims

1. A mobile terminal, comprising:

a wireless communication unit configured to provide wireless communication;

a memory configured to store at least one database (DB);

a display; and

a controller configured to;

activate a mode for voice recognition in response to a touch input to a soft button displayed on the display or to a hard button on the mobile terminal,

receive a first voice input associated with an executable menu relating operation of the mobile terminal,

display an indicator on the display indicating the first voice input is being recognized by the mobile terminal,

determine a meaning of a voice command in the first voice input based on information stored in the at least one database (DB),

display information corresponding to the determined meaning,

receive a second voice input associated with a user'"'"'s confirmation about the displayed information,

if the received second voice input matches an affirmative received response, execute a menu relating operation corresponding to the displayed information,

if the received second voice input matches a negative received response, perform a learning process based on a third voice input for learning the meaning of the voice command in the first voice input and execute a menu relating operation corresponding to the learned meaning, and

update the at least one database (DB) to store the learned meaning according to the third voice input.

2. The mobile terminal of claim 1, wherein the executable menu relating operation of the mobile terminal comprises at least one of Edit, Add, Find, Call, Send Message, Reply Message, Settings, Select, Application Execute, Search and Move.

3. The mobile terminal of claim 2, wherein the first voice input associated with a phone call relating operation of the mobile terminal comprises a name stored in the phonebook.

4. The mobile terminal of claim 1, wherein the mode for voice recognition is deactivated if there is no voice input detected for a predetermined amount of time.

5. The mobile terminal of claim 1, wherein the first voice input is in a natural language.

6. The mobile terminal of claim 1, wherein the mode for voice recognition is triggered in response to a short-range wireless signal or a long-range wireless signal.

7. The mobile terminal of claim 1, wherein a recognition rate for the first voice input is updated based on the second voice input.

8. The mobile terminal of claim 7, wherein the recognition rate is increased if the second voice input affirms the first voice input.

9. The mobile terminal of claim 8, wherein a pattern of using the mobile terminal is used to improve the recognition rate.

10. The mobile terminal of claim 1, wherein the controller is further configured to:

execute a call relating operation only if there is a single contact in a phonebook that matches the voice command in the first voice input,

if there is no single contact that matches the voice command of the first voice input, display a plurality of candidates that is analyzed based on the voice command, and

display a selected candidate according a user'"'"'s input when the user'"'"'s input is received while displaying the plurality of candidates.

11. The mobile terminal of claim 10, wherein the user'"'"'s input comprises at least one of a touch input or a voice input.

12. A method of controlling a mobile terminal having a display and a controller, the method comprising:

activating, via the controller, a mode for voice recognition in response to a touch input to a soft button displayed on the display or to a hard button on the mobile terminal;

receiving, via the controller, a first voice input associated with an executable menu relating operation of the mobile terminal;

displaying, via the controller, an indicator on the display indicating the first voice input is being recognized by the mobile terminal;

determining, via the controller, a meaning of a voice command in the first voice input based on information stored in the at least one database (DB);

displaying, via the controller, information corresponding to the determined meaning;

receiving, via the controller, a second voice input associated with a user'"'"'s confirmation about the displayed information;

if the received second voice input matches an affirmative received response, executing, via the controller a menu relating operation corresponding to the displayed information;

if the received second voice input matches a negative received response, performing, via the controller, a learning process based on a third voice input for learning the meaning of the voice command in the first voice input and executing a menu relating operation corresponding to the learned meaning; and

updating, via the controller, the at least one database (DB) to store the learned meaning according to the third voice input.

13. The method of claim 12, wherein the executable menu relating operation of the mobile terminal comprises at least one of Edit, Add, Find, Call, Send Message, Reply Message, Settings, Select, Application Execute, Search and Move.

14. The method of claim 13, wherein the first voice input associated with a phone call relating operation of the mobile terminal comprises a name stored in the phonebook.

15. The method of claim 12, further comprising:

deactivating the mode for voice recognition if there is no voice input detected for a predetermined amount of time.

16. The method of claim 12, further comprising:

updating a recognition rate for the first voice input based on the second voice input.

17. The method of claim 16, wherein the recognition rate is increased if the second voice input affirms the first voice input.

18. The method of claim 12, further comprising:

executing a call relating operation only if there is a single contact in a phonebook that matches the voice command in the first voice input;

if there is no single contact that matches the voice command of the first voice input, displaying a plurality of candidates that is analyzed based on the voice command; and

displaying a selected candidate according to a user'"'"'s input when the user'"'"'s input is received while displaying the plurality of candidates.