Mobile terminal and controlling method thereof using voice recognition

• US 9,460,717 B2
• Filed: 11/20/2013
• Issued: 10/04/2016
• Est. Priority Date: 11/20/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Jeong, Hojoong, Kim, Jonghwan
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US14/085,571
• Publication Number:
  US 20140142953A1
• Time in Patent Office: 1,049 Days
• Field of Search: 704 8- 10, 704/275
• US Class Current: 1/1
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/225 Feedback of the input speech

Abstract

A mobile terminal including a microphone configured to receive a voice input; a touchscreen configured to display information; and a controller configured to activate a voice recognition mode on the mobile terminal for receiving the voice input from the microphone, receive the voice input indicating a particular function on the mobile terminal is to be executed, execute the particular function indicated by the received voice input, if the voice recognition mode is interrupted while the particular function is being executed, determine whether the particular function is in a complete state or an incomplete state, if the particular function is in the incomplete state, display a display object corresponding to the particular function in the incomplete state, and resume the particular function and activate the microphone for receiving additional voice input to complete the particular function.

Claims

1. A mobile terminal comprising:

a microphone configured to receive a voice input;

a touchscreen configured to display information; and

a controller configured to;

activate a voice recognition mode on the mobile terminal for receiving the voice input from the microphone,

receive the voice input via the microphone, and execute a particular function related to the received voice input,

if the voice recognition mode is interrupted and the microphone is deactivated while the particular function is being executed, determine whether the particular function is in a complete state or an incomplete state,

if the particular function is in the incomplete state, display a display object informing that the particular function is in the incomplete state by a deactivation of the microphone, and

activate the microphone for receiving additional voice input to complete the particular function when the display object is selected by a user.

2. The mobile terminal of claim 1, wherein the controller is further configured to determine that the particular function is in the incomplete state when saving, deletion or transmission of the particular function is not complete.

3. The mobile terminal of claim 1, wherein the controller is further configured to determine that the particular function is in the incomplete state if at least one of a task, content, target and a presence or non-presence of a final activation for the particular function is not specified.

4. The mobile terminal of claim 1, wherein the controller is further configured to display the display object on one of a home screen, a lock screen, a quick panel and a main menu.

5. The mobile terminal of claim 1, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function previously recognized before the voice recognition mode is interrupted.

6. The mobile terminal of claim 1, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function not obtained before the interruption of the voice recognition mode.

7. The mobile terminal of claim 1, wherein the controller is further configured to resume the particular function and activate the microphone when the display object is displayed on the touchscreen.

8. The mobile terminal of claim 1, wherein the controller is further configured to only resume the particular function and activate the microphone during a prescribed time starting from a timing point of initially displaying or selecting the display object.

9. The mobile terminal of claim 8, wherein the controller is further configured to change a visual effect to the display object based on an elapse of the prescribed time.

10. The mobile terminal of claim 1, wherein the controller is further configured to display a recognition result for each voice input in an active state of the voice recognition mode as a message thread.

11. The mobile terminal of claim 1, wherein the controller is further configured to resume the particular function and activate the voice recognition mode if new voice input is input through the microphone in response to the display or selection of the display object.

12. The mobile terminal of claim 11, wherein when the voice recognition mode is activated, the controller is further configured to display information on the particular function progressing before the interruption of the voice recognition mode on the touchscreen.

13. The mobile terminal of claim 1, further comprising:

an audio output unit,

wherein when the display object is displayed or selected, the controller is further configured to output audio requesting the user to input information required for completing the particular function.

14. A method of controlling a mobile terminal, the method comprising:

activating, via a controller of the mobile terminal, a voice recognition mode on the mobile terminal for receiving the voice input from a microphone of the mobile terminal;

receiving, via the microphone, the voice input, and executing, via the controller, a particular function related to the received voice input;

if the voice recognition mode is interrupted and the microphone is deactivated while the particular function is being executed, determining, via the controller, whether the particular function is in a complete state or an incomplete state;

if the particular function is in the incomplete state, displaying, via a touchscreen of the mobile terminal, a display object informing that the particular function is in the incomplete state by a deactivation of the microphone; and

activating, via the controller, the microphone for receiving additional voice input to complete the particular function when the display object is selected by a user.

15. The method of claim 14, wherein the determining step determines that the particular function is in the incomplete state when saving, deletion or transmission of the particular function is not complete.

16. The method of claim 14, wherein the determining step determines that the particular function is in the incomplete state if at least one of a task, content, target and a presence or non-presence of a final activation for the particular function is not specified.

17. The method of claim 14, wherein the displaying step displays the display object on one of a home screen, a lock screen, a quick panel and a main menu.

18. The method of claim 14, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function previously recognized before the voice recognition mode is interrupted.

19. The method of claim 14, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function not obtained before the interruption of the voice recognition mode.

20. The method of claim 14, wherein the activating step activates the microphone when the display object is displayed on the touchscreen, or resumes the particular function and activates the microphone during a prescribed time starting from a timing point of initially displaying or selecting the display object.