MOBILE TERMINAL AND CONTROLLING METHOD THEREOF

• US 20140142953A1
• Filed: 11/20/2013
• Published: 05/22/2014
• Est. Priority Date: 11/20/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: KIM, Jonghwan, JEONG, Hojoong
• Granted Patent: US 9,460,717 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/225 Feedback of the input speech

Abstract

A mobile terminal including a microphone configured to receive a voice input; a touchscreen configured to display information; and a controller configured to activate a voice recognition mode on the mobile terminal for receiving the voice input from the microphone, receive the voice input indicating a particular function on the mobile terminal is to be executed, execute the particular function indicated by the received voice input, if the voice recognition mode is interrupted while the particular function is being executed, determine whether the particular function is in a complete state or an incomplete state, if the particular function is in the incomplete state, display a display object corresponding to the particular function in the incomplete state, and resume the particular function and activate the microphone for receiving additional voice input to complete the particular function.

Claims

1. A mobile terminal comprising:

a microphone configured to receive a voice input;

a touchscreen configured to display information; and

a controller configured to;

activate a voice recognition mode on the mobile terminal for receiving the voice input from the microphone,

receive the voice input indicating a particular function on the mobile terminal is to be executed,

execute the particular function indicated by the received voice input,

if the voice recognition mode is interrupted while the particular function is being executed, determine whether the particular function is in a complete state or an incomplete state,

if the particular function is in the incomplete state, display a display object corresponding to the particular function in the incomplete state, and

resume the particular function and activate the microphone for receiving additional voice input to complete the particular function.

2. The mobile terminal of claim 1, wherein the controller is further configured to determine that the particular function is in the incomplete state when saving, deletion or transmission of the particular function is not complete.

3. The mobile terminal of claim 1, wherein the controller is further configured to determine that the particular function is in the incomplete state if at least one of a task, content, target and a presence or non-presence of a final activation for the particular function is not specified.

4. The mobile terminal of claim 1, wherein the controller is further configured to display the display object on one of a home screen, a lock screen, a quick panel and a main menu.

5. The mobile terminal of claim 1, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function previously recognized before the voice recognition mode is interrupted.

6. The mobile terminal of claim 1, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function not obtained before the interruption of the voice recognition mode.

7. The mobile terminal of claim 1, wherein the controller is further configured to only resume the particular function and activate the microphone when the display object is displayed or selected.

8. The mobile terminal of claim 1, wherein the controller is further configured to only resume the particular function and activate the microphone during a prescribed time starting from a timing point of initially displaying or selecting the display object.

9. The mobile terminal of claim 8, wherein the controller is further configured to change a visual effect to the display object based on an elapse of the prescribed time.

10. The mobile terminal of claim 1, wherein the controller is further configured to display a recognition result for each voice input in an active state of the voice recognition mode as a message thread.

11. The mobile terminal of claim 1, wherein the controller is further configured to resume the particular function and activate the voice recognition mode if new voice input is input through the microphone in response to the display or selection of the display object.

12. The mobile terminal of claim 11, wherein when the voice recognition mode is activated, the controller is further configured to display information on the particular function progressing before the interruption of the voice recognition mode on the touchscreen.

13. The mobile terminal of claim 1, further comprising:

an audio output unit,

wherein when the display object is displayed or selected, the controller is further configured to output audio requesting a user to input information required for completing the particular function.

14. A method of controlling a mobile terminal, the method comprising:

receiving, via a microphone of the mobile terminal, a voice input;

activating, via a controller of the mobile terminal, a voice recognition mode on the mobile terminal for receiving the voice input from the microphone;

receiving, via the controller, the voice input indicating a particular function on the mobile terminal is to be executed;

executing, via the controller, the particular function indicated by the received voice input;

if the voice recognition mode is interrupted while the particular function is being executed, determining, via the controller, whether the particular function is in a complete state or an incomplete state;

if the particular function is in the incomplete state, displaying, via a touchscreen of the mobile terminal, a display object corresponding to the particular function in the incomplete state; and

resuming, via the controller, the particular function and activating the microphone for receiving additional voice input to complete the particular function.

15. The method of claim 14, wherein the determining step determines that the particular function is in the incomplete state when saving, deletion or transmission of the particular function is not complete.

16. The method of claim 14, wherein the determining step determines that the particular function is in the incomplete state if at least one of a task, content, target and a presence or non-presence of a final activation for the particular function is not specified.

17. The method of claim 14, wherein the displaying step displays the display object on one of a home screen, a lock screen, a quick panel and a main menu.

18. The method of claim 14, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function previously recognized before the voice recognition mode is interrupted.

19. The method of claim 14, wherein the display object includes at least one of text, an image and an icon for indicating information about the particular function not obtained before the interruption of the voice recognition mode.

20. The method of claim 14, wherein the resuming step only resumes the particular function and activates the microphone when the display object is displayed or selected, or only resumes the particular function and activates the microphone during a prescribed time starting from a timing point of initially displaying or selecting the display object.