MOBILE TERMINAL AND CONTROLLING METHOD THEREOF

• US 20120052909A1
• Filed: 05/03/2011
• Published: 03/01/2012
• Est. Priority Date: 08/31/2010
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Joh, Jaemin, Lee, Injik, Cha, Sunhwa, Jung, Daesung
• Granted Patent: US 8,615,228 B2
• Time in Patent Office: Days
• US Class Current: 455/557
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/31 Voice input
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A mobile terminal and controlling method thereof are disclosed, by which a user can control a mobile terminal and each device connected to the mobile terminal using a speech via the mobile terminal while the mobile terminal and external digital devices are connected together via a prescribed interface. The present invention includes a display unit, a user input unit, a microphone, a communication module and a controller, when connected to at least one external device via the communication module, if a electric signal corresponding to a user'"'"'s speech command is inputted via the microphone in a speech recognition mode, recognizing the speech command by analyzing the electric signal, the controller controlling the recognized speech command to be displayed as a prescribed graphic user interface (GUI) on the display unit.

Claims

1. A mobile terminal comprising:

a display unit;

a user input unit configured to receive an input of a command from a user;

a microphone converting a speech signal to an electric signal;

a communication module configured to externally transceive a signal by wire/wireless; and

a controller, when connected to at least one external device via the communication module, if the electric signal corresponding to a user'"'"'s speech command is inputted via the microphone in a speech recognition mode, recognizing the speech command by analyzing the electric signal, the controller controlling the recognized speech command to be displayed as a prescribed graphic user interface (GUI) on the display unit.

2. The mobile terminal of claim 1, wherein the speech command includes at least one selected from the group consisting of a target content, a source device having the target content, an operation to be performed on the target content and a target device to perform the operation and wherein each of the source device and the target device is selected by the mobile terminal and the connected at least one external device.

3. The mobile terminal of claim 2, wherein the GUI includes a visual information region indicating each of the target content, the source device, the operation and the target device.

4. The mobile terminal of claim 3, wherein the visual information region includes at least one selected from the group consisting of an icon, a text and an image.

5. The mobile terminal of claim 3, wherein if the target content is recognized from the speech command, the controller performs a search for the target content on each of the mobile terminal and the connected at least one external device and then controls a result of the search to be sorted according to a prescribed reference.

6. The mobile terminal of claim 5, wherein the controller controls information on a content most proximate to the speech command in the sorted result of the search to be displayed on the visual information region corresponding to the target content.

7. The mobile terminal of claim 6, wherein the controller controls the rest of content information except the information on the most proximate content in the sorted search result to be further displayed within or in the vicinity of the visual information region corresponding to the target content.

8. The mobile terminal of claim 7, wherein if detecting an input for selecting the region for displaying the information on the most proximate content via the user input unit, the controller controls the rest of the content information to be further displayed.

9. The mobile terminal of claim 7, wherein if one of the rest of the content information is selected, the controller controls a content corresponding to the selected content information to be recognized as a new target content.

10. The mobile terminal of claim 9, wherein if the new target content is recognized, the controller determines whether the operation is executable by the target device and wherein if the operation is not executable as a result of the determination, the controller controls information on the operation executable external device among the connected at least one external device to be displayed via a prescribed region of the GUI.

11. The mobile terminal of claim 6, wherein if the visual information region corresponding to the operation is selected from the GUI, the controller controls an operation list including all operations executable on the target content by the target device to be displayed.

12. The mobile terminal of claim 11, wherein the display unit comprises a touchscreen configured to recognize a touch input, wherein if the touch input of a first pattern is detected from the visual information region corresponding to the operation on the touchscreen, the controller controls the operation list to be displayed, and wherein if the touch input of a second pattern different from the first pattern is detected from the visual information region corresponding to the operation, the controller controls the speech command displayed on the GUI to be executed.

13. The mobile terminal of claim 11, wherein the display unit comprises a touchscreen configured to recognize a touch input, wherein the visual information region corresponding to the operation is represented as a slide bar, and wherein if detecting an input of dragging the slide bar on the touchscreen in one direction over a prescribed distance, the controller controls the speech command displayed on the GUI to be executed.

14. The mobile terminal of claim 6, wherein the GUI further includes an icon for enabling a user to select whether to execute the recognized speech command and wherein if the icon is selected by an input via the user input unit, the controller controls the recognized speech command to be executed.

15. The mobile terminal of claim 6, wherein if the visual information region corresponding to the source device is selected from the GUI, the controller controls at least one of the at least one external device including the same as the most proximate target content to be displayed as a prescribed list.

16. The mobile terminal of claim 1, wherein the controller uses STT (speech to text) scheme to recognize the speech command by analyzing the electric signal.

17. A method of controlling a mobile terminal, the method comprising:

performing a connection to at least one external device via a communication module configured to externally transceive a signal by wire/wireless;

if an electric signal corresponding to a user'"'"'s speech command is inputted via a microphone in a speech recognition mode, recognizing the speech command by analyzing the electric signal; and

controlling the recognized speech command to be displayed as a prescribed graphic user interface (GUI) on a display unit.