System for controlling device, digital device, and method for controlling same

• US 10,063,905 B2
• Filed: 06/01/2015
• Issued: 08/28/2018
• Est. Priority Date: 11/26/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Jeong, Hyeryoung, Heo, Seunghyun, Han, Joonghee, Lee, Hyangjin, Kim, Mingi
• Primary Examiner(s): Lee, Michael
• Application Number:
  US15/531,388
• Publication Number:
  US 20170332128A1
• Time in Patent Office: 1,184 Days
• Field of Search: 348734
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 5/44504 Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits
• CPC Class Codes: H04N 5/50 Tuning indicators; Automatic tuning control

Abstract

A digital device and a method for controlling the digital device are disclosed in this specification. Herein, according to an exemplary embodiment of the present invention, a targeted device being controlled by a control command received through at least one or more controlling devices includes a first receiving unit receiving content, a second receiving unit receiving a voice signal or text data respective to the voice signal from the controlling device, a decoder decoding the content, a processing unit processing the text data, a controlling unit identifying whether or not text data received from the processing data include a control command, controlling an output of a voice interface in response to a reception of the identified text data, configuring a result screen respective to the processed data and controlling an output of the result screen, and performing control operations so as to execute functions corresponding to the outputted result screen, and an outputting unit outputting the decoded content, the voice interface and its result screen or its function execution screen.

Claims

1. A targeted device being controlled by a control command received through at least one or more controlling devices, the targeted device comprises:

a first receiving unit receiving content for a Miracast service from a mobile terminal;

a second receiving unit receiving a voice signal or text data respective to the voice signal for a voice recognition service from a wearable device wherein the voice signal or the text data is transmitted from the wearable device to the targeted device via a mobile terminal;

a decoder decoding the content;

a processing unit processing the text data;

a controlling unit;

identifying whether text data received from the processed text data includes a control command,

controlling an output of a voice interface in response to a reception of the received text data,

configuring a result screen respective to the processed text data and controlling an output of the result screen, and

performing control operations so as to execute functions corresponding to the outputted result screen; and

an outputting unit outputting the decoded content, the voice interface and the result screen or a function execution screen.

2. The targeted device of claim 1, wherein the targeted device includes a Bluetooth manager so as to be connected to the at least one or more controlling devices through a Bluetooth communication protocol.

3. The targeted device of claim 2, wherein the processing unit performs STT (Speech to Text) and NLP (Natural Language Processing) processing when a voice signal is received from the controlling device, and wherein the processing unit performs only NLP processing when text data respective to the voice signal is received.

4. The targeted device of claim 1, wherein the controlling unit determines whether or not a control command of a voice signal or text data is included based upon identification information included in the voice signal or the text data respective to the voice signal received from the controlling device.

5. The targeted device of claim 1, wherein, when the outputting unit is outputting content, the controlling unit performs control operations so as to output the result screen and the function execution screen by dividing a screen and outputting the result screen and the function execution screen on any one of the divided screens or by overlaying the result screen and the function execution screen on a predetermined portion of the screen on which the content is being outputted.

6. The targeted device of claim 1, wherein, when the processed data is related to an execution of a specific function, the controlling unit determines whether or not a resource related to at least one or more function blocks is available for usage, the resource being required for performing the corresponding function, and, based upon the determined result, if the resource is available for usage, the controlling unit calls the corresponding function block.

7. The targeted device of claim 1, wherein, when the processed data correspond to a text message that is not related to an execution of a function, the controlling unit allocates a resource for providing an interactive service, collects user history data associated with the text message, and provides an interactive service including content recommendation.

8. The targeted device of claim 1, wherein the targeted device corresponds to a digital TV, and wherein the at least one or more controlling devices include at least one of wearable devices and mobile terminals.

9. A method for controlling a targeted device by a control command received through at least one or more controlling devices, the method comprising:

receiving content for a Miracast service from a mobile terminal;

decoding the content and outputting the decoded content to a screen;

receiving a voice signal or text data respective to the voice signal for a voice recognition service from a wearable device wherein the voice signal or the text data is transmitted from the wearable device to the targeted device via a mobile terminal;

processing the received voice signal or text data;

identifying whether a control command is included in the processed data and outputting a voice interface;

configuring and outputting a result screen respective to the control command included in the processed data;

executing functions corresponding to the outputted result screen; and

outputting a function execution screen.

10. The method of claim 9, wherein connection is established with the at least one or more controlling devices through a Bluetooth communication protocol.

11. The method of claim 10, wherein STT (Speech to Text) and NLP (Natural Language Processing) processing is performed when a voice signal is received from the controlling device, and wherein only NLP processing is performed when text data respective to the voice signal is received.

12. The method of claim 9, wherein whether or not a control command of a voice signal or text data is included is determined based upon identification information included in the voice signal or the text data respective to the voice signal received from the controlling device.

13. The method of claim 9, wherein the result screen and the function execution screen are outputted by dividing a screen on which the content is being outputted and outputting the result screen and the function execution screen on any one of the divided screens or by overlaying the result screen and the function execution screen on a predetermined portion of the screen on which the content is being outputted.

14. The method of claim 9, wherein, when the processed data is related to an execution of a specific function, whether or not a resource related to at least one or more function blocks is available for usage is determined, the resource being required for performing the corresponding function, and, based upon the determined result, if the resource is available for usage, the corresponding function block is called.

15. The method of claim 9, wherein, when the processed data correspond to a text message that is not related to an execution of a function, a resource for providing an interactive service is allocated, user history data associated with the text message are collected, and an interactive service including content recommendation is provided.

16. The method of claim 9, wherein the targeted device corresponds to a digital TV, and wherein the at least one or more controlling devices include at least one of wearable devices and mobile terminals.