Smart controlling device and method of controlling therefor

• US 10,489,111 B2
• Filed: 11/16/2017
• Issued: 11/26/2019
• Est. Priority Date: 03/28/2017
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Jeong, Gyuhyeok
• Primary Examiner(s): Albertalli, Brian L
• Application Number:
  US15/815,491
• Publication Number:
  US 20180285065A1
• Time in Patent Office: 740 Days
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/02 Neural networks
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

The present specification relates to a smart controlling device capable of utilizing machine learning for voice recognition and a method of controlling therefor. The smart controlling device according to the present invention includes a receiver configured to receive an input including a command trigger, and a controller configured to detect one or more external display devices, select a display device of the detected one or more external display devices, cause a power status of the selected display device to be changed to a first state, and cause a response data corresponding to a first command data received after the command trigger to be output on a display of the selected display device.

Claims

1. A smart controlling device, comprising:

a receiver configured to receive an input comprising a command trigger;

a communication interface configured to transceive data with an external device; and

a controller configured to;

detect one or more external display devices;

select a display device of the detected one or more external display devices;

cause a power status of the selected display device to be changed to a first state; and

cause a response data corresponding to a first command data received after the command trigger to be output on a display of the selected display device,

wherein the controller is further configured to;

detect the power status of the display of the selected display device; and

when the power status of the display of the selected display device corresponds to a power-off status, cause the communication interface to transmit a control command to change the power status of the display of the selected display device from the power-off status to a stand-by status.

2. The smart controlling device of claim 1, wherein the controller is further configured to generate the response data based on the first command data.

3. The smart controlling device of claim 1, wherein the received input corresponds to a first voice input and the controller is further configured to obtain a first location of a speaker of the first voice input based on the received input.

4. The smart controlling device of claim 3, wherein the controller is further configured to select the selected display device from the detected one or more external display devices based on at least the first location of the speaker.

5. The smart controlling device of claim 4, wherein the controller is further configured to select the selected display device which is located closest to the first location of the speaker among the detected one or more external display devices.

6. The smart controlling device of claim 1, wherein the controller is further configured to select the selected display device based on an attribute of the command trigger, an attribute of the first command data, an attribute of the response data, a location of a source of the received input, a direction of the source of the received input, an attribute of the selected display device, a display size of the selected display device, or a current power status of the selected display device.

7. The smart controlling device of claim 1, wherein the controller is further configured to transmit a control command to change the power status of the selected display device from the first state to a second state when the response data is required to be output via a display.

8. The smart controlling device of claim 7, wherein the controller is further configured to transmit the response data to the selected display device for displaying the response data via a display of the selected display device.

9. The smart controlling device of claim 1, wherein the controller is further configured to transmit a control command to change the power status of the selected display device from the first state to a previous state when the response data is not required to be output via a display.

10. The smart controlling device of claim 4, wherein the controller is further configured to:

when at least one external display device is not detected within a first range based on the first location of the speaker, detect the at least one external display device by expanding the first range to a second range.

11. The smart controlling device of claim 1, wherein the controller is further configured to transmit a control command to the selected display device to cancel changing the power status of the selected display device when the first command data is not received within a threshold period of time following the command trigger.

12. The smart controlling device of claim 3, wherein the controller is further configured to generate second response data corresponding to second command data when the second command data is received with a threshold period of time after the first command data is received or when the second command data is received within the threshold period of time after the response data corresponding to the first command data is output at the selected display device.

13. The smart controlling device of claim 12, wherein the second command data corresponds to a second voice input and controller is further configured to:

obtain a second location of a speaker of the second voice input; and

cause the generated second response data to be output at the selected display device when the second location of the speaker is within a threshold distance from the first location of the speaker.

14. The smart controlling device of claim 12, wherein the second command data corresponds to a second voice input and controller is further configured to:

obtain a second location of a speaker of the second voice input;

change the power status of the selected display device from the first state to a previous state when the second location of the speaker is not within a threshold distance from the first location of the speaker;

select another display device from the one or more detected external display devices; and

cause the generated second response data to be output at the selected another display device.

15. The smart controlling device of claim 1, wherein at least two external display devices are detected and the controller is further configured to select the selected display device based on the first command data and a functionality of the selected display device.

16. The smart controlling device of claim 1, wherein the command trigger corresponds to a voice input, a text input, or a motion gesture.

17. The smart controlling device of claim 1, further comprising an output unit, wherein the controller is further configured to output an indicator via the output unit to indicate that the response data is being output at the selected display device.

18. A method of controlling a smart controlling device, the method comprising:

receiving, via a receiver, an input comprising a command trigger;

detecting a location of a source of the received input;

detecting one or more external display devices based on the detected location;

selecting a display device from the detected one or more external display devices;

causing a power status of the selected display device to be changed to a first state; and

causing a response data corresponding to a first command data received after the command trigger to be output on a display of the selected display device,

wherein the method further comprises;

detecting the power status of the display of the selected display device; and

when the power status of the display of the selected display device corresponds to a power-off status, transmitting a control command to change the power status of the display of the selected display device from the power-off status to a stand-by status.