ELECTRONIC DEVICE AND CONTROL METHOD THEREOF

• US 20200135202A1
• Filed: 12/27/2019
• Published: 04/30/2020
• Est. Priority Date: 10/12/2016
• Status: Active Grant

• Current Assignee: Hisense Visual Technology Co., Ltd. (Qingdao Huatong State-Owned Capital Operation (Group) Co., Ltd.)
• Original Assignee: Qingdao Hisense Electronics Co., Ltd. (Qingdao Huatong State-Owned Capital Operation (Group) Co., Ltd.), Toshiba Visual Solutions Corporation (Toshiba Corporation)
• Inventors: ZAWA, Hidehito, KAWACHI, Reiko, HONSAWA, Kunio, NOMOTO, Hiroyuki
• Granted Patent: US 11,404,060 B2
• Time in Patent Office: Days
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context

Abstract

According to one embodiment, an electronic device determines whether one or more devices should be controlled based on a second utterance input subsequent to a first utterance input from outside in accordance with the first utterance. The electronic device includes a management unit and a controller. The management unit prepares and manages a determination audio data item for determining whether the first utterance is a desired utterance by utterances input from outside at a plurality of times, and determines whether the first utterance is the desired utterance using the prepared and managed determination audio data item. The controller controls the one or more devices based on the second utterance.

Claims

1. An electronic device comprising:

a management unit configured to prepare and manage a voice command triggering audio data item for determining whether a first external utterance input is a desired utterance, and to determine whether the first external utterance is the desired utterance using the prepared and managed voice command triggering audio data item; and

a controller configured to control one or more devices based on a second external utterance input subsequent to the first external utterance input in response to the management unit determines that the first external utterance is the desired utterance,

wherein the management unit is further configured to receive a third external utterance input, and wherein, in response to the third external utterance being received after the second external utterance within a predetermined time threshold, the controller is further configured to interpret the third external utterance as a control content and to control the one or more devices based on the third external utterance.

2. The electronic device according to claim 1, wherein the controller is further configured to determine whether the third external utterance is the desired utterance in response to that the third external utterance is received after the second external utterance outside the predetermined time threshold.

3. The electronic device according to claim 1, wherein the one or more devices controlled by the controller based on the second external utterance are in connection with the electronic device via a network.

4. The electronic device according to claim 1, wherein the controller is further configured to determine whether the first external utterance is the desired utterance by:

receiving the first external utterance;

reading voice recognition reference data;

comparing the voice recognition reference data with the first external utterance;

in response to the first external utterance being recognized as a reserved expression, determining a recognition probability; and

in response to the recognition probability being less than a first threshold, prompting for more external utterance input.

5. The electronic device according to claim 1, further comprising a display unit configured to display a result of determination of the management unit, wherein the said determination comprises determining that the first external utterance is the desired utterance using the voice command triggering audio data item.

6. The electronic device according to claim 1, further comprising an output unit configured to output a result of determination of the management unit by sound, wherein the said determination comprises determining that the first external utterance is the desired utterance using the voice command triggering audio data item.

7. The electronic device according to claim 1, further comprising a selection unit for selecting a type of speech recognition dictionary used for analyzing the first external utterance, wherein the selection unit is configured to determine the type of speech recognition dictionary in accordance with a state of the electronic device.

8. The electronic device according to claim 1, further comprising a selection unit for selecting a type of speech recognition dictionary used for analyzing the second external utterance, wherein the selection unit is configured to determine the type of speech recognition dictionary in accordance with a state of the electronic device.

9. The electronic device according to claim 1, further comprising a selection unit for selecting a type of speech recognition dictionary used for analyzing the third external utterance, wherein the selection unit is configured to determine the type of speech recognition dictionary in accordance with a state of the electronic device.

10. A control method of an electronic device comprising:

receiving a first external utterance input;

determining whether the first external utterance is a desired utterance based on a predefined voice command triggering audio data item;

in response to the first external utterance being the desired utterance, controlling one or more devices based on a second external utterance input subsequent to the first external utterance input;

receiving a third external utterance input; and

in response to the third external utterance being received after the second external utterance within a predetermined time threshold, interpreting the third external utterance as a control content and controlling the one or more devices based on the third external utterance.

11. The method according to claim 10, further comprising:

in response to that the third external utterance is received after the second external utterance outside the predetermined time threshold, determining whether the third external utterance is the desired utterance.

12. The method according to claim 10, wherein determining whether the first external utterance is the desired utterance comprises:

receiving the first external utterance;

reading voice recognition reference data;

comparing the voice recognition reference data with the first external utterance;

in response to the first external utterance being recognized as a reserved expression, determining a recognition probability; and

in response to the recognition probability being less than a first threshold, prompting for more external utterance input.

13. The method according to claim 10, further comprising:

displaying a result of the determination that the first external utterance is the desired utterance using the predefined voice command triggering audio data item.

14. The method according to claim 10, further comprising:

outputting a result of the determination that the first external utterance is the desired utterance using the predefined voice command triggering audio data item by sound.

15. The method according to claim 10, further comprising:

selecting a type of speech recognition dictionary used for analyzing the first external utterance in accordance with a state of the electronic device.

16. The method according to claim 10, further comprising:

selecting a type of speech recognition dictionary used for analyzing the second external utterance in accordance with a state of the electronic device.

17. The method according to claim 10, further comprising:

selecting a type of speech recognition dictionary used for analyzing the third external utterance in accordance with a state of the electronic device.