Display apparatus, voice acquiring apparatus and voice recognition method thereof

• US 10,586,554 B2
• Filed: 08/08/2017
• Issued: 03/10/2020
• Est. Priority Date: 11/09/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jang, Jong-hyuk, Choi, Chan-hee, Ryu, Hee-seob, Park, Kyung-mi, Park, Seung-kwon, Bae, Jae-hyun
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US15/671,178
• Publication Number:
  US 20170337937A1
• Time in Patent Office: 945 Days
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/485 End-user interface for client configuration

Abstract

Disclosed are a display apparatus, a voice acquiring apparatus and a voice recognition method thereof, the display apparatus including: a display unit which displays an image; a communication unit which communicates with a plurality of external apparatuses; and a controller which includes a voice recognition engine to recognize a user'"'"'s voice, receives a voice signal from a voice acquiring unit, and controls the communication unit to receive candidate instruction words from at least one of the plurality of external apparatuses to recognize the received voice signal.

Claims

1. A display apparatus comprising:

a display;

a storage;

a communicator comprising circuitry configured to communicate with an external apparatus; and

a processor configured to;

obtain a plurality of instruction words corresponding to at least one application;

control the storage to store the obtained plurality of instruction words;

register, as candidate instruction words, in a voice recognition program, the plurality of instruction words stored in the storage;

based on a wakeup keyword being received from one of a first external voice acquiring unit and a second external voice acquiring unit, enable reception of a voice signal from the one of the first external voice acquiring unit and the second external voice acquiring unit from which the wakeup keyword is received, and disable reception of a voice signal from remaining one of the first external voice acquiring unit and the second external voice acquiring unit;

based on a voice signal being received from the enabled one of the first external voice acquiring unit and the second external voice acquiring unit, perform a voice recognition process using the voice recognition program, to recognize an instruction word corresponding to the received voice signal, among the registered candidate instruction words;

identify one of the at least one application to perform the recognized instruction word; and

perform a control operation for the identified one of the at least one application to operate based on the recognized instruction word.

2. The display apparatus according to claim 1, wherein the at least one application is stored in the external apparatus.

3. The display apparatus according to claim 1, wherein the at least one application comprises the plurality of instruction words.

4. The display apparatus according to claim 1, wherein the plurality of instruction words corresponding to the at least one application is obtained from the external apparatus corresponding to the at least one application or from a server.

5. The display apparatus according to claim 1, wherein the processor is further configured to, based on the voice recognition process failing, identify another application, based on a user input.

6. The display apparatus according to claim 1, wherein the processor is further configured to, based on a memory state of the storage, control the storage to delete the stored plurality of instruction words.

7. The display apparatus according to claim 1, wherein the wakeup keyword is input by a manipulation of a predetermined button that is provided in the one of the first external voice acquiring unit and the second external voice acquiring unit.

8. The display apparatus according to claim 1, wherein the processor is further configured to, based on the voice signal being received from the enabled one of the first external voice acquiring unit and the second external voice acquiring unit:

identify, using the voice recognition program, whether at least one among the registered candidate instruction words corresponding to a first one of the at least one application is identical or similar to the instruction word corresponding to the received voice signal;

based on the at least one among the registered candidate instruction words corresponding to the first one of the at least one application being identified to be identical or similar to the instruction word, control the display to display a voice recognition result indicating that the at least one among the registered candidate instruction words corresponding to the first one of the at least one application is identified to be identical or similar to the instruction word; and

based on the at least one among the registered candidate instruction words corresponding to the first one of the at least one application being identified to be not identical or similar to the instruction word, identify, using the voice recognition program, whether at least one among the registered candidate instruction words corresponding to a second one of the at least one application is identical or similar to the instruction word corresponding to the received voice signal.

9. A voice recognition method of a display apparatus, the method comprising:

obtaining a plurality of instruction words corresponding to at least one application;

storing the obtained plurality of instruction words;

registering, as candidate instruction words, in a voice recognition program, the stored plurality of instruction words;

based on a wakeup keyword being received from one of a first external voice acquiring unit and a second external voice acquiring unit, enabling reception of a voice signal from the one of the first external voice acquiring unit and the second external voice acquiring unit from which the wakeup keyword is received, and disabling reception of a voice signal from remaining one of the first external voice acquiring unit and the second external voice acquiring unit;

based on a voice signal being received from the enabled one of the first external voice acquiring unit and the second external voice acquiring unit, performing a voice recognition process using the voice recognition program, to recognize an instruction word corresponding to the received voice signal, among the registered candidate instruction words;

identifying one of the at least one application to perform the recognized instruction word; and

performing a control operation for the identified one of the at least one application to operate based on the recognized instruction word.

10. The method according to claim 9, wherein the at least one application is stored in an external apparatus.

11. The method according to claim 9, wherein the at least one application comprises the plurality of instruction words.

12. The method according to claim 9, wherein the plurality of instruction words corresponding to the at least one application is obtained from an external apparatus corresponding to the at least one application or from a server.

13. The method according to claim 9, further comprising, based on the voice recognition process failing, identifying another application, based on a user input.

14. The method according to claim 9, further comprising, based on a memory state of a storage storing the plurality of instruction words, deleting the stored plurality of instruction words.

15. A display apparatus comprising:

a display;

a communicator comprising circuitry configured to communicate with a plurality of external apparatus; and

a processor configured to;

obtain a plurality of instruction words corresponding to at least one application;

register, as candidate instruction words, in a voice recognition program, the plurality of instruction words;

based on a wakeup keyword being received from a voice acquiring unit, enable reception of a voice signal from the voice acquiring unit from which the wakeup keyword is received, and disable reception of a voice signal which is successively received from another voice acquiring unit;

based on the received voice signal from the voice acquiring unit, perform a voice recognition process using the voice recognition program, to recognize an instruction word corresponding to the received voice signal, among the registered candidate instruction words;

identify one of the at least one application to perform the recognized instruction word;

perform a control operation for the identified one of the at least one application to operate based on the recognized instruction word; and

display a voice recognition result indicating that the at least one among the registered candidate instruction words corresponding to the first one of the at least one application.

16. The display apparatus according to claim 15, wherein the wakeup keyword is input by a manipulation of a predetermined button that is provided in the voice acquiring unit.

17. The display apparatus according to claim 15, wherein the processor is further configured to, based on the voice signal being received from the voice acquiring unit, identify, using the voice recognition program, whether at least one among the registered candidate instruction words corresponding to a first one of the at least one application is identical or similar to the instruction word corresponding to the received voice signal.

18. The display apparatus according to claim 15, wherein the processor is further configured to, based on the voice signal being received from the voice acquiring unit, and based on the at least one among the registered candidate instruction words corresponding to the first one of the at least one application being identified to be not identical or similar to the instruction word, identify, using the voice recognition program, whether at least one among the registered candidate instruction words corresponding to a second one of the at least one application is identical or similar to the instruction word corresponding to the received voice signal.