Electronic device and method for voice recognition using a plurality of voice recognition engines

• US 10,192,557 B2
• Filed: 08/26/2014
• Issued: 01/29/2019
• Est. Priority Date: 08/26/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Sang-Hoon, Kang, Hyuk, Kim, Kyung-Tae, Je, Seong-Min, Jung, Seok-Yeong
• Primary Examiner(s): He, Jialong
• Application Number:
  US14/915,068
• Publication Number:
  US 20160217795A1
• Time in Patent Office: 1,617 Days
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/04 Training, enrolment or model building
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/24 the user being prompted to utter a password or a predefined phrase
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A method and an electronic device are provided for voice recognition. A method includes receiving a first voice by one of a first voice recognition device and a second voice recognition device; when the first voice is received by the first voice recognition device and the first voice recognition device recognizes a predetermined command in the first voice, transferring a received second voice to an external electronic device and recognizing the received second voice through the external electronic device; and when the first voice is received by the second voice recognition device and the second voice recognition device recognizes the predetermined command in the first voice, recognizing a second command in the received second voice, and performing an operation based on the recognized second command.

Claims

1. A method of performing voice recognition by an electronic device including a first voice recognition device and a second voice recognition device, the method comprising:

when an audio signal is not output from the electronic device, receiving a first voice by the first voice recognition device of the electronic device;

when an audio signal is output from the electronic device, receiving the first voice by the second voice recognition device of the electronic device;

when the first voice is received by the first voice recognition device and the first voice recognition device recognizes a predetermined command in the first voice, transferring a received second voice to an external electronic device and receiving a result of recognizing the received second voice from the external electronic device; and

when the first voice is received by the second voice recognition device and the second voice recognition device recognizes the predetermined command in the first voice, recognizing a second command in the received second voice, and performing an operation based on the recognized second command.

2. The method of claim 1, further comprising performing an operation based on the received second voice recognized by the external electronic device.

3. The method of claim 1, further comprising:

when the first voice is received by the first voice recognition device and the first voice recognition device does not recognize the predetermined command in the first voice, transferring the first voice to the second voice recognition device; and

when the first voice is transferred to the second voice recognition device, the second voice recognition device recognizes the predetermined command in the first voice, and the second voice recognition device recognizes the second command in the received second voice, performing the operation based on the recognized second command.

4. The method of claim 3, further comprising:

when the first voice is received by the first voice recognition device, the first voice recognition device recognizes the predetermined command in the first voice, and the second voice is received by the first voice recognition device, transferring the received second voice to a third voice recognition device; and

performing an operation based on the received second voice recognized by the third voice recognition device.

5. A method of performing voice recognition by an electronic device including a first voice recognition device and a second voice recognition device, the method comprising:

executing a predetermined application;

receiving a first voice for the application;

when an audio signal is not output from the electronic device, activating the first voice recognition device of the electronic device;

when an audio signal is output from the electronic device, receiving the first voice by the second voice recognition device of the electronic device;

when the first voice recognition device of the electronic device is activated and the first voice recognition device recognizes a predetermined command in the first voice, transferring a received second voice to an external electronic device and receiving a result of recognizing the received second voice from the external electronic device; and

when the first voice is received by the second voice recognition device, performing the voice recognition by the second voice recognition device, and when the second voice recognition device recognizes the predetermined command in the first voice, recognizing a second command in the received second voice, and performing an operation based on the recognized second command.

6. The method of claim 5, further comprising, when the first voice recognition device is activated and the first voice recognition device does not recognize the predetermined command in the first voice, performing an operation based on another command.

7. The method of claim 5, further comprising, when the second voice recognition device does not recognize the predetermined command in the first voice, performing an operation based on another command.

8. The method of claim 5, further comprising:

recognizing the second voice by a third voice recognition device; and

when a command related to the second voice is included in a command set, updating the command set based on the second voice.

9. The method of claim 8, further comprising, when the command related to the second voice is not included in the command set and there is a device function related to the second voice, updating the device function related to the second voice based on the second voice.

10. An electronic device comprising:

a first voice recognition device of the electronic device; and

a second voice recognition device of the electronic device,

wherein when an audio signal is not output from the electronic device, a first voice is received by the first voice recognition device of the electronic device,

wherein when an audio signal is output from the electronic device, the first voice is received by the second voice recognition device of the electronic device,

wherein when a first voice is received by the first voice recognition device and the first voice recognition device recognizes a predetermined command in the first voice, the first voice recognition device transfers a received second voice to an external electronic device and receives a result of recognizing the received second voice from the external electronic device, and

wherein when the first voice is received by the second voice recognition device and the second voice recognition device recognizes the predetermined command in the first voice, the second voice recognition device recognizes a second command in the received second voice, and performs an operation based on the recognized second command.

11. The electronic device of claim 10, wherein first voice recognition device performs an operation based on the received second voice recognized by the external electronic device.

12. The electronic device of claim 10, wherein when the first voice is received by the first voice recognition device and the first voice recognition device does not recognize the predetermined command in the first voice, the first voice recognition device transfers the first voice to the second voice recognition device, and

wherein when the first voice is transferred to the second voice recognition device, the second voice recognition device recognizes the predetermined command in the first voice, and the second voice recognition device recognizes the second command in the received second voice, the second voice recognition device performs the operation based on the recognized second command.

13. The electronic device of claim 12, wherein when the first voice is transferred to the second voice recognition device, the second voice recognition device recognizes the predetermined command in the first voice, and the second voice recognition device does not recognize the second command in the received second voice, the second voice recognition device transfers the received second voice to a third voice recognition device and performs an operation based on the second voice recognized by the third voice recognition device,

wherein the electronic device comprises at least one storage unit which stores at least one voice recognition model to recognize the predetermined command.

14. An electronic device comprising:

a first voice recognition device of the electronic device;

a second voice recognition device of the electronic device; and

a processor configured for;

executing a predetermined application,

when an audio signal is not output from the electronic device, activating the first voice recognition device of the electronic device, and

when an audio signal is output from the electronic device, receiving the first voice by the second voice recognition device of the electronic device,

wherein when the first voice recognition device is activated and the first voice recognition device recognizes a predetermined command in the first voice, the first voice recognition device transfers a received second voice to an external electronic device and receives a result of recognizing the received second voice from the external electronic device; and

wherein when the first voice is received by the second voice recognition device, the second voice recognition device performs the voice recognition, and when the second voice recognition device recognizes the predetermined command in the first voice, the second voice recognition device recognizes a second command in the received second voice and performs an operation based on the recognized second command.

15. The electronic device of claim 14, wherein when the first voice recognition device is activated and the first voice recognition device does not recognize the predetermined command in the first voice, the first voice recognition device performs an operation based on another command.

16. The electronic device of claim 14, wherein when the second voice recognition device does not recognize the predetermined command in the first voice, the first voice recognition device performs an operation based on another command.

17. The electronic device of claim 14, further comprising a third voice recognition device that determines whether a command related to the second voice is included in a command set, and when the command related to the received second voice is included in the command set, updates the command set based on the received second voice.

18. The electronic device of claim 17, wherein when the command related to the second voice is not included in the command set and there is a device function related to the second voice, the third voice recognition device updates the device function related to the received second voice based on the received second voice.

19. A non-transitory computer-readable recording medium storing commands, the computer-readable recording medium having a program recorded therein to execute operations of a first voice recognition device of the electronic device and a second voice recognition device of the electronic device, the operations comprising:

when an audio signal is not output from the electronic device, receiving a first voice by the first voice recognition device;

when an audio signal is output from the electronic device, receiving the first voice by the second voice recognition device of the electronic device;

when the first voice is received by the first voice recognition device and the first voice recognition device recognizes a predetermined command in the first voice, transferring a received second voice to an external electronic device and receiving a result of recognizing the received second voice from the external electronic device; and

when the first voice is received by the second voice recognition device and the second voice recognition device recognizes the predetermined command in the first voice, recognizing a second command in the received second voice, and performing an operation based on the recognized second command.

20. A non-transitory computer-readable recording medium for executing operations of a first voice recognition device and a second voice recognition device, the operations comprising:

executing a predetermined application;

receiving a first voice for the application;

when an audio signal is not output from the electronic device, activating the first voice recognition device of the electronic device;

when an audio signal is output from the electronic device, receiving the first voice by the second voice recognition device of the electronic device;

when the first voice recognition device of the electronic device is activated and the first voice recognition device recognizes a predetermined command in the first voice, transferring a received second voice to an external electronic device and receiving a result of recognizing the received second voice from the external electronic device; and

when the first voice is received by the second voice recognition device, performing the voice recognition by the second voice recognition device, and when the second voice recognition device recognizes the predetermined command in the first voice, recognizing a second command in the received second voice, and performing an operation based on the recognized second command.