Mobile phone with variable energy consuming speech recognition module

• US 9,251,806 B2
• Filed: 09/05/2013
• Issued: 02/02/2016
• Est. Priority Date: 09/05/2013
• Status: Active Grant

• Current Assignee: Ear And Skull Base Center, Inc.
• Original Assignee: Intel Corporation
• Inventors: Shah, Saurin, Bramlett, Brian W., Dadu, Saurabh, Kar, Swarnendu, Vogel, Brian K.
• Primary Examiner(s): Trinh, Tan H
• Application Number:
  US14/127,094
• Publication Number:
  US 20150065199A1
• Time in Patent Office: 880 Days
• Field of Search: 455/563, 455/508, 455/501, 455/41.2, 455/41.1, 455/41.3, 455/60, 455/63.1, 455/67.13, 455/72, 455/76, 455/79, 455/570, 455/135, 704/233, 704/215, 704/216, 704/217, 704/218, 704/240, 704/227, 704/201, 704/226, 704/246, 379/406.03, 379/88.04, 379/88.07, 379/406.01, 379/406.08, 379/406.06, 379/88.22, 370/286, 370/290, 725/92, 381/110, 348/14.08
• US Class Current: 1/1
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04W 52/0254 detecting a user operation or a tactile contact or a motion of the device
• CPC Class Codes: H04W 52/028 switching on or off only a part of the equipment circuit blocks
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

Apparatus, computer-readable storage medium, and method associated with speech recognition are described. In embodiments, a mobile phone may include a processor; and a speech recognition module coupled with the processor. The voice recognition module may be configured to recognize one or more voice commands and may include first echo cancellation logic and second echo cancellation logic to be selectively employed during recognition of voice commands. Employment of the first and second echo cancellation logic respectively may cause the mobile phone to variably consume a first and second amount of energy, with the second amount of energy being less than the first amount energy.

Claims

1. A mobile phone comprising:

a processor; and

a speech recognition module coupled with the processor, wherein the speech recognition module is to recognize one or more voice commands and includes first echo cancellation logic and second echo cancellation logic to be selectively employed, either the first echo cancellation logic or the second echo cancellation logic, during recognition of voice commands, and wherein employment of the first echo cancellation logic causes the mobile phone to consume a first amount of energy to recognize a first of the one or more voice commands, and employment of the second echo cancellation logic causes the mobile phone to consume a second amount of energy to recognize the first command, with the second amount of energy being less than the first amount energy.

2. The mobile phone of claim 1, wherein the first and second echo cancellation logic are to respectively operate at first and second sampling rate, with the second sampling rate being a lower sampling rate than the first sampling rate.

3. The mobile phone of claim 1, wherein the first echo cancellation logic includes non-linear processing logic and the second echo cancellation logic omits the non-linear processing logic.

4. The mobile phone of claim 1, wherein the speech recognition module is to further determine a rendering delay between when an audio stream is processed by the mobile phone and when the audio stream is rendered by a remote speaker coupled with the mobile phone;

wherein the first and second echo cancellation logic are to incorporate the rendering delay into one or more calculations.

5. The mobile phone of claim 1, wherein the speech recognition module is to employ the second echo cancellation logic, while the mobile phone is in a low power state.

6. The mobile phone of claim 1, wherein the mobile phone further comprises a speaker and a microphone, wherein the speech recognition module is further coupled with both the speaker and the microphone, and to employ the second echo cancellation logic whenever the speaker is not outputting audio contemporaneously captured by the microphone.

7. The mobile phone of claim 1, wherein the speech recognition module is to further selectively initiate a private mode or a group mode of a conversational user interface (CUI) of the mobile phone;

wherein the speech recognition module is to initiate the private mode CUI in response to a voice trigger, while the user has placed a voice call on hold, and the speech recognition module is to initiate the group mode CUI in response to the voice trigger, while the user is engaged in a video call with one or more participants.

8. The mobile phone of claim 7, wherein the private mode CUI is to receive commands from the user, and exclude the one or more participants from interaction with the CUI, and the group mode CUI is to receive commands from any of the one or more participants, as well as the user, in interaction with the CUI.

9. One or more non-transitory computer-readable media having instructions stored thereon which, when executed by a mobile phone provide the mobile phone with a speech recognition module to:

receive a voice trigger;

determine whether the voice trigger is received while the user has placed a voice call on hold, or while the user is engaged in a video call with one or more participants;

initiate a private mode of a conversational user interface (CUI), having the private mode and a group mode of operation, if a result of the determination indicates the voice trigger is received while the user has placed a voice call on hold; and

initiate the group mode of the CUI if a result of the determination indicates the voice trigger is received while the user is engaged in a video call with one or more participants.

10. The one or more non-transitory computer-readable media of claim 9, wherein the private mode CUI is to receive commands from the user, and exclude the one or more participants from interaction with the private mode CUI, and the group mode CUI is to receive commands from any one of the one or more participants and the user to interact with the group mode CUI.

11. The one or more computer-readable media of claim 9, further comprising, selective employment of one of first and second echo cancellation logic wherein the first and second echo cancellation logic respectively cause the mobile phone to consume first and second amount of energy to recognize a command, with the second amount of energy being less than the first amount energy.

12. The one or more computer-readable media of claim 11, wherein the first and second echo cancellation logic are to respectively operate at a first and second sampling rate, with the second sampling rate being a lower sampling rate than the first sampling rate.

13. The one or more non-transitory computer-readable media of claim 11, wherein the first echo cancellation logic includes non-linear processing logic and the second echo cancellation logic omits the non-linear processing logic.

14. The one or more non-transitory computer-readable media of claim 11, wherein the speech recognition module is to further:

determine a rendering delay between when an audio stream is processed by the mobile phone and when the audio stream is rendered by a remote speaker coupled with the mobile phone; and

incorporate the rendering delay into first and second echo cancellation logic.

15. The one or more non-transitory computer-readable media of claim 11, wherein the speech recognition module is to further employ the second echo cancellation logic, while the mobile phone is in a low power state.

16. The one or more non-transitory computer-readable media of claim 11, wherein the speech recognition module is to further employ the second echo cancellation logic whenever a speaker of the mobile phone is not outputting audio contemporaneously captured by a microphone of the mobile phone.

17. A computer-implemented method comprising:

initiating, by a speech recognition module of a mobile phone, a private mode of a conversational user interface (CUI), having the private mode and a group mode of operation, in response to a voice trigger, while a user of the mobile phone has placed a voice call on hold, or initiating the group mode of the CUI in response to the voice trigger, while the user is engaged in a video call with one or more participants; and

selectively employing, by the speech recognition module, one of first echo cancellation logic and second echo cancellation logic to recognize a command, wherein employment of the first and second echo cancellation logic to recognize the command respectively cause the mobile phone to consume a first and second amount of energy, with the second amount of energy being less than the first amount energy.

18. The computer-implemented method of claim 17, wherein the private mode CUI is to receive commands from the user and excludes the one or more participants from interaction with the private mode CUI, and the group mode CUI is to received commands from any of the one or more participants, as well as the user, in interaction with the group mode CUI.

19. The computer-implemented method of claim 17, wherein the first and second echo cancellation logic respectively operate at first and second sampling rate, with the second sampling rate being a lower sampling rate than the first sampling rate.

20. The computer-implemented method of claim 19, wherein the first echo cancellation logic includes non-linear processing logic and the second echo cancellation logic omits the non-linear processing logic.

21. The computer-implemented method of claim 17, further comprising determining a rendering delay between when an audio stream is processed by the mobile phone and when the audio stream is rendered by a remote speaker coupled with the mobile phone;

wherein the first and second echo cancellation logic is to incorporate the rendering delay into one or more calculations.

22. The computer-implemented method of claim 17, further comprising employing the second echo cancellation logic, while the mobile phone is in a low power state.