SYSTEMS, METHODS, APPARATUS, AND COMPUTER-READABLE MEDIA FOR PROCESSING OF SPEECH SIGNALS USING HEAD-MOUNTED MICROPHONE PAIR

• US 20110288860A1
• Filed: 05/19/2011
• Published: 11/24/2011
• Est. Priority Date: 05/20/2010
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Visser, Erik, Ramakrishnan, Dinesh, Liu, Ian Ernan, Li, Ren, Momeyer, Brian, Park, Hyun Jin, Oliveira, Louis D., Schevciw, Andre Gustavo Pucci
• Application Number:
  US13/111,627
• Publication Number:
  US 20110288860A1
• Time in Patent Office: Days
• US Class Current: 704/233
• CPC Class Codes: G10L 2021/02168 the estimation exclusively taking place during speech pauses
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

A noise cancelling headset for voice communications contains a microphone at each of the user'"'"'s ears and a voice microphone. The headset shares the use of the ear microphones for improving signal-to-noise ratio on both the transmit path and the receive path.

Claims

1. A method of signal processing, said method comprising:

producing a voice activity detection signal that is based on a relation between a first audio signal and a second audio signal; and

applying the voice activity detection signal to a signal that is based on a third audio signal to produce a speech signal,

wherein the first audio signal is based on a signal produced (A) by a first microphone that is located at a lateral side of a user'"'"'s head and (B) in response to a voice of the user, and

wherein the second audio signal is based on a signal produced, in response to the voice of the user, by a second microphone that is located at the other lateral side of the user'"'"'s head, and

wherein the third audio signal is based on a signal produced, in response to the voice of the user, by a third microphone that is different from the first and second microphones, and

wherein the third microphone is located in a coronal plane of the user'"'"'s head that is closer to a central exit point of the user'"'"'s voice than either of the first and second microphones.

2. The method according to claim 1, wherein said applying the voice activity detection signal comprises applying the voice activity detection signal to the signal that is based on the third audio signal to produce a noise estimate, and

wherein said speech signal is based on the noise estimate.

3. The method according to claim 2, wherein said applying the voice activity detection signal comprises:

applying the voice activity detection signal to the signal that is based on the third audio signal to produce a speech estimate; and

performing a noise reduction operation, based on the noise estimate, on the speech estimate to produce the speech signal.

4. The method according to claim 1, wherein said method comprises calculating a difference between (A) a signal that is based on a signal produced by the first microphone and (B) a signal that is based on a signal produced by the second microphone to produce a noise reference, and

wherein said speech signal is based on the noise reference.

5. The method according to claim 1, wherein said method comprises performing a spatially selective processing operation, based on the second and third audio signals, to produce a speech estimate, and

wherein said signal that is based on a third audio signal is the speech estimate.

6. The method according to claim 1, wherein said producing the voice activity detection signal comprises calculating a cross-correlation between the first and second audio signals.

7. The method according to claim 1, wherein said method comprises producing a second voice activity detection signal that is based on a relation between the second audio signal and the third audio signal, and

wherein said voice activity detection signal is based on the second voice activity detection signal.

8. The method according to claim 1, wherein said method comprises performing a spatially selective processing operation on the second and third audio signals to produce a filtered signal, and

wherein said signal that is based on a third audio signal is the filtered signal.

9. The method according to claim 1, wherein said method comprises:

performing a first active noise cancellation operation on a signal that is based on a signal produced by the first microphone to produce a first antinoise signal; and

driving a loudspeaker located at the lateral side of the user'"'"'s head to produce an acoustic signal that is based on the first antinoise signal.

10. The method according to claim 9, wherein said antinoise signal is based on information from an acoustic error signal produced by an error microphone located at the lateral side of the user'"'"'s head.

11. An apparatus for signal processing, said apparatus comprising:

means for producing a voice activity detection signal that is based on a relation between a first audio signal and a second audio signal; and

means for applying the voice activity detection signal to a signal that is based on a third audio signal to produce a speech signal,

wherein the first audio signal is based on a signal produced (A) by a first microphone that is located at a lateral side of a user'"'"'s head and (B) in response to a voice of the user, and

wherein the second audio signal is based on a signal produced, in response to the voice of the user, by a second microphone that is located at the other lateral side of the user'"'"'s head, and

wherein the third audio signal is based on a signal produced, in response to the voice of the user, by a third microphone that is different from the first and second microphones, and

wherein the third microphone is located in a coronal plane of the user'"'"'s head that is closer to a central exit point of the user'"'"'s voice than either of the first and second microphones.

12. The apparatus according to claim 11, wherein said means for applying the voice activity detection signal is configured to apply the voice activity detection signal to the signal that is based on the third audio signal to produce a noise estimate, and wherein said speech signal is based on the noise estimate.

13. The apparatus according to claim 12, wherein said means for applying the voice activity detection signal comprises:

means for applying the voice activity detection signal to the signal that is based on the third audio signal to produce a speech estimate; and

means for performing a noise reduction operation, based on the noise estimate, on the speech estimate to produce the speech signal.

14. The apparatus according to claim 11, wherein said apparatus comprises means for calculating a difference between (A) a signal that is based on a signal produced by the first microphone and (B) a signal that is based on a signal produced by the second microphone to produce a noise reference, and

wherein said speech signal is based on the noise reference.

15. The apparatus according to claim 11, wherein said apparatus comprises means for performing a spatially selective processing operation, based on the second and third audio signals, to produce a speech estimate, and

wherein said signal that is based on a third audio signal is the speech estimate.

16. The apparatus according to claim 11, wherein said means for producing the voice activity detection signal comprises means for calculating a cross-correlation between the first and second audio signals.

17. The apparatus according to claim 11, wherein said apparatus comprises means for producing a second voice activity detection signal that is based on a relation between the second audio signal and the third audio signal, and

wherein said voice activity detection signal is based on the second voice activity detection signal.

18. The apparatus according to claim 11, wherein said apparatus comprises means for performing a spatially selective processing operation on the second and third audio signals to produce a filtered signal, and

wherein said signal that is based on a third audio signal is the filtered signal.

19. The apparatus according to claim 11, wherein said apparatus comprises:

means for performing a first active noise cancellation operation on a signal that is based on a signal produced by the first microphone to produce a first antinoise signal; and

means for driving a loudspeaker located at the lateral side of the user'"'"'s head to produce an acoustic signal that is based on the first antinoise signal.

20. The apparatus according to claim 19, wherein said antinoise signal is based on information from an acoustic error signal produced by an error microphone located at the lateral side of the user'"'"'s head.

21. An apparatus for signal processing, said apparatus comprising:

a first microphone configured to be located during a use of the apparatus at a lateral side of a user'"'"'s head;

a second microphone configured to be located during the use of the apparatus at the other lateral side of the user'"'"'s head;

a third microphone configured to be located during the use of the apparatus in a coronal plane of the user'"'"'s head that is closer to a central exit point of a voice of the user than either of the first and second microphones;

a voice activity detector configured to produce a voice activity detection signal that is based on a relation between a first audio signal and a second audio signal; and

a speech estimator configured to apply the voice activity detection signal to a signal that is based on a third audio signal to produce a speech estimate,

wherein the first audio signal is based on a signal produced, in response to the voice of the user, by the first microphone during the use of the apparatus, and

wherein the second audio signal is based on a signal produced, in response to the voice of the user, by the second microphone during the use of the apparatus, and

wherein the third audio signal is based on a signal produced, in response to the voice of the user, by the third microphone during the use of the apparatus.

22. The apparatus according to claim 21, wherein said speech estimator is configured to apply the voice activity detection signal to the signal that is based on the third audio signal to produce a noise estimate, and

wherein said speech signal is based on the noise estimate.

23. The apparatus according to claim 22, wherein said speech estimator comprises:

a gain control element configured to apply the voice activity detection signal to the signal that is based on the third audio signal to produce a speech estimate; and

a noise reduction module configured to perform a noise reduction operation, based on the noise estimate, on the speech estimate to produce the speech signal.

24. The apparatus according to claim 21, wherein said apparatus comprises a calculator configured to calculate a difference between (A) a signal that is based on a signal produced by the first microphone and (B) a signal that is based on a signal produced by the second microphone to produce a noise reference, and

wherein said speech signal is based on the noise reference.

25. The apparatus according to claim 21, wherein said apparatus comprises a filter configured to perform a spatially selective processing operation, based on the second and third audio signals, to produce a speech estimate, and

wherein said signal that is based on a third audio signal is the speech estimate.

26. The apparatus according to claim 21, wherein said voice activity detector is configured to produce the voice activity detection signal based on a result of cross-correlating the first and second audio signals.

27. The apparatus according to claim 21, wherein said apparatus comprises a second voice activity detector configured to produce a second voice activity detection signal that is based on a relation between the second audio signal and the third audio signal, and

wherein said voice activity detection signal is based on the second voice activity detection signal.

28. The apparatus according to claim 21, wherein said apparatus comprises a filter configured to perform a spatially selective processing operation on the second and third audio signals to produce a filtered signal, and

wherein said signal that is based on a third audio signal is the filtered signal.

29. The apparatus according to claim 21, wherein said apparatus comprises:

a first active noise cancellation filter configured to perform an active noise cancellation operation on a signal that is based on a signal produced by the first microphone to produce a first antinoise signal; and

a loudspeaker configured to be located during the use of the apparatus at the lateral side of the user'"'"'s head and to produce an acoustic signal that is based on the first antinoise signal.

30. The apparatus according to claim 29, wherein said apparatus includes an error microphone configured to be located during the use of the apparatus at the lateral side of the user'"'"'s head and closer to an ear canal of the lateral side of the user than the first microphone, and

wherein said antinoise signal is based on information from an acoustic error signal produced by the error microphone.

31. A non-transitory computer-readable storage medium having tangible features that cause a machine reading the features to:

produce a voice activity detection signal that is based on a relation between a first audio signal and a second audio signal; and

apply the voice activity detection signal to a signal that is based on a third audio signal to produce a speech signal,

wherein the first audio signal is based on a signal produced (A) by a first microphone that is located at a lateral side of a user'"'"'s head and (B) in response to a voice of the user, and

wherein the second audio signal is based on a signal produced, in response to the voice of the user, by a second microphone that is located at the other lateral side of the user'"'"'s head, and

wherein the third audio signal is based on a signal produced, in response to the voice of the user, by a third microphone that is different from the first and second microphones, and

wherein the third microphone is located in a coronal plane of the user'"'"'s head that is closer to a central exit point of the user'"'"'s voice than either of the first and second microphones.

32. The computer-readable storage medium according to claim 31, wherein said applying the voice activity detection signal comprises applying the voice activity detection signal to the signal that is based on the third audio signal to produce a noise estimate, and

wherein said speech signal is based on the noise estimate.

33. The computer-readable storage medium according to claim 32, wherein said

applying the voice activity detection signal comprises:

applying the voice activity detection signal to the signal that is based on the third audio signal to produce a speech estimate; and

performing a noise reduction operation, based on the noise estimate, on the speech estimate to produce the speech signal.

34. The computer-readable storage medium according to claim 31, wherein said medium has tangible features that cause a machine reading the features to calculate a difference between (A) a signal that is based on a signal produced by the first microphone and (B) a signal that is based on a signal produced by the second microphone to produce a noise reference, and

wherein said speech signal is based on the noise reference.

35. The computer-readable storage medium according to claim 31, wherein said medium has tangible features that cause a machine reading the features to perform a spatially selective processing operation, based on the second and third audio signals, to produce a speech estimate, and

wherein said signal that is based on a third audio signal is the speech estimate.

36. The computer-readable storage medium according to claim 31, wherein said producing the voice activity detection signal comprises calculating a cross-correlation between the first and second audio signals.

37. The computer-readable storage medium according to claim 31, wherein said medium has tangible features that cause a machine reading the features to produce a second voice activity detection signal that is based on a relation between the second audio signal and the third audio signal, and

wherein said voice activity detection signal is based on the second voice activity detection signal.

38. The computer-readable storage medium according to claim 31, wherein said medium has tangible features that cause a machine reading the features to perform a spatially selective processing operation on the second and third audio signals to produce a filtered signal, and

wherein said signal that is based on a third audio signal is the filtered signal.

39. The computer-readable storage medium according to claim 31, wherein said medium has tangible features that cause a machine reading the features to:

perform a first active noise cancellation operation on a signal that is based on a signal produced by the first microphone to produce a first antinoise signal; and

drive a loudspeaker located at the lateral side of the user'"'"'s head to produce an acoustic signal that is based on the first antinoise signal.

40. The computer-readable storage medium according to claim 39, wherein said antinoise signal is based on information from an acoustic error signal produced by an error microphone located at the lateral side of the user'"'"'s head.