Acoustic voice activity detection (AVAD) for electronic systems

• US 8,326,611 B2
• Filed: 10/26/2009
• Issued: 12/04/2012
• Est. Priority Date: 05/25/2007
• Status: Active Grant

• Current Assignee: Jawbone Innovations, LLC
• Original Assignee: AliphCom, Inc. (AliphCom Corp.)
• Inventors: Petit, Nicolas, Burnett, Gregory, Jing, Zhinian
• Primary Examiner(s): AZAD, ABUL K
• Application Number:
  US12/606,140
• Publication Number:
  US 20100128881A1
• Time in Patent Office: 1,135 Days
• Field of Search: 704/208, 704/210, 704/214, 704/215, 381/99, 381/100, 381/46
• US Class Current: 704/208
• CPC Class Codes: G10L 2021/02165 Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.

Claims

1. A method comprising:

forming a first virtual microphone by combining a first signal of a first physical microphone and a second signal of a second physical microphone;

forming a filter that describes a relationship for speech between the first physical microphone and the second physical microphone;

forming a second virtual microphone by applying the filter to the first signal to generate a first intermediate signal, and summing the first intermediate signal and the second signal;

generating an energy ratio of energies of the first virtual microphone and the second virtual microphone; and

detecting acoustic voice activity of a speaker when the energy ratio is greater than a threshold value.

2. The method of claim 1, wherein the first virtual microphone and the second virtual microphone are distinct virtual directional microphones.

3. The method of claim 2, wherein the first virtual microphone and the second virtual microphone have approximately similar responses to noise.

4. The method of claim 3, wherein the first virtual microphone and the second virtual microphone have approximately dissimilar responses to speech.

5. The method of claim 1, comprising applying a calibration to at least one of the first signal and the second signal.

6. The method of claim 5, wherein the calibration compensates a second response of the second physical microphone so that the second response is equivalent to a first response of the first physical microphone.

7. The method of claim 5, comprising applying a delay to the first intermediate signal.

8. The method of claim 7, wherein the delay is proportional to a time difference between arrival of the speech at the second physical microphone and arrival of the speech at the first physical microphone.

9. The method of claim 8, wherein the forming of the first virtual microphone comprises applying the filter to the second signal.

10. The method of claim 9, wherein the forming of the first virtual microphone comprises applying the calibration to the second signal.

11. The method of claim 10, wherein the forming of the first virtual microphone comprises applying the delay to the first signal.

12. The method of claim 11, wherein the forming of the first virtual microphone by the combining comprises subtracting the second signal from the first signal.

13. The method of claim 12, wherein the filter is an adaptive filter.

14. The method of claim 13, comprising adapting the filter to minimize a second virtual microphone output when only speech is being received by the first physical microphone and the second physical microphone.

15. The method of claim 13, wherein the adapting comprises applying a least-mean squares process.

16. The method of claim 13, comprising generating coefficients of the filter during a period when only speech is being received by the first physical microphone and the second physical microphone.

17. The method of claim 13, wherein the forming of the filter comprises:

generating a first quantity by applying a calibration to the second signal;

generating a second quantity by applying the delay to the first signal;

forming the filter as a ratio of the first quantity to the second quantity.

18. The method of claim 17, wherein the generating of the energy ratio comprises generating the energy ratio for a frequency band.

19. The method of claim 17, wherein the generating of the energy ratio comprises generating the energy ratio for a frequency subband.

20. The method of claim 19, wherein the frequency subband includes frequencies higher than approximately 200 Hertz (Hz).

21. The method of claim 19, wherein the frequency subband includes frequencies in a range from approximately 250 Hz to 1250 Hz.

22. The method of claim 19, wherein the frequency subband includes frequencies in a range from approximately 200 Hz to 3000 Hz.

23. The method of claim 12, wherein the filter is a static filter.

24. The method of claim 23, wherein the forming of the filter comprises:

determining a first distance as distance between the first physical microphone and a mouth of the speaker;

determining a second distance as distance between the second physical microphone and the mouth; and

forming a ratio of the first distance to the second distance.

25. The method of claim 1, comprising generating a vector of the energy ratio versus time.

26. The method of claim 1, wherein the first and second physical microphones are omnidirectional microphones.

27. The method of claim 1, comprising positioning the first physical microphone and the second physical microphone along an axis and separating the first physical microphone and the second physical microphone by a first distance.

28. The method of claim 27, wherein a midpoint of the axis is a second distance from a mouth of the speaker, wherein the mouth is located in a direction defined by an angle relative to the midpoint.

29. A method comprising:

forming a first virtual microphone;

forming a filter by generating a first quantity by applying a calibration to a second signal of a second physical microphone, generating a second quantity by applying the delay to a first signal of a first physical microphone, and forming the filter as a ratio of the first quantity to the second quantity;

forming a second virtual microphone by applying the filter to the first signal to generate a first intermediate signal, and summing the first intermediate signal and the second signal; and

generating a ratio of energies of the first virtual microphone and the second virtual microphone and detecting acoustic voice activity using the ratio.

30. The method of claim 29, wherein the first virtual microphone and the second virtual microphone have approximately similar responses to noise and approximately dissimilar responses to speech.

31. The method of claim 29, comprising applying a calibration to at least one of the first signal and the second signal, wherein the calibration compensates a second response of the second physical microphone so that the second response is equivalent to a first response of the first physical microphone.

32. The method of claim 29, comprising applying a delay to the first intermediate signal, wherein the delay is proportional to a time difference between arrival of the speech at the second physical microphone and arrival of the speech at the first physical microphone.

33. The method of claim 29, wherein the forming of the first virtual microphone comprises applying the filter to the second signal.

34. The method of claim 33, wherein the forming of the first virtual microphone comprises applying the calibration to the second signal.

35. The method of claim 34, wherein the forming of the first virtual microphone comprises applying the delay to the first signal.

36. The method of claim 35, wherein the forming of the first virtual microphone by the combining comprises subtracting the second signal from the first signal.

37. The method of claim 29, wherein the filter is an adaptive filter.

38. The method of claim 29, comprising adapting the filter to minimize a second virtual microphone output when only speech is being received by the first physical microphone and the second physical microphone.

39. The method of claim 37, wherein the adapting comprises applying a least-mean squares process.

40. The method of claim 37, comprising generating coefficients of the filter during a period when only speech is being received by the first physical microphone and the second physical microphone.

41. The method of claim 29, wherein the generating of the ratio comprises generating the ratio for a frequency band.

42. The method of claim 29, wherein the generating of the ratio comprises generating the ratio for a frequency subband.

43. The method of claim 29, comprising generating a vector of the ratio versus time.

44. A method comprising:

forming a first virtual microphone by generating a first combination of a first signal and a second signal, wherein the first signal is received from a first physical microphone and the second signal is received from a second physical microphone;

forming a filter by generating a first quantity by applying a calibration to at least one of the first signal and the second signal, generating a second quantity by applying a delay to the first signal, and forming the filter as a ratio of the first quantity to the second quantity; and

forming a second virtual microphone by applying the filter to the first signal to generate a first intermediate signal and summing the first intermediate signal and the second signal; and

determining a presence of acoustic voice activity of a speaker when an energy ratio of energies of the first virtual microphone and the second virtual microphone is greater than a threshold value.