Systems, methods, apparatus, and computer program products for enhanced active noise cancellation

• US 9,202,455 B2
• Filed: 11/18/2009
• Issued: 12/01/2015
• Est. Priority Date: 11/24/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Park, Hyun Jin, Chan, Kwokleung
• Primary Examiner(s): Tsang, Fan
• Assistant Examiner(s): Zhao, Eugene
• Application Number:
  US12/621,107
• Publication Number:
  US 20100131269A1
• Time in Patent Office: 2,204 Days
• Field of Search: 381/71, 381/83, 381/93, 381/94, 381/71.8, 381/96, 381/163, 381/71.7, 381/92, 381/95, 381 941- 947, 381 714- 716, 704/227
• US Class Current: 1/1
• CPC Class Codes: G10K 11/17823 Reference signals, e.g. ambient acoustic environment
• CPC Class Codes: G10K 11/17837 by retaining part of the ambient acoustic environment, e.g. speech or alarm signals that the user needs to hear
• CPC Class Codes: G10K 11/17854 the filter being an adaptive filter
• CPC Class Codes: G10K 11/17857 Geometric disposition, e.g. placement of microphones
• CPC Class Codes: G10K 11/17873 using a reference signal without an error signal, e.g. pure feedforward
• CPC Class Codes: G10K 11/17881 the reference signal being an acoustic signal, e.g. recorded with a microphone
• CPC Class Codes: G10K 11/17885 additionally using a desired external signal, e.g. pass-through audio such as music or speech
• CPC Class Codes: G10K 2210/1081 Earphones, e.g. for telephones, ear protectors or headsets

Abstract

Uses of an enhanced sidetone signal in an active noise cancellation operation are disclosed. In one example, a method of audio signal processing includes producing an anti-noise signal based on information from a first audio signal. A target component of a second audio signal is separated from a noise component of the second audio signal to produce at least one among a separated target component and a separated noise component. Based on at least one among the separated target component and the separated noise component, an audio output signal is produced.

Claims

1. A method of audio signal processing, said method comprising performing each of the following acts using a device configured to process audio signals:

based on information from a first audio signal, producing an anti-noise signal;

separating a target component of a second audio signal from a noise component of the second audio signal to produce a separated target component; and

based on a result of mixing the anti-noise signal and the separated target component, producing an audio output signal,

wherein the second audio signal includes (A) a first channel that is based on a signal produced by a first microphone and (B) a second channel that is based on a signal produced by a second microphone that is arranged to receive a user'"'"'s voice more directly than the first microphone,

wherein said separating includes performing a spatially selective processing operation on the second audio signal to produce the separated target component.

2. The method of audio signal processing according to claim 1, wherein the first audio signal is based on a signal produced by an error feedback microphone, and

wherein said producing the anti-noise signal comprises filtering said first audio signal.

3. The method of audio signal processing according to claim 1, wherein said first channel of the second audio signal is the first audio signal.

4. The method of audio signal processing according to claim 1, wherein said separated target component is a separated voice component, and

wherein said separating a target component comprises separating a voice component of the second audio input signal from a noise component of the second audio input signal to produce the separated voice component.

5. The method of audio signal processing according to claim 4, wherein said voice component of the second audio signal includes the user'"'"'s voice.

6. The method of audio signal processing according to claim 1, wherein the anti-noise signal is based on the separated target component.

7. The method of audio signal processing according to claim 1, wherein said method comprises subtracting the separated target component from the first audio signal to produce a third audio signal, and

wherein said anti-noise signal is based on the third audio signal.

8. The method of audio signal processing according to claim 7, wherein the first audio signal is an error feedback signal.

9. The method of audio signal processing according to claim 1, wherein said separating comprises separating said target component from said noise component to produce a separated noise component, and

wherein the first audio signal includes the separated noise component produced by said separating.

10. The method of audio signal processing according to claim 1, wherein said method comprises mixing the audio output signal with a far-end communications signal.

11. The method of audio signal processing according to claim 1, wherein said separated target component is a combination of energy from the first channel and energy from the second channel.

12. The method of audio signal processing according to claim 1, wherein said spatially selective processing operation includes calculating, for each of a plurality of different frequency components of the second audio signal, a difference between a phase of the frequency component in the first channel and a phase of the frequency component in the second channel.

13. The method of audio signal processing according to claim 1, wherein said producing the anti-noise signal comprises filtering a signal that includes energy from the first audio signal to produce the anti-noise signal.

14. The method of audio signal processing according to claim 13, wherein said method comprises attenuating a desired sound component in the first audio signal, relative to a noise component of the first audio signal, to produce a third audio signal, and

wherein said signal that includes energy from the first audio signal is based on the third audio signal.

15. The method of audio signal processing according to claim 14, wherein said attenuating comprises subtracting the separated target component from the first audio signal to produce the third audio signal.

16. The method of audio signal processing according to claim 14, wherein said separating comprises separating said target component from said noise component to produce a separated noise component, and

wherein said attenuating the desired sound component is performed by said separating said target component from said noise component to produce the separated noise component, and

wherein said first channel of the second audio signal is the first audio signal, and

wherein the third audio signal includes the separated noise component produced by said separating.

17. The method of audio signal processing according to claim 1, wherein said producing the anti-noise signal comprises reversing a phase of a signal that is based on the first audio signal to produce the anti-noise signal.

18. A non-transitory computer-readable medium comprising instructions which when executed by at least one processor cause the at least one processor to perform a method of audio signal processing, said instructions comprising:

instructions which when executed by the at least one processor cause the at least one processor to produce an anti-noise signal based on information from a first audio signal;

instructions which when executed by the at least one processor cause the at least one processor to separate a target component of a second audio signal from a noise component of the second audio signal to produce a separated target component; and

instructions which when executed by the at least one processor cause the at least one processor to produce an audio output signal based on a result of mixing the anti-noise signal and the separated target component,

wherein the second audio signal includes (A) a first channel that is based on a signal produced by a first microphone and (B) a second channel that is based on a signal produced by a second microphone that is arranged to receive a user'"'"'s voice more directly than the first microphone,

wherein said instructions which when executed by the at least one processor cause the at least one processor to separate include instructions which when executed by the at least one processor cause the at least one processor to perform a spatially selective processing operation on the second audio signal to produce the separated target component.

19. The computer-readable medium according to claim 18, wherein the first audio signal is based on a signal produced by an error feedback microphone, and

wherein said producing the anti-noise signal comprises filtering said first audio signal.

20. The computer-readable medium according to claim 18, wherein said first channel of the second audio signal is the first audio signal.

21. The computer-readable medium according to claim 18, wherein said separated target component is a separated voice component, and

wherein said instructions which when executed by the at least one processor cause the at least one processor to separate a target component include instructions which when executed by the at least one processor cause the at least one processor to separate a voice component of the second audio input signal from a noise component of the second audio input signal to produce the separated voice component.

22. The computer-readable medium according to claim 18, wherein the anti-noise signal is based on the separated target component.

23. The computer-readable medium according to claim 18, wherein said medium includes instructions which when executed by the at least one processor cause the at least one processor to attenuate a desired sound component in the first audio signal, relative to a noise component of the first audio signal, to produce a third audio signal, and

wherein said producing the anti-noise signal comprises filtering a signal that includes energy from the third audio signal to produce the anti-noise signal.

24. The computer-readable medium according to claim 23, wherein said attenuating the desired sound component comprises subtracting the separated target component from the first audio signal.

25. The computer-readable medium according to claim 24, wherein the first audio signal is an error feedback signal.

26. The computer-readable medium according to claim 23, wherein said instructions which when executed by the at least one processor cause the processor to separate include said instructions which when executed by the at least one processor cause the at least one processor to attenuate the desired sound component to produce the third audio signal, and

wherein said instructions which when executed by the at least one processor cause the at least one processor to separate cause the at least one processor to attenuate the desired sound component in the first audio signal by separating said target component from said noise component to produce a separated noise component, and

wherein said first channel of the second audio signal is the first audio signal, and

wherein the third audio signal includes the separated noise component produced by the processor.

27. The computer-readable medium according to claim 18, wherein said medium includes instructions which when executed by the at least one processor cause the at least one processor to mix the audio output signal with a far-end communications signal.

28. The computer-readable medium according to claim 18, wherein said separated target component is a combination of energy from the first channel and energy from the second channel.

29. The computer-readable medium according to claim 18, wherein said spatially selective processing operation includes calculating, for each of a plurality of different frequency components of the second audio signal, a difference between a phase of the frequency component in the first channel and a phase of the frequency component in the second channel.

30. An apparatus for audio signal processing, said apparatus comprising:

means for producing an anti-noise signal based on information from a first audio signal;

means for separating a target component of a second audio signal from a noise component of the second audio signal to produce a separated target component; and

means for producing an audio output signal based on a result of mixing the anti-noise signal and the separated target component,

wherein the second audio signal includes (A) a first channel that is based on a signal produced by a first microphone and (B) a second channel that is based on a signal produced by a second microphone that is arranged to receive a user'"'"'s voice more directly than the first microphone,

wherein said means for separating is configured to perform a spatially selective processing operation on the second audio signal to produce the separated target component.

31. The apparatus according to claim 30, wherein the first audio signal is based on a signal produced by an error feedback microphone, and

wherein said producing the anti-noise signal comprises filtering said first audio signal.

32. The apparatus according to claim 30, wherein said first channel of the second audio signal is the first audio signal.

33. The apparatus according to claim 30, wherein said separated target component is a separated voice component, and

wherein said means for separating a target component is configured to separate a voice component of the second audio input signal from a noise component of the second audio input signal to produce the separated voice component.

34. The apparatus according to claim 30, wherein the anti-noise signal is based on the separated target component.

35. The apparatus according to claim 30, wherein said apparatus comprises means for attenuating a desired sound component in the first audio signal, relative to a noise component of the first audio signal, to produce a third audio signal, and

wherein said means for producing the anti-noise signal is arranged to filter a signal that includes energy from the third audio signal to produce the anti-noise signal.

36. The apparatus according to claim 35, wherein said attenuating the desired sound component in the first audio signal comprises subtracting the separated target component from the first audio signal.

37. The apparatus according to claim 36, wherein the first audio signal is an error feedback signal.

38. The apparatus according to claim 35, wherein said means for separating includes said means for attenuating the desired sound component in the first audio signal, and

wherein said means for separating is configured to perform said attenuating the desired sound component in the first audio signal by separating said target component from said noise component to produce a separated noise component, and

wherein said first channel of the second audio signal is the first audio signal, and

wherein the third audio signal includes the separated noise component produced by said means for separating.

39. The apparatus according to claim 30, wherein said apparatus includes means for mixing the audio output signal with a far-end communications signal.

40. The apparatus according to claim 30, wherein said separated target component is a combination of energy from the first channel and energy from the second channel.

41. The apparatus according to claim 30, wherein said spatially selective processing operation includes calculating, for each of a plurality of different frequency components of the second audio signal, a difference between a phase of the frequency component in the first channel and a phase of the frequency component in the second channel.

42. An apparatus for audio signal processing, said apparatus comprising:

an active noise cancellation filter configured to produce an anti-noise signal based on information from a first audio signal;

a source separation module configured to separate a target component of a second audio signal from a noise component of the second audio signal to produce a separated target component; and

an audio output stage configured to produce an audio output signal based on a result of mixing the anti-noise signal and the separated target component,

wherein the second audio signal includes (A) a first channel that is based on a signal produced by a first microphone and (B) a second channel that is based on a signal produced by a second microphone that is arranged to receive a user'"'"'s voice more directly than the first microphone, wherein said source separation module is configured to perform a spatially selective processing operation on the second audio signal to produce the separated target component.

43. The apparatus according to claim 42, wherein the first audio signal is based on a signal produced by an error feedback microphone, and

wherein said producing the anti-noise signal comprises filtering said first audio signal.

44. The apparatus according to claim 42, wherein said first channel of the second audio signal is the first audio signal.

45. The apparatus according to claim 42, wherein said separated target component is a separated voice component, and

wherein said source separation module is configured to separate a voice component of the second audio input signal from a noise component of the second audio input signal to produce the separated voice component.

46. The apparatus according to claim 45, wherein said voice component of the second audio signal includes the user'"'"'s voice.

47. The apparatus according to claim 42, wherein the anti-noise signal is based on the separated target component.

48. The apparatus according to claim 42, wherein said apparatus includes means for attenuating a desired sound component in the first audio signal, relative to a noise component of the first audio signal, to produce a third audio signal, and

wherein said active noise cancellation filter is arranged to filter a signal that includes energy from the third audio signal to produce the anti-noise signal.

49. The apparatus according to claim 48, wherein said means for attenuating the desired sound component in the first audio signal includes a mixer configured to subtract the separated target component from the first audio signal to produce the third audio signal.

50. The apparatus according to claim 49, wherein the first audio signal is an error feedback signal.

51. The apparatus according to claim 48, wherein said source separation module includes said means for attenuating the desired sound component in the first audio signal to produce the third audio signal, and

wherein said source separation module is configured to perform said attenuating the desired sound component in the first audio signal by separating said target component from said noise component to produce a separated noise component, and

wherein said first channel of the second audio signal is the first audio signal, and

wherein the third audio signal includes the separated noise component produced by said source separation module.

52. The apparatus according to claim 42, wherein said apparatus includes a mixer configured to mix the audio output signal with a far-end communications signal.

53. The apparatus according to claim 42, wherein said separated target component is a combination of energy from the first channel and energy from the second channel.

54. The apparatus according to claim 42, wherein said spatially selective processing operation includes calculating, for each of a plurality of different frequency components of the second audio signal, a difference between a phase of the frequency component in the first channel and a phase of the frequency component in the second channel.