Multi-microphone robust noise suppression

• US 9,438,992 B2
• Filed: 08/05/2013
• Issued: 09/06/2016
• Est. Priority Date: 04/29/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Knowles Electronics Llc (Knowles Corporation)
• Inventors: Jiang, Ye, Every, Mark, Avendano, Carlos, Solbach, Ludger, Murgia, Carlo
• Primary Examiner(s): Paul, Disler
• Application Number:
  US13/959,457
• Publication Number:
  US 20130322643A1
• Time in Patent Office: 1,128 Days
• Field of Search: 381 941- 949, 381/92, 381/66, 381/83, 381/93, 704/226, 704/233
• US Class Current: 1/1
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: H04R 3/002 Damping circuit arrangements for transducers, e.g. motional feedback circuits

Abstract

A robust noise reduction system may concurrently reduce noise and echo components in an acoustic signal while limiting the level of speech distortion. The system may receive acoustic signals from two or more microphones in a close-talk, hand-held or other configuration. The received acoustic signals are transformed to frequency domain sub-band signals and echo and noise components may be subtracted from the sub-band signals. Features in the acoustic sub-band signals are identified and used to generate a multiplicative mask. The multiplicative mask is applied to the noise subtracted sub-band signals and the sub-band signals are reconstructed in the time domain.

Claims

1. A system for performing noise reduction in an audio signal, the system comprising:

a memory;

a frequency analysis module stored in the memory and executed by a processor to generate a plurality of sub-band signals in a frequency domain from time domain acoustic signals;

a noise cancellation module stored in the memory and executed by a processor to cancel noise in one or more of the plurality of sub-band signals;

a modifier module stored in the memory and executed by a processor to suppress a noise component and an echo component in the one or more noise canceled sub-band signals on a per sub-band basis; and

a reconstructor module stored in the memory and executed by a processor to reconstruct a modified time domain signal from the components suppressed sub-band signals provided by the modifier module.

2. The system of claim 1, wherein the time domain acoustic signals are received from one or more microphone signals on an audio device.

3. The system of claim 1 further comprising a feature extraction module stored in memory and executed by a processor to determine features of the sub-band signals, the features determined for each frame in a series of frames for the acoustic signals.

4. The system of claim 3, the feature extraction module configured to control adaptation of the noise cancellation module or the modifier module based on inter-microphone level difference or inter-microphone time or phase differences between a primary acoustic signal and a second, third or other acoustic signal.

5. The system of claim 1, the noise cancellation module cancelling at least a portion of the plurality of sub-band signals by subtracting the noise component or by subtracting the echo component from the one or more of the plurality of sub-band signals.

6. The system of claim 5, further comprising:

a feature extraction module stored in memory and executed by a processor to receive the plurality of sub-band signals from the frequency analysis module, and determine features of each of the plurality of the sub-band signals, the features determined for each frame in a series of frames for the acoustic signals,

wherein a determined feature is a null-processing inter-microphone level difference derived in the feature extraction module from output of the one or more noise canceled sub-band signals from the noise cancellation module and from the plurality of received sub-band signals.

7. The system of claim 1, further comprising a mask generator module stored in memory and executed by the processor to generate a mask, the mask configured to be applied by the modifier module to sub-band signals output by the noise cancellation module.

8. The system of claim 7, further comprising:

a feature extraction module stored in memory and executed by a processor to determine features of the sub-band signals, the features determined for each frame in a series of frames for the acoustic signals,

wherein the mask is determined based partly upon one or more features derived in the feature extraction module.

9. The system of claim 8, wherein the mask is determined based at least in part on a threshold level of speech-loss distortion, a desired level of noise or echo suppression, or an estimated signal to noise ratio in each sub-band of the sub-band signals.

10. A method for performing noise reduction in an audio signal, the method comprising:

executing a stored frequency analysis module by a processor to generate sub-band signals in a frequency domain from time domain acoustic signals;

executing a noise cancellation module by a processor to cancel at least a portion of the sub-band signals;

executing a modifier module by a processor to suppress a noise component and an echo component in the noise canceled portion of the sub-band signals on a per sub-band basis; and

executing a reconstructor module by a processor to reconstruct a modified time domain signal from the components suppressed sub-band signals provided by the modifier module.

11. The method of claim 10, further comprising receiving time domain acoustic signals from one or more microphone signals on an audio device.

12. The method of claim 10, further comprising determining features of the sub-band signals, the features determined for each frame in a series of frames for the acoustic signals.

13. The method of claim 12, further comprising controlling adaptation of the noise cancellation module or the modifier module based on inter-microphone level difference or inter-microphone time or phase differences between a primary acoustic signal and a second, third or other acoustic signal.

14. The method of claim 10, further comprising:

determining features of the sub-band signals, the features determined for each frame in a series of frames for the acoustic signals,

wherein a feature is derived in a feature extraction module from output of the noise cancellation module and from the canceled portion of the sub-band signals.

15. The method of claim 10, further comprising generating a mask, the mask configured to be applied by the modifier module to sub-band signals output by the noise cancellation module.

16. The method of claim 15, further comprising:

determining features of the sub-band signals, the features determined for each frame in a series of frames for the acoustic signals,

wherein the mask is determined based partly upon one or more features derived in a feature extraction module.

17. The method of claim 16, wherein the mask is determined based at least in part on a threshold level of speech-loss distortion, a desired level of noise or echo suppression, or an estimated signal to noise ratio in each sub-band of the sub-band signals.

18. A non-transitory computer readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for reducing noise in an audio signal, the method comprising:

executing a stored frequency analysis module by a processor to generate a plurality of sub-band signals in a frequency domain from time domain acoustic signals;

executing a noise cancellation module by a processor to cancel noise in one or more of the plurality of sub-band signals;

executing a modifier module by a processor to suppress a noise component and an echo component in the one or more noise canceled sub-band signals on a per sub-band basis; and

executing a reconstructor module by a processor to reconstruct a modified time domain signal from the components suppressed sub-band signals provided by the modifier module.