USER ENVIRONMENT AWARE ACOUSTIC NOISE REDUCTION

• US 20160005422A1
• Filed: 07/02/2014
• Published: 01/07/2016
• Est. Priority Date: 07/02/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Zad Issa, Syavosh, Fleck, Rod G., Lu, Youhong, Gopal, Hundraj S.
• Granted Patent: US 9,837,102 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: G10L 25/24 the extracted parameters being the cepstrum
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G10L 25/84 for discriminating voice from noise
• CPC Class Codes: H03G 3/32 the control being dependent upon ambient noise level or sound level

Abstract

Examples of the disclosure describe user environment aware single channel acoustic noise reduction. A noisy signal received by a computing device is transformed and feature vectors of the received noisy signal are determined. The computing device accesses classification data corresponding to a plurality of user environments. The classification data for each user environment has associated therewith a noise model. A comparison is performed between the determined feature vectors and the accessed classification data to identify a current user environment. A noise level, a speech level, and a speech presence probability from the transformed noisy signal are estimated and the noise signal is reduced based on the estimates. The resulting signal is outputted as an enhanced signal with a reduced or eliminated noise signal.

Claims

1. A system for providing user environment aware acoustic noise reduction, said system comprising:

a memory area for storing classification data corresponding to a plurality of user environments, the classification data for each user environment including a noise model associated therewith; and

a processor programmed to;

receive a noisy signal and create a transform of the received noisy signal, the noisy signal including a speech signal and a noise signal;

determine feature vectors of the received noisy signal;

compare the determined feature vectors with the classification data stored in the memory area to identify a current user environment;

estimate, based on the noise model associated with the identified current user environment, a noise level, a speech level, and a speech presence probability for the transformed noisy signal;

reduce, based on the estimated noise level, the speech level, and the speech presence probability and the noise model associated with the identified current user environment, the noise signal from the transformed noisy signal; and

upon reducing the noise signal, output an enhanced version of the speech signal from the noisy signal.

2. The system of claim 1, wherein the processor is further programmed to confirm the identified current user environment upon determining that the identified current user environment is the same for at least a predefined number of frames of the noisy signal.

3. The system of claim 1, wherein the noisy signal includes only the noise signal for at least a predefined time period upon beginning the identification of the current user environment.

4. The system of claim 1, wherein the memory area further stores a running signal-to-noise ratio (SNR) histogram for each of the plurality of user environments and the processor is programmed to identify the current user environment by:

calculating a SNR histogram for the received noisy signal;

comparing the calculated SNR histogram with the SNR histograms for the plurality of user environments; and

identifying the current user environment based on the comparison.

5. The system of claim 1, wherein the processor is further programmed to repeat, after a predefined time period, identification of the current user environment based on an updated noisy signal.

6. The system of claim 1, wherein the noise model associated with the identified current user environment is selected from a group consisting of a car, a pub, a café

, pink noise, or clean speech.

7. The system of claim 1, wherein the processor is further programmed to:

calculate a mean and a variance of the determined feature vectors; and

compare the calculated mean and the variance with the classification data to identify the noise model for the current user environment.

8. The system of claim 1, wherein the processor is further programmed to:

inversely transform the outputted enhanced speech signal; and

revise the classification data for the identified current user environment based on the inversely transformed enhanced speech signal.

9. The system of claim 1, wherein the processor is further programmed to identify the current user environment by considering data selected from a group consisting of data from a gyroscope, data from back end speech recognition, or speaker-speech characteristics.

10. The system of claim 1, wherein the processor is programmed to create the transform of the received noisy signal in a frequency domain, and wherein the processor is programmed to determine the feature vectors of the received noisy signal by computing Mel-Scale frequency cepstral coefficients (MFCC).

11. A method comprising:

transforming a noisy signal received by a computing device;

determining feature vectors of the received noisy signal;

accessing classification data corresponding to a plurality of user environments, the classification data for each of the user environments including a noise model associated therewith;

comparing the determined feature vectors with the accessed classification data to identify a current user environment;

estimating, based on the noise model associated with the identified current user environment, a noise level, a speech level, and a speech presence probability for the transformed noisy signal; and

reducing, based on the estimated noise level, the speech level, and the speech presence probability and the noise model associated with the identified current user environment, a noise signal from the transformed noisy signal to output an enhanced signal.

12. The method of claim 11, further comprising confirming the identified current user environment by identifying a most frequently identified current user environment over a predefined time period.

13. The method of claim 11, wherein a memory area associated with the computing device stores a signal-to-noise ratio (SNR) histogram for each of the user environments and the identification of the current user environment is performed by:

calculating a SNR histogram for the received noisy signal;

comparing the calculated SNR histogram with the SNR histograms for the plurality of user environments; and

identifying the current user environment based on the comparison of the calculated SNR histogram with the SNR histograms for the plurality of user environments.

14. The method of claim 11, further comprising:

applying a known speech signal to the plurality of user environments; and

upon applying the known speech signal, characterizing each of the plurality of user environments using machine learning to define at least a portion of the classification data.

15. The method of claim 11, wherein said identification of the current user environment is further based on data selected from a group consisting of sensor data from a gyroscope, data from back end speech recognition, or speaker-speech characteristics.

16. The method of claim 11, wherein transforming the noisy signal comprises transforming the noisy signal in a frequency domain, and wherein determining the feature vectors of the received noisy signal comprises computing Mel-Scale frequency cepstral coefficients (MFCC).

17. A computer storage media storing computer executable components executable by a processor associated with a computing device, said components comprising:

a transformation component that when executed by at least one processor causes the at least one processor to transform a noisy signal received by a computing device;

a determination component that when executed by at least one processor causes the at least one processor to determine feature vectors of the received noisy signal;

a classification component that when executed by at least one processor causes the at least one processor to access classification data corresponding to a plurality of user environments, the classification data for each user environment including a noise model associated therewith;

an identification component that when executed by at least one processor causes the at least one processor to identify a current user environment of the computing device based on a comparison of the feature vectors determined by the determination component with the classification data accessed by the classification component;

an estimation component that when executed by at least one processor causes the at least one processor to estimate, based on the noise model associated with the current user environment identified by the identification component, a noise level, speech level, and a speech presence probability for the transformed noisy signal; and

a noise reduction component that when executed by at least one processor causes the at least one processor to reduce, based on the noise level, the speech level, and the speech presence probability estimated by the estimation component and the noise model associated with the current user environment, a noise signal from the transformed noisy signal to output an enhanced signal.

18. The computer storage media of claim 17, further comprising:

an inverse transformation component that when executed by at least one processor causes the at least one processor to inversely transform the enhanced signal outputted by the noise reduction component; and

a feedback component that when executed by at least one processor causes the at least one processor to adjust the classification data for the identified current user environment based on the inversely transformed, enhanced signal.

19. The computer storage media of claim 17, wherein said identification of the current user environment by the identification component further comprises incorporating data from a group consisting of data from a gyroscope, data from back-end speech recognition, or data describing speaker-speech characteristics.

20. The computer storage media of claim 17, wherein the determination component determines the feature vectors of the received noisy signal by computing Mel-Scale frequency cepstral coefficients (MFCC) and the received noisy signal is transformed in a frequency domain.