Dynamic audibility enhancement

• US 8,509,450 B2
• Filed: 08/23/2010
• Issued: 08/13/2013
• Est. Priority Date: 08/23/2010
• Status: Expired due to Fees

• Current Assignee: Qualcomm technologies international, ltd. (Qualcomm, Inc.)
• Original Assignee: Cambridge Silicon Radio Limited (Qualcomm, Inc.)
• Inventors: Sun, Xuejing
• Primary Examiner(s): Islam, Mohammad
• Assistant Examiner(s): GANMAVO, KUASSI A
• Application Number:
  US12/861,361
• Publication Number:
  US 20120045069A1
• Time in Patent Office: 1,086 Days
• Field of Search: 381/66, 381/71.1, 381/95, 381/96, 381/83, 381/317, 381/321, 381 941- 947, 379/68, 379/78, 37940601-40609, 704/E19.001, 700/94
• US Class Current: 381/66
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain

Abstract

A method of enhancing an audio signal includes the steps of: a) receiving a primary audio input signal, b) receiving a detected audio signal which comprises: A) an echo component derived from play-out of the primary audio input signal and B) a noise component, and c) estimating from the primary audio input signal and the detected audio signal: 1) a set of frequency-specific lower bound gains, such that each frequency-specific lower bound gain, when applied to a respective frequency of the primary audio input signal, would cause the noise component to just mask the echo component at that respective frequency and 2) a set of frequency-specific upper bound gains, such that each frequency-specific upper bound gain, when applied to a respective frequency of the primary audio input signal, would cause the echo component to just mask the noise component at that respective frequency; d) estimating a set of frequency-specific gains in such a way that each frequency-specific gain falls between the respective frequency-specific lower bound gain and respective frequency-specific upper bound gain; and e) applying the frequency-specific gains to the primary audio input signal.

Claims

1. A method of enhancing an audio signal comprising the steps of:

a) receiving a primary audio input signal,

b) receiving a detected audio signal which comprises;

A) an echo component derived from play-out of the primary audio input signal and

B) a noise component, and

c) estimating from the primary audio input signal and the detected audio signal;

1) a set of frequency-specific lower bound gains, such that each frequency-specific lower bound gain, when applied to a respective frequency of the primary audio input signal, would cause the noise component to just mask the echo component at that respective frequency and

2) a set of frequency-specific upper bound gains, such that each frequency-specific upper bound gain, when applied to a respective frequency of the primary audio input signal, would cause the echo component to just mask the noise component at that respective frequency;

d) estimating a set of frequency-specific gains in such a way that each frequency-specific gain falls between the respective frequency-specific lower bound gain and respective frequency-specific upper bound gain; and

e) applying the frequency-specific gains to the primary audio input signal.

2. A method according to claim 1 wherein each frequency-specific gain is specific to a respective frequency sub-band.

3. A method according to claim 1, wherein the step of applying the frequency-specific gains to the primary audio input signal produces an output signal, the method comprising the further step of:

f) playing out the output signal.

4. A method according to claim 1 wherein step c) comprises the sub-steps of:

c-i) estimating the echo component,

c-ii) estimating the noise component,

c-iii) estimating a frequency-specific auditory masking threshold for the echo component,

c-iv) estimating a frequency-specific auditory masking threshold for the noise component, and

c-v) using the aforesaid frequency-specific auditory masking thresholds to calculate the upper and lower bounds.

5. A method according to claim 1 wherein the frequency-specific gains are each equal to the result of summing two terms;

the first term being equal to the result of multiplying a weighting factor, having a value between zero and one, with the respective frequency-specific upper bound, and

the second term being equal to the result of multiplying one minus the weighting factor with the respective frequency-specific lower bound.

6. A method according to claim 1 wherein the frequency-specific gains are each equal to the result of summing two terms;

the first term being equal to the result of multiplying a weighting factor, having a value between zero and one, with the respective frequency-specific upper bound, and

the second term being equal to the result of multiplying one minus the weighting factor with the respective frequency-specific lower bound,

the method comprising the further step of the weighting factor being specified by a user.

7. A method according to claim 1 wherein step c) comprises the sub-step of:

c-i) estimating the echo component by means of an adaptive filter algorithm.

8. A method according to claim 1 wherein step c) comprises the sub-step of:

c-i) estimating the echo component by means of an adaptive filter algorithm, wherein the detected audio signal is monitored for the presence of user speech, and

the adaptation of the filter is slowed down or halted when user speech is detected.

9. A method according to claim 1 wherein the execution of step e) produces an output signal, the method comprising the further step of:

f) playing out the output signal produced in step e),

wherein step e) comprises the sub-steps of;

e-i) applying the frequency-specific gains to the primary audio input signal, this sub-step producing a gain-adjusted signal, and

e-ii) modifying the gain-adjusted signal produced in sub-step e-i) such that the varying sensitivity to different frequencies at different sound pressure levels of the average human ear is compensated for.

10. A system for enhancing an audio signal comprising:

a primary audio input for receiving a primary audio input signal,

a detected audio input for receiving a detected audio signal wherein the detected audio signal comprises;

A) an echo component derived from play-out of the primary audio input signal and

B) a noise component, and

an estimation unit for estimating from the primary audio input signal and the detected audio signal;

1) a set of frequency-specific lower bounds for gains, such that each frequency-specific lower bound gain value, when applied to a respective frequency of the primary audio input signal, would cause the noise component to just mask the echo component at that respective frequency and

2) a set of frequency-specific upper bounds for gains, such that each frequency-specific upper bound gain, when applied to a respective frequency of the primary audio input signal, would cause the echo component to just mask the noise component at that respective frequency;

3) a set of frequency-specific gains estimated in such a way that each frequency-specific gain falls between the respective frequency-specific lower bound and respective frequency-specific upper bound; and

a processing unit for applying the frequency-specific gains to the primary audio input signal.

11. A system according to claim 10 wherein the frequency-specific gains are specific to frequency sub-bands.

12. A system according to claim 10 further comprising:

a loudspeaker for playing out the signal produced by the processing unit.

13. A system according to claim 10 wherein the estimation unit comprises:

an echo estimation module for estimating the echo component,

a noise estimation module for estimating the noise component,

a module for estimating a frequency-specific auditory masking threshold for the echo component,

a module for estimating a frequency-specific auditory masking threshold for the noise component, and

a module for using the aforesaid frequency-specific auditory masking thresholds to estimate the frequency-specific upper and lower bounds.

14. A system according to claim 10 wherein the frequency-specific gains are equal to the result of summing two terms;

the first term being equal to the result of multiplying a weighting factor, having a value between zero and one, with the respective frequency-specific upper bound, and

the second term being equal to the result of multiplying one minus the weighting factor with the respective frequency-specific lower bound.

15. A system according to claim 10 wherein the frequency-specific gains are equal to the result of summing two terms;

the first term being equal to the result of multiplying a weighting factor, having a value between zero and one, with the respective frequency-specific upper bound, and

the second term being equal to the result of multiplying one minus the weighting factor with the respective frequency-specific lower bound,

the system further comprising a control for adjusting the weighting factor, actuable by the user.

16. A system according to claim 10 wherein the estimation unit comprises:

an echo estimation unit which estimates the echo component using an adaptive filter.

17. A system according to claim 10 wherein the estimation unit comprises:

an echo estimation unit configured to estimate the echo component using an adaptive filter, the system further comprising;

a double talk detector configured to monitor the detected audio input signal for the presence of user speech, and slow down or halt the adaptation of the filter when user speech is detected.

18. A system according to claim 10 further comprising:

a processing unit for applying the frequency-specific gains to the primary audio input signal, and

a tonal balance compensation module for modifying the signal produced by the processing unit such that the varying sensitivity to different frequencies at different sound pressure levels of the average human ear is compensated for.

19. A system according to claim 10 wherein the estimation unit comprises:

an echo estimation module which estimates echo using an adaptive filter, wherein the adaptive filter is a normalized least mean squares filter.

20. A system according to claim 10 further comprising:

a noise estimation module, wherein

the noise estimation module is a recursive noise estimator configured to be adaptively controlled by the output of a module which is configured to estimate the probability of the absence of speech in the detected audio signal.