Systems, methods, apparatus, and computer program products for speech signal processing using spectral contrast enhancement

• US 8,831,936 B2
• Filed: 05/28/2009
• Issued: 09/09/2014
• Est. Priority Date: 05/29/2008
• Status: Active Grant

• Current Assignee: Glaxo Group Limited (Glaxosmithkline Holdings Ltd.), Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Toman, Jeremy, Visser, Erik, Lin, Hung Chun
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US12/473,492
• Publication Number:
  US 20090299742A1
• Time in Patent Office: 1,930 Days
• Field of Search: 704/228
• US Class Current: 704/228
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0272 Voice signal separating

Abstract

Systems, methods, and apparatus for spectral contrast enhancement of speech signals, based on information from a noise reference that is derived by a spatially selective processing filter from a multichannel sensed audio signal, are disclosed.

Claims

1. A method comprising performing each of the following acts within a device that is configured to process audio signals:

performing a spatially selective processing operation within a spatially selective processing filter on a multichannel sensed audio signal to produce a source signal and a noise reference; and

performing a first spectral contrast enhancement operation within a first spectral contrast enhancer on a far end speech signal and the noise reference to produce a first processed speech signal.

2. The method of processing the far end speech signal according to claim 1, including decoding a signal that is received wirelessly by the device to obtain a decoded speech signal, wherein the far end speech signal is based on information from the decoded speech signal.

3. The method of claim 1, wherein the method comprises:

using an echo canceller to cancel echoes from the multichannel sensed audio signal; and

using the first processed speech signal to train the echo canceller.

4. The method of claim 1, wherein the method comprises:

based on information from the noise reference, performing a noise reduction operation on the source signal to obtain the far end speech signal; and

performing a voice activity detection operation based on a relation between the source signal and the far end speech signal, wherein the producing the first processed speech signal is based on a result of the voice activity detection operation.

5. The method of claim 1, wherein the performing the spatially selective processing operation includes determining a relation between phase angles of channels of the multichannel sensed audio signal at each of a plurality of different frequencies.

6. The method of claim 1, wherein the performing the first spectral contrast enhancement operation includes:

calculating a first plurality of subband factors based on information from the noise reference;

calculating a second plurality of subband factors based on information from the far-end speech signal;

generating a first-contrast enhanced signal by applying the second plurality of subband factors to the far-end speech signal; and

producing the first processed speech signal by combining the first plurality of subband factors and the first contrast enhanced signal.

7. The method of claim 1, wherein the performing the spatially selective processing operation includes concentrating energy of a directional component of the multichannel sensed audio signal into the source signal, and

wherein the multichannel sensed audio signal comprises a near end speech signal.

8. The method of claim 1, further comprises performing a second spectral contrast enhancement operation within a second spectral contrast enhancer on a near end speech signal to produce a second processed speech signal.

9. The method of claim 8, wherein the performing the second spectral contrast enhancement operation includes:

calculating a third plurality of subband factors based on information from the noise reference;

calculating a fourth plurality of subband factors based on information from the near-end speech signal;

generating a second contrast enhanced signal by applying the third plurality of subband factors to the near-end speech signal; and

producing a second processed speech signal by combining the third plurality of subband factors and the second contrast enhanced signal.

10. The method of claim 9, wherein the producing the second processed speech signal includes filtering the near-end speech signal using a cascade of filter stages.

11. An apparatus comprising:

means for performing a spatially selective processing operation on a multichannel sensed audio signal to produce a source signal and a noise reference; and

means for performing a first spectral contrast enhancement operation within a first spectral contrast enhancer on a far end speech signal and the noise reference to produce a first processed speech signal.

12. The apparatus of claim 11, includes means for decoding a signal that is received wirelessly by the apparatus to obtain a decoded speech signal, wherein the far end speech signal is based on information from the decoded speech signal.

14. The apparatus of claim 11, wherein said apparatus comprises:

means for performing a noise reduction operation, based on information from the noise reference, on the source signal to obtain the far end speech signal; and

means for performing a voice activity detection operation based on a relation between the source signal and the far end speech signal,

wherein said means for producing a first processed speech signal is configured to produce the first processed speech signal based on a result of the voice activity detection operation.

15. The apparatus of claim 11, wherein the means for performing the first spectral contrast enhancement operation includes:

means for calculating a first plurality of subband factors based on information from the noise reference;

means for calculating a second plurality of subband factors based on information from the far end speech signal;

means for generating a first contrast enhanced signal by applying the second plurality of subband factors to the far end speech signal; and

means for producing a first processed speech signal by means for combining the first plurality of subband factors and the first contrast enhanced signal.

16. The apparatus of claim 11, wherein means for the spatially selective processing operation includes concentrating energy of a directional component of the multichannel sensed audio signal into the source signal, and wherein the multichannel sensed audio signal comprises a near end speech signal.

17. The apparatus of claim 11, further comprising means for performing a second spectral contrast enhancement operation within a second spectral contrast enhancer on a near end speech signal and the noise reference to produce a second processed speech signal.

18. The apparatus of claim 17, wherein the means for performing the second spectral contrast enhancement operation includes:

means for calculating a third plurality of subband factors based on information from the noise reference;

means for calculating a fourth plurality of subband factors based on information from the near end speech signal;

means for generating a second contrast enhanced signal by applying the fourth plurality of subband factors to the near end speech signal; and

means for producing a second processed speech signal by means for combining the third plurality of subband factors and the second contrast enhanced signal.

19. The apparatus of claim 18, wherein the means for producing the second processed speech signal a includes a cascade of filter stages arranged to filter the near end speech signal.

13. The apparatus of 11, wherein the apparatus comprises means for cancelling echoes from the multichannel sensed audio signal, and wherein the means for cancelling echoes is configured and arranged to be trained by the first processed speech signal.

20. An apparatus comprising:

a spatially selective processing filter configured to perform a spatially selective processing operation on a multichannel sensed audio signal to produce a source signal and a noise reference; and

a first spectral contrast enhancer, coupled to the spatially selective processing filter, configured to perform a spectral contrast enhancement operation on a far end speech signal and the noise reference to produce a first processed speech signal.

21. The apparatus of claim 20, wherein the apparatus comprises a decoder configured to decode a signal that is received wirelessly by the apparatus to obtain a decoded speech signal, and

wherein the far end speech signal is based on information from the decoded speech signal.

22. The apparatus of claim 20, wherein the first spectral contrast enhancer comprises an echo canceller configured to cancel echoes from the multichannel sensed audio signal, and

wherein the echo canceller is configured and arranged to be trained by the first processed speech signal.

23. The apparatus of claim 20, wherein the apparatus comprises:

a noise reduction stage configured to perform a noise reduction operation, based on information from the noise reference, on the source signal to obtain the far end speech signal; and

a voice activity detector configured to perform a voice activity detection operation based on a relation between the source signal and the far end speech signal,

wherein the first spectral contrast enhancer is configured to produce the first processed speech signal based on a result of the voice activity detection operation.

24. The apparatus of claim 20, wherein the first spectral contrast enhancer comprises:

a first subband factor calculator configured to calculate a first plurality of subband factors based on information from a noise reference;

a second subband factor calculator configured to calculate a second plurality of subband factors based on information from a far end speech signal;

a control element configured to generate a first contrast enhanced signal based on the second plurality of subband factors to the far end speech signal; and

a mixer configured to combine the first plurality of subband factors and the first contrast enhanced signal.

25. The apparatus of claim 20, wherein the spatially selective processing operation includes concentrating energy of a directional component of the multichannel sensed audio signal into the source signal, and wherein the multichannel sensed audio signal comprises a near end speech signal.

26. The apparatus of claim 20, further comprising a second spectral contrast enhancer, coupled to a spatially selective processing filter, configured to perform a spectral contrast enhancement operation on a near end speech signal to produce a second processed speech signal.

27. The apparatus of claim 20, wherein the second spectral contrast enhancer comprises:

a third subband factor calculator configured to calculate a third plurality of subband factors based on information from the noise reference;

a fourth subband factor calculator configured to calculate a fourth plurality of subband factors based on information from the far end speech signal;

a control element configured to generate a second contrast enhanced signal based on the second plurality of subband factors to the far end speech signal; and

a mixer configured to combine the third plurality of subband factors and the second contrast enhanced signal.

28. A non-transitory computer-readable medium comprising instructions which when executed by at least one processor cause the at least one processor to perform a method comprising:

instructions which when executed by a processor cause the processor to perform a spatially selective processing operation on a multichannel sensed audio signal to produce a source signal and a noise reference; and

instructions which when executed by a processor cause the processor to perform a first spectral contrast enhancement operation within a first spectral contrast enhancer on a speech signal and the noise reference to produce a first processed speech signal, wherein the speech signal comprises a far end speech signal.

29. The non-transitory computer-readable medium according to claim 28, wherein the medium comprises instructions which when executed by a processor cause the processor to decode a signal that is received wirelessly by a device that includes said medium to obtain a decoded speech signal, and wherein far end speech signal is based on information from the decoded speech signal.

30. The non-transitory computer-readable medium according to claim 28, wherein the medium comprises:

instructions which when executed by a processor cause the processor to cancel echoes from the multichannel sensed audio signal; and

wherein the instructions which when executed by a processor cause the processor to cancel echoes are configured and arranged to be trained by the first processed speech signal.

31. The non-transitory computer-readable medium according to claim 28, wherein said medium comprises:

instructions which when executed by a processor cause the processor to perform a noise reduction operation, based on information from the noise reference, on the source signal to obtain the far end speech signal; and

instructions which when executed by a processor cause the processor to perform a voice activity detection operation based on a relation between the source signal and the far end speech signal,

wherein the instructions which when executed by a processor cause the processor to produce a first processed speech signal are configured to produce the first processed speech signal based on a result of the voice activity detection operation.

33. The non-transitory computer-readable medium according to claim 28, wherein the instructions which when executed by a processor cause the processor to perform a spatially selective processing operation include instructions which when executed by a processor cause the processor to concentrate energy of a directional component of the multichannel sensed audio signal into the source signal, and wherein the multichannel sensed audio signal comprises a near end speech signal.

34. The non-transitory computer-readable medium according to claim 28, further comprising performing a second spectral contrast enhancement operation within a second spectral contrast enhancer on a near end speech signal to produce a second processed speech signal.

35. The non-transitory computer-readable medium according to claim 34, comprising instructions which when executed by at least one processor cause the at least one processor to perform the second spectral contrast enhancement operation comprising:

instructions which when executed by a processor cause the processor to calculate a third plurality of subband factors based on information from the noise reference;

instructions which when executed by a processor cause the processor to calculate a fourth plurality of subband factors based on information from the near end speech signal;

instructions which when executed by a processor cause the processor to generate a contrast enhanced signal by applying the fourth plurality of subband factors to the near end speech signal subbands; and

instructions which when executed by a processor cause the processor to combine the third plurality of subband factors and the second contrast enhanced signal.

32. A non-transitory computer-readable medium comprising instructions which when executed by at least one processor cause the at least one processor to perform the first spectral contrast enhancement operation comprising:

instructions which when executed by a processor cause the processor to calculate a first plurality of subband factors based on information from the noise reference;

instructions which when executed by a processor cause the processor to calculate a second plurality of subband factors based on information from the far end speech signal;

instructions which when executed by a processor cause the processor to generate a contrast enhanced signal by applying the second plurality of subband factors to the far end speech signal subbands; and

instructions which when executed by a processor cause the processor to combine the first plurality of subband factors and the first contrast enhanced signal.