Speech enhancement system and method

• US 9,020,813 B2
• Filed: 11/14/2012
• Issued: 04/28/2015
• Est. Priority Date: 09/02/2005
• Status: Active Grant

• Current Assignee: Blackberry Limited
• Original Assignee: 2236008 Ontario Inc. (Blackberry Limited)
• Inventors: Paranjpe, Shreyas, Hetherington, Phillip A., Li, Xueman
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US13/676,803
• Publication Number:
  US 20130073284A1
• Time in Patent Office: 895 Days
• Field of Search: 704/219, 704/226
• US Class Current: 704/219
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04B 1/66 for reducing bandwidth of signals; for improving efficiency of transmission H04B1/68 takes precedence
• CPC Class Codes: H04B 3/04 Control of transmission; Equalising
• CPC Class Codes: H04M 3/002 Applications of echo suppressors or cancellers in telephonic connections in two-way loud-speaking telephone systems H04M9/08, echo suppressors or cancellers per se H04B3/20

Abstract

A speech enhancement system improves speech conversion within an encoder and decoder. The system includes a first device that converts sound waves into operational signals. A second device selects a template that represents an expected signal model. The selected template models speech characteristics of the operational signals through a speech codebook that is further accessed in a communication channel.

Claims

1. A system, comprising:

a speech enhancement processor configured to receive an input signal and output a processed signal; and

an encoder device coupled with the speech enhancement processor and configured to receive the processed signal from the speech enhancement processor, where the encoder device is configured to use a codebook to encode the processed signal for transmission over a communication channel;

where the speech enhancement processor is configured to modify one or more characteristics of the input signal based on the codebook associated with the encoder device to generate the processed signal.

2. The system of claim 1, where the codebook comprises a plurality of spectral shape templates.

3. The system of claim 2, where the speech enhancement processor comprises an attenuation device configured to modify a spectral shape of the input signal to generate the processed signal based on at least one of the spectral shape templates.

4. The system of claim 3, where the processed signal is a closer match than the input signal for the at least one of the spectral shape templates.

5. The system of claim 2, where the speech enhancement processor is configured to perform linear prediction analysis to generate its own spectral estimate of a formant frequency shape, and where the speech enhancement processor is configured to use the formant frequency shape to find a closest matching spectral shape of the plurality of spectral shapes in the codebook.

6. The system of claim 1, where the codebook is shared by the speech enhancement processor, the encoder device, and a decoder device coupled with the communication channel.

7. The system of claim 1, where the encoder device comprises an Adaptive Multirate (AMR) codec.

8. The system of claim 1, where the encoder device comprises an Enhanced Variable Rate Codec (EVRC).

9. The system of claim 1, where the speech enhancement processor comprises an attenuating device selected from the group consisting of an adaptive filter, a spectral subtractor, a beam-former, a blind signal separation element, a de-correlation element, a de-convolution element, a parametric modeler, or a perceptual masker that processes the input signal to generate the processed signal.

10. The system of claim 1, where the speech enhancement processor comprises a spectral subtractor configured to reduce a noise from the input signal to generate the processed signal.

11. The system of claim 1, where the speech enhancement processor comprises an adaptive filter configured to self-adjust its transfer function based on noise segments in the input signal.

12. The system of claim 1, where the speech enhancement processor comprises an adaptive beamformer configured to adapt to signals received from a plurality of sensors that comprise an input array.

13. A speech enhancement system, comprising:

a memory that retains a codebook of spectral shape templates used by an encoder device;

a speech enhancement processor coupled with the memory and the encoder device, where the speech enhancement processor is configured to;

receive an input signal;

modify at least one spectral characteristic of the input signal based on at least one of the spectral shape templates to generate a processed signal; and

output the processed signal to the encoder device that uses the codebook to encode the processed signal for transmission over a communication channel.

14. The speech enhancement system of claim 13, where the speech enhancement processor comprises an attenuation device configured to modify a spectral shape of the input signal to generate the processed signal based on the at least one of the spectral shape templates, and where the processed signal is a closer match than the input signal for the at least one of the spectral shape templates.

15. The speech enhancement system of claim 13, where the speech enhancement processor comprises an attenuating device selected from the group consisting of an adaptive filter, a spectral subtractor, a beam-former, a blind signal separation element, a de-correlation element, a de-convolution element, a parametric modeler, or a perceptual masker that processes the input signal to generate the processed signal.

16. A speech enhancement method, comprising:

receiving an input signal at a speech enhancement processor;

accessing, by the speech enhancement processor, a memory that retains a codebook of spectral shape templates used by an encoder device;

modifying, by the speech enhancement processor, at least one spectral characteristic of the input signal based on at least one of the spectral shape templates to generate a processed signal; and

outputting the processed signal from the speech enhancement processor to the encoder device that uses the codebook to encode the processed signal for transmission over a communication channel.

17. The method of claim 16, where the speech enhancement processor comprises an attenuation device, where the step of modifying comprises modifying a spectral shape of the input signal by the attenuation device to generate the processed signal based on the at least one of the spectral shape templates, and where the processed signal is a closer match than the input signal for the at least one of the spectral shape templates.

18. The method of claim 16, where the speech enhancement processor comprises a spectral subtractor, and where the step of modifying comprises reducing a noise from the input signal by the spectral subtractor to generate the processed signal.

19. The method of claim 16, where the speech enhancement processor comprises an adaptive filter, and where the step of modifying comprises adjusting a transfer function of the adaptive filter based on noise segments in the input signal.

20. The method of claim 16, further comprising:

performing linear prediction analysis by the speech enhancement processor to generate its own spectral estimate of a formant frequency shape; and

using the formant frequency shape by the speech enhancement processor to find a closest matching spectral shape of the plurality of spectral shapes in the codebook.