Coding of acoustic waveforms

• US 5,054,072 A
• Filed: 12/15/1989
• Issued: 10/01/1991
• Est. Priority Date: 04/02/1987
• Status: Expired due to Fees

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Quatieri, Thomas F. Jr., McAulay, Robert J.
• Primary Examiner(s): Shaw, Dale M.
• Assistant Examiner(s): Knepper, David D.
• Application Number:
  US07/456,183
• Time in Patent Office: 655 Days
• Field of Search: 364/513.5, 381/29-49
• US Class Current: 704/207
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders

Abstract

Encoding techniques and devices are based on a sinusoidal speech representation model. In one aspect of the invention, a pitch-adaptive channel encoding technique for amplitude coding varies the channel spacing in accordance with the pitch of the speaker'"'"'s voice. In another aspect of the invention, a phase synthesis technique locks rapidly-varying phases into synchrony with the phase of the fundamental. Phase coding techniques which introduce a voice-dependent random phase and a pitch-adaptive quadratic phase dispersion are also performed.

Claims

1. A method of coding speech for digital transmission, the method comprising:

sampling the speech to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples;

analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes and phases which, in summation, approximate the waveform of the speech frame;

estimating a pitch for each frame of samples;

coding data representative of the analyzed speech frame and the pitch for digital transmission;

synthesizing a set of reconstruction frequency components from the encoded data; and

establishing a pitch onset time at which the frequency components come into phase synchrony.

2. The method of claim 1 wherein the step of coding the frequency components further includes determining a pitch onset time to establish a time at which the frequency components come into phase synchrony.

3. The method of claim 1 wherein the step of analyzing each frame to extract frequency components further includes predicting the phases of the frequency components by homomorphic transformation and pitch onset time analysis, and the step of coding the frequency components includes coding only the phase residuals for transmission.

4. The method of claim 1 wherein the step of coding the frequency components further includes applying a pitch-dependent quadratic phase dispersion to the frequency components to eliminate the need to code phase values for the frequency components.

5. The method of claim 1 wherein the step of coding the frequency components further includes generating a voicing dependent random phase for said frequency components to eliminate the need to code phase values for the frequency components.

6. The method of claim 1 wherein the step of analyzing each frame to extract frequency components further includes determining a phase of a fundamental frequency by integrating an instantaneous pitch frequency, and defining the phases of the frequency components as multiples of the phase of the fundamental frequency.

7. A method of coding speech for digital transmission, the method comprising:

sampling the speech to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples;

analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes and phases;

estimating the pitch for each frame of samples;

constructing a spectral envelope from the amplitudes of the frequency components;

sampling the envelope based upon the pitch estimate to obtain a set of amplitude values at variable channel frequencies, the location of which vary with the pitch;

coding the amplitude values for digital transmission; and

synthesizing a set of reconstruction frequency components from the encoded values.

8. The method of claim 7 wherein the step of coding the amplitude values further includes defining a set of linearly-spaced channels in a baseband and a set of logarithmically-shaped channels in a higher frequency region.

9. The method of claim 8 wherein the step of defining said linear and logarithmatically-spaced channels further includes defining a transition frequency from said linearly-spaced frequency channels to said logarithmatically-spaced frequency channels based on a pitch measurement of the speech.

10. A speech coding device comprising:

sampling means for sampling a speech waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples;

analyzing means for analyzing each frame of samples by Fourier analysis to extract a set of variable frequency components having individual amplitude and phase values;

estimating means for estimating the pitch for each frame of samples;

coding means for coding data representative of the analyzed speech frame and a pitch for each frame;

synthesizing means for synthesizing a set of reconstruction frequency components from the encoded data; and

means for establishing a pitch onset time at which the frequency components come into phase synchrony.

11. The device of claim 10 wherein the analyzing means further includes a pitch onset estimator for establishing a time at which the frequency components come into phase.

12. The device of claim 10 wherein the analyzing means further includes a homomorphic phase estimator for estimating the phases of the frequency components and the coding means further includes means for coding only phase residuals for transmission.

13. The device of claim 10 wherein the coding means further includes a quadratic phase dispersion computer which eliminates the need to code phase values for the frequency components.

14. The device of claim 10 wherein the coding means further includes a random phase generator for generating a voicing dependent random phase for the frequency components.

15. The device of claim 10 wherein the analyzing means further includes means for determining the phase of a fundamental frequency by integrating an instantaneous pitch frequency and means for defining a series of onset times.

16. A speech coding device comprising:

sampling means for sampling a speech waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples;

analyzing means for analyzing each frame of samples by Fourier analysis to extract a set of variable frequency components having individual amplitude and phase values;

estimating means for estimating the pitch of the waveform;

envelope construction means for constructing a spectral envelope from the amplitudes of the frequency components;

envelope sampling means for sampling the envelope based upon the pitch estimate to obtain a set of amplitude values at variable channel frequencies, the number and spacing of which vary based upon the pitch;

coding means for coding the amplitude values for digital transmission; and

synthesizing means for synthesizing a set of reconstruction frequency components from the encoded values.

17. The device of claim 16 wherein the coding means further includes means for defining a first set of linearly-spaced frequency channels in a baseband, and a second set of logarithmatically-spaced channels in a higher frequency region.

18. The device of claim 17 wherein the coding means further includes means for defining a transition frequency from said linearly-spaced channels to said logarithmatically-spaced channels.

19. A system for processing an acoustic waveform comprising:

analyzing means for decomposing the waveform into a set of sinusoidal components having individual amplitudes which in sum approximate the waveform over an analysis frame;

pitch estimating means for estimating the pitch of the waveform for the analysis frame; and

synthesis means for generating a synthetic reproduction of the waveform from the data representative of the analyzed waveform and the pitch, including means for summing a set of sinusoidal reconstruction components and means for establishing a pitch onset time for each analysis frame at which time the phases of the sinusoidal reconstruction components come into synchrony.

20. The system of claim 19 wherein the waveform is a speech waveform.

21. The system of claim 19 wherein the analysis means further comprises means for analyzing the waveform by Fourier analysis.

22. The system of claim 19 wherein the system further comprises means for modifying the time scale of the synthetic reproduction of the waveform.

23. The system of claim 19 wherein the system further comprises means for coding and transmitting the data representative of the analyzed waveform and the pitch.