Sound synthesis process

• US 5,401,897 A
• Filed: 03/18/1993
• Issued: 03/28/1995
• Est. Priority Date: 07/26/1991
• Status: Expired due to Term

• Current Assignee: Gula Consulting Limited Liability Company (Intellectual Ventures LLC)
• Original Assignee: Orange S.A.
• Inventors: Rodet, Xavier, Depalle, Philippe
• Primary Examiner(s): Witkowski, Stanley J.
• Application Number:
  US08/030,101
• Time in Patent Office: 740 Days
• Field of Search: 84/603, 84/608, 84/659, 84/660, 84/663, 84/627, 84/693, 84/698, 84/622-625
• US Class Current: 84/625
• CPC Class Codes: G10H 2250/031 Spectrum envelope processing
• CPC Class Codes: G10H 2250/145 Convolution, e.g. of a music input signal with a desired impulse response to compute an output
• CPC Class Codes: G10H 2250/265 Blackman Harris window
• CPC Class Codes: G10H 7/105 using Fourier coefficients

Abstract

A sound synthesis process. The invention relates to an additive sound synthesis process, as shown in FIGS. 1A and 1B, in which sample blocks (16) are determined by performing the inverse Fourier transform of successive frequency spectra. The time-superimposed sample blocks (16) are added in order to form a sequence of samples representing the reconstituted sound wave.

Claims

1. Process for the synthesis of sounds, the steps comprising:

A) generating a synthesis signal by superimposing time-displaced signal blocks, which are overlapped in time, each block being obtained by an inverse orthogonal transform of a constructed frequency spectrum,

B) constructing said spectrum by carrying out the following steps;

choosing a spectral envelope,

then interactively and for each desired sinusoidal, discrete spectral frequency component, defined by its frequency, amplitude and phase parameters;

multiplying the spectral envelope by the amplitude of the component weighted by its phase factor, which is computed such that the phases of a given said sinusoidal component in overlapping blocks are equal at a point where the amplitudes of the envelopes of this sinusoidal component in the two overlapping blocks are equal, so as to obtain a pattern representing said frequency component,

adding the so obtained pattern to the spectrum being constructed,

C) adding the spectrum corresponding to the unwanted part of the signal to be synthesized to the spectrum obtained in Step B.

2. Process according to claim 1, wherein prior to the addition stage, each block constituted by samples is multiplied by a smoothing function so as to smooth the discontinuities appearing between successive sample blocks.

3. Process according to claim 1 wherein the step of choosing a spectral envelope, further comprises:

choosing a spectral envelope according to a grouping of the spectral components in one of the signal blocks, the spectral envelope is an orthogonal transform of a limited time base function.

4. Process according to claim 2, wherein the smoothing function is the ratio of a dividend function (div) by the limited time base function (fen), the dividend function being such that, displaced by a certain number of samples and added to itself, it gives a constant value on an interval between said overlapping blocks.

5. Process according to claim 4, wherein the dividend function is symmetrical.

6. Process according to claim 4, wherein the dividend function is a triangular function (20).

7. Process according to claim 4, wherein the dividend function is a trapezoidal function (21).

8. Process according to claim 3, wherein said envelopes only assume a non-negligible value in a frequency band centered on a positive frequency and contained in a range limited by -Fe/2 and +Fe/2, in which Fe is the sampling frequency.

9. Process according to claim 8, wherein the envelopes are made as narrow as possible.

10. Process according to claim 8, wherein, during building of frequency spectra, the discrete spectral components, grouped under said envelopes corresponding to a noise spectrum, are added to the frequency spectra being built.

11. Process according to claim 1, wherein:

the frequency and amplitude are interpolated.

12. Process according to claim 1, characterized in that the spectrum corresponding to a part of the signal considered non-sinusoidal is obtained by the multiplication of the spectral density of a white noise by a frequency response of a filter.

13. Process according to claim 12, characterized in that before multiplying the spectral density of the white noise by the frequency response of said filter, a convolution is performed between the spectrum of the white noise and the chosen spectral envelope and in that the convolution results are recorded in a storage table.

14. Process according to claim 1, characterized in that the chosen spectral envelope is oversampled compared with the sampling of the blocks and is recorded under its oversampled version in a storage table.

15. Process according to claim 1, characterized in that, in a preliminary state, parameters of the components of the spectrum are recorded in a storage table.

16. A process for the synthesis of sounds from a sound signal corresponding to a sample block (Cj) digitally stored as discrete components including frequencies (fi), amplitudes (Ai), phases (ρ

i) and noise components (Bi), i being the number of discrete components, the steps comprising;

selecting a type of frequency domain spectral envelope based on shape, said spectral envelope being of the window-type;

sampling said spectral envelope at said frequencies (fi) to create a sampled spectral envelope;

multiplying said sampled spectral envelope at each of the frequency points (fi) with a corresponding said amplitude (Ai) and phase (ρ

i) over a range of frequencies (fi) to obtain a pattern;

adding said pattern with the spectrum being constructed to obtain an auto-correlated spectrum;

adding said noise components (Bi) with said auto-correlated spectrum to obtain a frequency domain block;

obtaining an inverse Fourier transform of the frequency domain block to obtain a time-displaced signal block;

repeating said process for the synthesis of sounds for other sample blocks and obtaining a plurality of time displaced signal blocks, which overlap in time; and

superimposing said time displaced signal blocks in real time to synthesize sounds.

17. The process according to claim 16, wherein said step of selecting a spectral envelope further comprises the step of:

choosing spectral envelopes which ignore negligible sinusoidal components below 40 dB.

18. The process according to claim 16, wherein the spectral envelopes are selected from a group consisting of a Hann window and a Blackmann window.

19. The process according to claim 16, wherein the step of multiplying further comprises the step of:

storing said discrete components of said sample block (Cj) which correspond only to positive frequencies; and

completing said pattern for negative frequencies using symmetry.

20. The process according to claim 16, further comprising the step of:

multiplying each said sample block in time domain with a smoothing function to smooth discontinuities appearing in overlapping said sample blocks.