Generation of synthetic speech

• US 20050171777A1
• Filed: 04/29/2003
• Published: 08/04/2005
• Est. Priority Date: 04/29/2002
• Status: Abandoned Application

• Current Assignee: David Moore, John Coleman
• Original Assignee: David Moore, John Coleman
• Inventors: Moore, David, Coleman, John
• Application Number:
  US10/512,817
• Publication Number:
  US 20050171777A1
• Time in Patent Office: Days
• US Class Current: 704/265
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 2021/0135 Voice conversion or morphing

Abstract

There is disclosed a method of generating synthetic speech sound data relating to first and second utterances. Interpolation between or extrapolation from first and second sets of parameters encoding said utterances results in a third set of parameters used to synthesise the synthetic speech sound. Each set of parameters preferably includes separate source parameters and spectral parameters derived using linear prediction coding. Related methods of trailing and diagnosis, and related apparatus are also disclosed.

Claims

1. A method of training a subject to discriminate between first and second utterances, the method comprising the steps of:

generating data representing a synthetic speech sound by extrapolation from or interpolation between said first and second utterances, said synthetic speech sound lying respectively outside or inside a range of variation defined by the first and second utterances;

reproducing the synthetic speech sound from the data; and

determining whether the subject is capable of discriminating between said synthetic speech sound and another test speech sound related to said first and second utterances.

3. The method of claim 1 or 2 wherein said another test speech sound is also generated by extrapolation from or interpolation between said first and second utterances.

4. The method of any of claims 1 to 3 further comprising the steps of:

in response to the step of determining, generating further data representing a further synthetic speech sound by extrapolation from or interpolation between said first and second utterances; and

reproducing said further synthetic speech sound from said further data.

5. The method of any of claims 1 to 4 further comprising the step of:

providing first and second sets of parameters encoding first and second recorded speech samples of said first and second utterances,

each step of extrapolation or interpolation comprising extrapolating from or interpolating between the first and second sets of parameters to form a third set of parameters,

each step of reproducing comprising generating the synthetic speech sound from the respective third set of parameters.

17. The method of any of claims 1 to 5 wherein the data representing the synthetic speech sound is generated using the method of any of claims 6 to 16.

28. A computer readable medium comprising computer program instructions arranged to carry out the method steps of any of claims 1 to 17 when executed on a computer.

2. A method of testing a subject, comprising the steps of:

generating data representing a synthetic speech sound by extrapolation from or interpolation between first and second utterances, said synthetic speech sound lying respectively outside or inside a range of variation defined by the first and second utterances;

reproducing the synthetic speech sound from the data; and

determining whether the subject is capable of discriminating between said synthetic speech sound and another test speech sound related to said first and second utterances.

6. A method of generating data representing a synthetic speech sound related to first and second utterances, comprising the steps of:

providing first and second sets of parameters encoding first and second recorded speech samples of the first and second utterances;

interpolating between or extrapolating from the first and second sets of parameters to form a third set of parameters; and

generating the synthetic speech sound data from the third set of parameters.

7. The method of claim 6 wherein each of the first and second sets of parameters comprises a respective set of source parameters and a respective set of spectral parameters, the spectral parameters being derived by linear prediction coding.

8. The method of claim 7 wherein each set of source parameters includes one or more of a fundamental frequency, a probability of voicing, a measure of amplitude and a largest cross correlation found at any lag of the respective recorded speech sample.

9. The method of either of claims 7 or 8 wherein each set of spectral parameters comprises a plurality of reflection coefficients calculated for each of a plurality of time frames the respective recorded speech sample.

10. The method of any of claims 7 to 9 wherein the step of generating the data representing the synthetic speech sound comprises the step of applying linear prediction synthesis to the third set of parameters.

11. The method of any of claims 7 to 10 wherein the step of interpolating or extrapolating comprises the steps of:

interpolating between or extrapolating from the spectral coefficients of the first and second sets of parameters; and

using the source parameters of only a selected one of the first and second sets of parameters.

12. The method of claim 11 further comprising the steps of:

generating data representing a first test synthetic speech sound from the spectral parameters of the first set of parameters and the source parameters of the second set of parameters;

generating data representing a second test synthetic speech sound from the spectral parameters of the second set of parameters and the source parameters of the first set of parameters; and

selecting the source parameters for use in the step of interpolation by comparison of the first and second synthetic test speech sounds according to predetermined criteria.

13. The method of claim 12 wherein, in the step of selecting, the source parameters used to generate the more natural sounding of the first and second synthetic test speech sounds are chosen for use in the step of interpolating.

14. The method of claim 6 wherein each of the first and second sets of parameters comprises a respective set of formant parameters.

15. The method of any of claims 6 to 14 further comprising the steps of:

providing respective first and second recorded speech samples of the first and second utterances; and

encoding the first and second speech samples to generate the first and second sets of parameters.

16. The method of claim 15 further comprising the step of aligning the first and second recorded speech samples prior to the step of encoding so that the waveforms of the samples are synchronized in time.

29. A computer readable medium comprising data representing a synthetic speech sound generated according to the method steps of any of claims 6 to 16.

18. Apparatus for generating data representing a synthetic speech sound related to first and second utterances, comprising:

an input parameter memory arranged to receive and store first and second sets of parameters encoding first and second recorded speech samples of the first and second utterances;

a speech sound calculator arranged to interpolate between or extrapolate from the first and second sets of parameters to form a third set of parameters; and

a synthesiser arranged to generate the synthetic speech sound data from the third set of parameters.

19. The apparatus of claim 18 wherein each of the first and second sets of parameters comprises a respective set of source parameters and a respective set of spectral parameters, the spectral parameters being derived by linear prediction coding.

20. The apparatus of claim 19 wherein each set of source parameters includes one or more of a fundamental frequency, a probability of voicing, a measure of amplitude and a largest cross correlation found at any lag of the respective recorded speech sample.

21. The apparatus of either of claims 19 or 20 wherein each set of spectral parameters comprises a plurality of reflection coefficients calculated for each of a plurality of time frames the respective recorded speech sample.

22. The apparatus of any of claims 19 to 21 wherein, to generate the data representing the synthetic speech sound, the synthesiser is arranged to apply linear prediction synthesis to the third set of parameters.

23. The apparatus of any of claims 19 to 22 wherein the calculator is arranged to:

interpolate between or extrapolate from the spectral coefficients of the first and second sets of parameters; and

to

use the source parameters of only a selected one of the first and second sets of parameters.

24. The apparatus of claim 23 further arranged to:

generate data representing a first test synthetic speech sound from the spectral parameters of the first set of parameters and the source parameters of the second set of parameters;

generate data representing a second test synthetic speech sound from the spectral parameters of the second set of parameters and the source parameters of the first set of parameters; and

select the source parameters for use in the step of interpolation by comparison of the first and second synthetic test speech sounds according to predetermined criteria.

25. Apparatus for training a subject to discriminate between first and second utterances, comprising:

a playback device for reproducing a synthetic speech sound from data representing the synthetic speech sound, generated by extrapolation from or interpolation between said first and second utterances, said synthetic speech sound respectively lying outside or within a range of variation defined by the first and second utterances;

an input device; and

logic for determining, from signals received from said input device, whether the subject is capable of discriminating between said synthetic speech sound and another test speech sound related to said first and second utterances.

26. The apparatus of claim 25 wherein said other test speech sound is also generated by extrapolation from or interpolation between said first and second utterances.

27. The apparatus of claim 25 wherein the logic is adapted to cause the playback device to reproduce a further synthetic speech sound, dependent on the signals received from the input device.