Method and Device for Selecting Acoustic Units and a Voice Synthesis Method and Device

• US 20070276666A1
• Filed: 08/30/2005
• Published: 11/29/2007
• Est. Priority Date: 09/16/2004
• Status: Abandoned Application

• Current Assignee: Orange S.A.
• Original Assignee: Orange S.A.
• Inventors: Rouibia, Soufiane, Rosec, Olivier, Moudenc, Thierry
• Application Number:
  US11/662,652
• Publication Number:
  US 20070276666A1
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G10L 13/07 Concatenation rules

Abstract

A method for selecting acoustic units each of which contains a natural speech signal and symbolic parameters involves a stage (4) for determining at least one target symbolic unit sequence; a stage (5) for determining a contextual acoustic model sequence corresponding to the target sequence; a stage (6) for determining an acoustic template on the basis of the contextual acoustic model sequence and a stage (7) for selecting the acoustic unit sequence according to the acoustic template applied to the target symbolic unit sequence. The invention is used for voice synthesis.

Claims

1-22. -22. (canceled)

23. A process for the selection of acoustic units corresponding to acoustic productions of symbolic units of a phonological nature, the said acoustic units each comprising a natural speech signal and symbolic parameters representing their acoustic characteristics, the said process comprising:

determining at least one target sequence of symbolic units

determining a sequence of contextual acoustic models corresponding to the said target sequence,

determining an acoustic template from the said sequence of contextual acoustic models; and

selecting a sequence of acoustic units on the basis of the said acoustic template applied to the said target sequence of symbolic units.

24. A process according to claim 23, wherein the process comprises, prior to determining at least one target sequence, determining contextual acoustic models carried out on the basis of a given set of acoustic units.

25. A process according to claim 24, wherein contextual acoustic models comprises:

determining a probabilistic model for each acoustic unit obtained from a finite set of models each comprising an observable random process corresponding to the acoustic production of symbolic units and a non-observable random process having known probabilistic properties referred to as “

Markov properties”

,

classifying the said probabilistic models on the basis of their symbolic parameters,

the observable and non-observable random processes of the models in each class constituting the said contextual acoustic models.

26. A process according to claim 25, wherein determining contextual acoustic models further comprises determining probabilistic models adapted to the phonetic context whose parameters are used in the course of classifying the said probabilistic models.

27. A process according to claim 25, wherein classifying probabilistic models comprises a classification using decision trees, the parameters of the said probabilistic models being modified by the path of the said decision trees to form the said contextual acoustic models.

28. A process according to claim 23, wherein determining at least one target sequence of symbolic units comprises

acquiring a symbolic representation of a text, and

determining at least one sequence of symbolic units from the said symbolic representation.

29. A process according to claim 23, wherein determining a sequence of contextual acoustic models, comprises:

modelling the said target sequence by breaking it down on the basis of probabilistic models in order to provide a sequence of probabilistic models corresponding to the said target sequence; and

forming contextual acoustic models by parameter modification of the said probabilistic models to form the said sequence (Λ

₁^M) of contextual acoustic models.

30. A process according to claim 23, wherein determining an acoustic template (C) comprises

determining the time period for each contextual acoustic model;

determining a time sequence of models; and

determining a sequence of corresponding acoustic frames forming the said acoustic template.

31. A process according to claim 30, wherein determining the time period of each contextual acoustic model comprises prediction of its duration.

32. A process according to claim 23, wherein the selection of a sequence of acoustic units comprises:

determining a reference sequence of symbolic units from the said target sequence, each symbolic unit in the reference sequence being associated with a set of acoustic units, and

aligning between the acoustic units associated with the said reference sequence and the said acoustic template.

33. A process according to claim 32, selecting a sequence of acoustic units further comprise the segmentation of the said acoustic template on the basis of the said reference sequence.

34. A process according to claim 33, wherein the segmentation comprises a breakdown of the said acoustic template on the basis of time units.

35. A process according to claim 33, wherein when the said template is segmented each segment corresponds to one symbolic unit of the reference sequence and aligning comprises alignment of each segment of the template with each of the acoustic units associated with the corresponding symbolic unit originating from the reference sequence.

36. A process according to claim 32, wherein the alignment comprises the determination of an optimal alignment as determined by an algorithm known as a “

DTW”

algorithm.

37. A process according to claim 32, wherein the selection further comprises the preselection through which it is possible to determine possible acoustic units for each symbolic unit of the reference sequence, the said alignment substage comprising a substage of final selection between these possible units.

38. A process according to claim 23, wherein the said contextual acoustic models are probabilistic models having observable processes with continuous values and non-observable processes with discrete values forming the states of this process.

39. A process according to claim 23, wherein the said contextual acoustic models are probabilistic models having non-observable processes with continuous values.

40. A process of synthesising a speech signal comprising a selection process according to claim 23, the said target sequence corresponding to a text which has to be synthesised and the process further comprising synthesising a voice sequence from the said sequence of selected acoustic units.

41. A process according to claim 40, wherein synthesis comprises:

recovering a natural speech signal for each acoustic unit selected,

smoothing the speech signals, and

concatenation of the different natural speech signals.

42. A device for selecting acoustic units corresponding to acoustic productions of symbolic units of a phonological nature, comprising suitable means for carrying out a selection process according to claim 23.

43. A device for the synthesis of a speech signal, including means suitable for carrying out a selection process according to claim 23.

44. A computer program on a data carrier, comprising suitable instructions for carrying out a selection process according to claim 23 when the program is loaded into and run on a data processing system.