Method and apparatus for sculpting synthesized speech

• US 8,527,281 B2
• Filed: 06/29/2012
• Issued: 09/03/2013
• Est. Priority Date: 04/17/2002
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Rutten, Peter, Taylor, Paul A.
• Primary Examiner(s): Desir, Pierre-Louis
• Assistant Examiner(s): Serrou, Abdelali
• Application Number:
  US13/537,995
• Publication Number:
  US 20120303361A1
• Time in Patent Office: 431 Days
• Field of Search: 704/278, 704/275, 704/276, 704/260, 704/269, 704/258
• US Class Current: 704/278
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 13/06 Elementary speech units used in speech synthesisers; Concatenation rules

Abstract

Methods and systems for sculpting synthesized speech using a graphic user interface are disclosed. An operator enters a stream of text that is used to produce a stream of target phonetic-units. The stream of target phonetic-units is then submitted to a unit-selection process to produce a stream of selected phonetic-units, each selected phonetic-unit derived from a database of sample phonetic-units. After the stream of sample phonetic-units is selected, an operator can remove various selected phonetic-units from the stream of selected phonetic-units, prune the sample phonetic-database and edit various cost functions using the graphic user interface. The edited speech information can then be submitted to the unit-selection process to produce a second stream of selected phonetic-units.

Claims

1. A speech processor, comprising:

a unit-selection device that processes a stream of target phonetic-units to produce a stream of respective selected phonetic-units, the selected phonetic-units being selected on the basis of at least a set of target-cost functions that determine target-costs between each target phonetic-unit and respective groups of sample phonetic-units; and

a phonetic editor configured to;

i. enable an operator to selectively designate one or more selected phonetic-units in the stream of selected phonetic-units,

ii. automatically remove the one or more designated phonetic units from the stream of selected phonetic-units, and

iii. prune one or more non-selected phonetic-units each of which relates to the same phonetic-unit group as a first removed selected phonetic unit.

2. A speech processor as in claim 1, wherein the one or more removed phonetic-units is precluded from re-selection by a subsequent unit-selection process.

3. A speech processor as in claim 1, wherein the phonetic editor is further configured to edit at least a first target-cost function.

4. A speech processor as in claim 3, wherein the phonetic editor is configured to change at least one or more parameters of the first target-cost function.

5. A speech processor as in claim 4, wherein the one or more parameters includes at least one of a center point and a standard deviation.

6. A speech processor as in claim 3, wherein the edited target-cost function is at least one of a duration function, a pitch function, and an amplitude function.

7. A speech processor as in claim 1, wherein the phonetic editor is configured to enable an operator to compare two or more streams of speech with at least one stream of speech generated using one or more editing functions.

8. A speech processor as in claim 1, wherein the unit-selection device is enabled to select a new selected phonetic-unit to replace at least one removed phonetic-unit.

9. A method for processing speech information, comprising:

selecting a stream of selected phonetic-units from a database of sample phonetic-units, wherein the step of selecting is based on a stream of target phonetic-units with respective target-costs relating to the sample phonetic-units; and

performing an editing function on the stream of selected phonetic-units, the editing function including;

i. selectively designating one or more selected phonetic-units,

ii. automatically removing the one or more designated phonetic units from the stream of selected phonetic-units, and

iii. pruning one or more non-selected phonetic-units each of which relates to the same phonetic-unit group as a first removed selected phonetic unit.

10. A method as in claim 9, wherein performing an editing function includes editing at least one cost function.

11. A method as in claim 10, wherein performing an editing function includes changing at least one or more parameters of a target-cost function.

12. A method as in claim 11, wherein the one or more parameters include at least one of a center point and a standard deviation.

13. A method as in claim 11, wherein the edited target-cost function is selected from one of a duration function, a pitch function and an amplitude function.

14. A method as in claim 11, wherein the step of pruning comprises entering a value in a window of the graphic user interface.

15. A method as in claim 11, wherein the step of pruning comprises defining a pruning threshold having regard to a reference phonetic-unit.

16. A method as in claim 9, wherein the step of editing the at least one cost function includes re-drawing some or all of the cost function.