Singing voice synthesis

• US 6,304,846 B1
• Filed: 09/28/1998
• Issued: 10/16/2001
• Est. Priority Date: 10/22/1997
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Clements, Mark, Oliverio, James, Macon, Michael W., George, E. Bryan, Jensen-Link, Leslie
• Primary Examiner(s): Tsang, Fan
• Assistant Examiner(s): Opsasnick, Michael N.
• Application Number:
  US09/161,799
• Time in Patent Office: 1,114 Days
• Field of Search: 704/270, 704/500, 704/205-209, 434/307, 84/622
• US Class Current: 704/270
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser

Abstract

A method of singing voice synthesis uses commercially-available MIDI-based music composition software as a user interface (13). The user specifies a musical score and lyrics; as well as other music control parameters. The control information is stored in a MIDI file (11). Based on the input to the MIDI file (11) the system selects synthesis model parameters from an inventory (15) of linguistic voice data units. The units are selected and concatenated in a linguistic processor (17). The units are smoothed in the processing and are modified according to the music control parameters in musical processor (19) to modify the pitch, duration, and spectral characteristics of the concatenated voice units as specified by the musical score. The output waveform is synthesized using a sinusoidal model 20.

Claims

1. A method of singing voice synthesis comprising the steps of:

providing a musical score and lyrics and musical control parameters;

providing an inventory of recorded linguistic singing voice data units that have been analyzed off-line by a sinusoidal model representing segmented phonetic characteristics of an utterance;

selecting said recorded linguistic singing voice data units dependent on lyrics;

joining said recorded linguistic singing voice data units and smoothing boundaries of said joined data units selected;

modifying the recorded linguistic singing voice data units that have been joined and smoothed according to musical score and other musical control parameters to provide directives for a signal model; and

performing signal model synthesis using said directives.

2. The method of claim 1 wherein said signal model is a sinusoidal model.

3. The method of claim 2 wherein said sinusoidal model is an analysis-by-synthesis/overlap-add sinusoidal model.

4. The method of claim 1 wherein said selection of data units is by a decision tree method.

5. The method of claim 1 wherein said modifying step includes modifying the pitch, duration and spectral characteristics of the concatenated recorded linguistic singing voice data units as specified by the musical score and MIDI control information.