Singing voice edit assistant method and singing voice edit assistant device

• US 10,497,347 B2
• Filed: 09/28/2018
• Issued: 12/03/2019
• Est. Priority Date: 09/29/2017
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Ogasawara, Motoki
• Primary Examiner(s): Fletcher, Marlon T
• Application Number:
  US16/145,776
• Publication Number:
  US 20190103084A1
• Time in Patent Office: 431 Days
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/0091 Means for obtaining special acoustic effects combined with modulation G10H1/043
• CPC Class Codes: G10H 1/12 by filtering complex waveforms G10H1/14, G10H1/16 take precedence
• CPC Class Codes: G10H 2210/265 Acoustic effect simulation, i.e. volume, spatial, resonance or reverberation effects added to a musical sound, usually by appropriate filtering or delays physical modeling of room acoustics G10H2250/531; formant synthesis G10H2250/481
• CPC Class Codes: G10H 2210/331 Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale
• CPC Class Codes: G10H 2220/116 for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope non-graphical waveform editing G10H2250/615
• CPC Class Codes: G10H 2250/455 Gensound singing voices, i.e. generation of human voices for musical applications, vocal singing sounds or intelligible words at a desired pitch or with desired vocal effects, e.g. by phoneme synthesis formant synthesis G10H2250/481; parcor synthesis G10H2250/505; modulation effects G10H2210/195; ensemble effects G10H2210/245; speech synthesis in general G10L13/00
• CPC Class Codes: G10H 7/008 Means for controlling the transition from one tone waveform to another
• CPC Class Codes: G10L 13/0335 Pitch control

Abstract

A singing voice edit assistant method, performed by a computer, includes: reading out singing style data that prescribes individuality of a singing voice and acoustic effects to be added to the singing voice, the singing voice being represented by singing voice data to be synthesized by the computer based on score data representing a time series of notes and lyrics data representing words corresponding to the respective notes; and synthesizing singing voice data while adjusting the individuality and adding acoustic effects based on the score data, the lyrics data, and the singing style data read out by the reading process.

Claims

1. A singing voice edit assistant method, performed by a computer, comprising:

reading out singing style data that includes first data that indicates acoustic effects to be added to a singing voice and second data that prescribes individuality of the singing voice, wherein the singing voice is represented by singing voice data;

synthesizing, by the computer, the singing voice data based on score data representing a time series of notes and lyrics data representing words corresponding to the respective notes;

executing signal processing, according to the first data that indicates acoustic effects to be added to the singing voice, on the singing voice data that has been synthesized based on the score data and the lyrics data; and

modifying values of parameters of the score data and the lyrics data, using the second data that prescribes individuality of the singing voice, before the singing voice data is synthesized based on the score data and the lyrics data.

2. The edit assistant method according to claim 1, wherein the first data that indicates acoustic effects to be added to the singing voice data that has been synthesized varies according to music genre.

3. The edit assistant method according to claim 1, further comprising:

writing, into a memory, the score data, the lyrics data, and the singing style data such that the score data, the lyrics data, and the singing style data are correlated with each other.

4. The edit assistant method according to claim 1, wherein a plural pieces of singing style data respectively corresponding to music genres are stored in a memory;

and

wherein in the reading out the singing style data, a piece of singing style data corresponding to a music genre specified by a user is read out from the memory from among the plural pieces of singing style data stored in the memory.

5. A singing voice edit assistant device comprising:

a memory configured to store instructions, and

a processor configured to execute the instructions,

wherein the instructions, when executed by the processor, cause the singing voice edit assistant device to;

read out singing style data that includes first data that indicates acoustic effects to be added to a singing voice and second data that prescribes individuality of the singing voice, wherein the singing voice is represented by singing voice data;

synthesize the singing voice data based on score data representing a time series of notes and lyrics data representing words corresponding to the respective notes;

execute signal processing, according to the first data that indicates acoustic effects to be added to the singing voice, on the singing voice data that has been synthesized based on the score data and the lyrics data; and

modify values of parameters of the score data and the lyrics data, using the second data that prescribes individuality of the singing voice, before the singing voice data is synthesized based on the score data and the lyrics data.

6. The singing voice edit assistant device according to claim 5, wherein the first data that indicates acoustic effects to be added to the singing voice data that has been synthesized varies according to music genre.

7. The singing voice edit assistant device according to claim 5, further comprising instructions stored in the memory that, when executed by the processor, cause the singing voice edit assistant device to:

write, into a memory, the score data, the lyrics data, and the singing style data such that the score data, the lyrics data, and the singing style data are correlated with each other.

8. The singing voice edit assistant device according to claim 5, wherein a plural pieces of singing style data respectively corresponding to music genres are stored in a memory;

and

wherein when the singing voice edit assistant device is caused to read out the signing style data, a piece of singing style data corresponding to a music genre specified by a user is read out from the memory from among the plural pieces of singing style data stored in the memory.

9. A non-transitory computer-readable storage medium storing instructions for causing a computer to execute a control method for a singing voice edit assistant device, the method comprising:

reading out singing style data that includes first data that indicates acoustic effects to be added to a singing voice and second data that prescribes individuality of the singing voice, wherein the singing voice is represented by singing voice data;

synthesizing, by the computer, the singing voice data based on score data representing a time series of notes and lyrics data representing words corresponding to the respective notes;

executing signal processing, according to the first data that indicates acoustic effects to be added to the singing voice, on the singing voice data that has been synthesized based on the score data and the lyrics data; and

modifying values of parameters of the score data and the lyrics data, using the second data that prescribes individuality of the singing voice, before the singing voice data is synthesized based on the score data and the lyrics data.