Sound processing apparatus and method, and program therefor

• US 20060212298A1
• Filed: 03/09/2006
• Published: 09/21/2006
• Est. Priority Date: 03/10/2005
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Bonada, Jordi, Yoshioka, Yasuo, Kemmochi, Hideki
• Granted Patent: US 7,945,446 B2
• Time in Patent Office: Days
• US Class Current: 704/278
• CPC Class Codes: G10H 1/10 for obtaining chorus, celeste or ensemble effects continuous modulation G10H1/043
• CPC Class Codes: G10H 1/366 with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice
• CPC Class Codes: G10H 2210/251 Chorus, i.e. automatic generation of two or more extra voices added to the melody, e.g. by a chorus effect processor or multiple voice harmonizer, to produce a chorus or unison effect, wherein individual sounds from multiple sources with roughly the same timbre converge and are perceived as one
• CPC Class Codes: G10H 2250/031 Spectrum envelope processing
• CPC Class Codes: G10H 5/005 Voice controlled instruments
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser

Abstract

Spectrum envelope of an input sound is detected. In the meantime, a converting spectrum is acquired which is a frequency spectrum of a converting sound comprising a plurality of sounds, such as unison sounds. Output spectrum is generated by imparting the detected spectrum envelope of the input sound to the acquired converting spectrum. Sound signal is synthesized on the basis of the generated output spectrum. Further, a pitch of the input sound may be detected, and frequencies of peaks in the acquired converting spectrum may be varied in accordance with the detected pitch of the input sound. In this manner, the output spectrum can have the pitch and spectrum envelope of the input sound and spectrum frequency components of the converting sound comprising a plurality of sounds, and thus, unison sounds can be readily generated with simple arrangements.

Claims

1. A sound processing apparatus comprising:

an envelope detection section that detects a spectrum envelope of an input sound;

a spectrum acquisition section that acquires a converting spectrum that is a frequency spectrum of a converting sound comprising a plurality of sounds;

a spectrum conversion section that generates an output spectrum created by imparting the spectrum envelope of the input sound, detected by said envelope detection section, to the converting spectrum acquired by said spectrum acquisition section; and

a sound synthesis section that synthesizes a sound signal on the basis of the output spectrum generated by said spectrum conversion section.

2. A sound processing apparatus as claimed in claim 1 wherein said spectrum conversion section includes a pitch adjustment section that adjusts a pitch of the converting spectrum acquired by said spectrum acquisition section, and said spectrum conversion section generates an output spectrum created by imparting the spectrum envelope of the input sound to the converting spectrum adjusted in pitch by said pitch adjustment section.

3. A sound processing apparatus as claimed in claim 1 which further comprises a pitch detection section that detects a pitch of the input sound, and wherein said spectrum conversion section includes:

a pitch conversion section that varies frequencies of peaks in the converting spectrum, acquired by said spectrum acquisition section, in accordance with the pitch of the input sound detected by said pitch detection section; and

an envelope adjustment section that adjusts a spectrum envelope of the converting spectrum, having frequency components varied by said pitch conversion section, to substantially agree with the spectrum envelope of the input sound detected by said envelope detection section.

4. A sound processing apparatus as claimed in claim 3 wherein said pitch conversion section expands or reduces a whole of the converting spectrum in accordance with the pitch of the input sound detected by said pitch detection section.

5. A sound processing apparatus as claimed in claim 3 wherein said pitch conversion section displaces the frequency of each of the peaks in accordance with the pitch of the input sound while maintaining spectrum distribution regions formed around each of the peaks.

6. A sound processing apparatus as claimed in claim 1 which further comprises a pitch detection section that detects a pitch of the input sound, and

wherein said spectrum acquisition section acquires a converting spectrum of a converting sound, among a plurality of the converting sounds differing from each other in fundamental pitch, which has a fundamental pitch closest to the pitch detected by said pitch detection section.

7. A sound processing apparatus as claimed in claim 6 wherein said spectrum conversion section includes:

a pitch conversion section that varies frequencies of peaks in the converting spectrum, acquired by said spectrum acquisition section, to agree with the pitch of the input sound detected by said pitch detection section; and

an envelope adjustment section that adjusts a spectrum envelope of the converting spectrum, having frequency components varied by said pitch conversion section, to substantially agree with the spectrum envelope of the input sound detected by said envelope detection section.

8. A sound processing apparatus as claimed in claim 1 wherein the converting sound of the converting spectrum acquired by said spectrum acquisition section comprises a plurality of sounds uttered in unison.

9. A sound processing apparatus as claimed in claim 1 wherein said spectrum acquisition section acquires the converting spectrum that varies over time.

10. A sound processing apparatus as claimed in claim 1 wherein said sound synthesis section synthesizes a sound signal based on the output spectrum as long as generation of the input sound lasts.

11. A sound processing apparatus as claimed in claim 10 wherein said spectrum acquisition section sequentially acquires a limited plurality of the converting spectrums in accordance with passage of time, and said spectrum acquisition section re-acquires any of the limited plurality of the converting spectrums as long as the generation of the input sound lasts.

12. A sound processing apparatus as claimed in claim 1 which is provided as an attachment to a karaoke apparatus, and wherein the input sound is a sound signal picked up by a microphone of the karaoke apparatus.

13. A sound processing apparatus comprising:

an envelope detection section that detects a spectrum envelope of an input sound;

a spectrum acquisition section that acquires either one of a first converting spectrum that is a frequency spectrum of a converting sound, and a second converting spectrum that is a frequency spectrum of a sound having substantially a same pitch as the converting sound indicated by said first converting spectrum and having a greater bandwidth at each peak than said first converting spectrum;

a spectrum conversion section that generates an output spectrum created by imparting the spectrum envelope of the input sound, detected by said envelope detection section, to the converting spectrum acquired by said spectrum acquisition section; and

a sound synthesis section that synthesizes a sound signal on the basis of the output spectrum generated by said spectrum conversion section.

14. A sound processing apparatus 13 wherein said first converting spectrum is a frequency spectrum of a converting sound comprising a single sound, and said second converting spectrum is a frequency spectrum of a converting sound comprising a plurality of sounds.

15. A sound processing apparatus 13 wherein the first and second converting spectrums are each a frequency spectrum of a converting sound comprising a plurality of mutually-different sounds.

16. A method for processing an input sound, said method comprising:

a step of detecting a spectrum envelope of an input sound;

a step of acquiring a converting spectrum that is a frequency spectrum of a converting sound comprising a plurality of sounds;

a step of generating an output spectrum created by imparting the spectrum envelope of the input sound, detected by said step of detecting, to the converting spectrum acquired by said step of acquiring; and

a step of synthesizing a sound signal on the basis of the output spectrum generated by said step of generating.

17. A program containing a group of instructions for causing a computer to execute a procedure for processing an input sound, said procedure comprising:

a step of detecting a spectrum envelope of an input sound;

a step of acquiring a converting spectrum that is a frequency spectrum of a converting sound comprising a plurality of sounds;

a step of generating an output spectrum created by imparting the spectrum envelope of the input sound, detected by said step of detecting, to the converting spectrum acquired by said step of acquiring; and

a step of synthesizing a sound signal on the basis of the output spectrum generated by said step of generating.

18. A method for processing an input sound, said method comprising:

a step of detecting a spectrum envelope of an input sound;

a step of acquiring either one of a first converting spectrum that is a frequency spectrum of a converting sound, and a second converting spectrum that is a frequency spectrum of a sound having substantially a same pitch as the converting sound indicated by said first converting spectrum and having a greater bandwidth at each peak than said first converting spectrum;

a step of generating an output spectrum created by imparting the spectrum envelope of the input sound, detected by said step of detecting, to the converting spectrum acquired by said step of acquiring; and

a step of synthesizing a sound signal on the basis of the output spectrum generated by said step of generating.

19. A program containing a group of instructions for causing a computer to execute a procedure for processing an input sound, said procedure comprising:

a step of detecting a spectrum envelope of an input sound;

a step of acquiring either one of a first converting spectrum that is a frequency spectrum of a converting sound, and a second converting spectrum that is a frequency spectrum of a sound having substantially a same pitch as the converting sound indicated by said first converting spectrum and having a greater bandwidth at each peak than said first converting spectrum;

a step of generating an output spectrum created by imparting the spectrum envelope of the input sound, detected by said step of detecting, to the converting spectrum acquired by said step of acquiring; and

a step of synthesizing a sound signal on the basis of the output spectrum generated by said step of generating.