Tone processing apparatus and method

• US 20080236364A1
• Filed: 01/07/2008
• Published: 10/02/2008
• Est. Priority Date: 01/09/2007
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Bonada, Jordi, Fujishima, Takuya, Boer, Maarten De
• Granted Patent: US 7,750,228 B2
• Time in Patent Office: Days
• US Class Current: 84/601
• CPC Class Codes: G10H 1/14 during execution voice controlled instruments G10H5/005
• CPC Class Codes: G10H 1/183 Channel-assigning means for polyphonic instruments
• CPC Class Codes: G10H 1/344 Structural association with individual keys electrically operated wind-actuated organs G10B3/22
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2210/095 Inter-note articulation aspects, e.g. legato or staccato
• CPC Class Codes: G10H 2210/381 Manual tempo setting or adjustment tempo setting by interpretation of conducting movements G10H2220/206
• CPC Class Codes: G10H 2210/565 Manual designation or selection of a tonality
• CPC Class Codes: G10H 2220/221 Keyboards, i.e. configuration of several keys or key-like input devices relative to one another details of individual keys or key-like devices G10H2220/265; continuous keyboards or keyboards implementing specific musical scales, e.g. quartertone G10H2210/395; switch matrix keyboards, e.g. on guitar necks G10H2220/295
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2240/135 Library retrieval index, i.e. using an indexing scheme to efficiently retrieve a music piece
• CPC Class Codes: G10H 2240/155 Library update, i.e. making or modifying a musical database using musical parameters as indices data structures involving musical parameters G10H2240/005
• CPC Class Codes: G10H 2250/035 Crossfade, i.e. time domain amplitude envelope control of the transition between musical sounds or melodies, obtained for musical purposes, e.g. for ADSR tone generation, articulations, medley, remix audio mixers H04H60/04
• CPC Class Codes: G10H 2250/455 Gensound singing voices, i.e. generation of human voices for musical applications, vocal singing sounds or intelligible words at a desired pitch or with desired vocal effects, e.g. by phoneme synthesis formant synthesis G10H2250/481; parcor synthesis G10H2250/505; modulation effects G10H2210/195; ensemble effects G10H2210/245; speech synthesis in general G10L13/00
• CPC Class Codes: G10H 2250/625 Interwave interpolation, i.e. interpolating between two different waveforms, e.g. timbre or pitch or giving one waveform the shape of another while preserving its frequency or vice versa
• CPC Class Codes: G10H 2250/641 Waveform sampler, i.e. music samplers; Sampled music loop processing, wherein a loop is a sample of a performance that has been edited to repeat seamlessly without clicks or artifacts
• CPC Class Codes: G10H 7/008 Means for controlling the transition from one tone waveform to another
• CPC Class Codes: G10H 7/02 in which amplitudes at successive sample points of a tone waveform are stored in one or more memories

Abstract

For at least one music piece, a storage section stores tone data of each of a plurality of fragments segmented from the music piece and stores a first descriptor indicative of a musical character of each of the fragments in association with the fragment. Descriptor generation section receives input data based on operation by a user and generates a second descriptor, indicative of a musical character, on the basis of the received input data. Determination section determines similarity between the second descriptor and the first descriptor of each of the fragments. Selection section selects the tone data of at least one fragment on the basis of a result of the similarity determination by the determination section. On the basis of the tone data of the selected at least one fragment, a data generation section generates tone data to be outputted.

Claims

1. A tone processing apparatus comprising:

a storage section that, for at least one music piece, stores tone data of each of a plurality of fragments segmented from the music piece and stores a first descriptor indicative of a musical character of each of the fragments in association with the fragment;

a descriptor generation section that receives input data based on operation by a user and generates a second descriptor, indicative of a musical character, on the basis of the received input data;

a determination section that determines similarity between said second descriptor and said first descriptor of each of the fragments;

a selection section that selects the tone data of at least one of the fragments from the storage section on the basis of a result of similarity determination by said determination section; and

a data generation section that, on the basis of the tone data of the fragment selected by said selection section, generates tone data to be outputted.

2. The tone processing apparatus as claimed in claim 1 wherein said determination section calculates a similarity index value indicative of a degree of similarity, to said second descriptor, of said first descriptor of each of the fragments, and

said selection section selects, from said storage section, the tone data of at least one of the fragments on the basis of the similarity index value calculated by said determination section.

3. The tone processing apparatus as claimed in claim 1 wherein said descriptor generation section receives input data from a performance device that generates the input data in response to performance operation by the user.

4. The tone processing apparatus as claimed in claim 3 wherein said first descriptor includes a combination of information indicative of a pitch of a tone included in the fragment associated therewith and information indicative of a volume of the tone,

said input data includes operator data indicative of a performance operator member operated by the user on the performance device and intensity data indicative of intensity of operation, by the user, of the performance operator member, and

said descriptor generation section generates said second descriptor that includes a combination of information indicative of a pitch corresponding to the operator data and information indicative of a volume corresponding to the intensity data.

5. The tone processing apparatus as claimed in claim 3 wherein said first descriptor includes information indicative of a volume of a tone included in the fragment associated therewith,

said input data includes intensity data indicative of intensity of operation, by the user, of a performance operator member of the performance device, and

said descriptor generation section generates said second descriptor that includes information indicative of a volume corresponding to the intensity data.

6. The tone processing apparatus as claimed in claim 1 wherein said first descriptor includes information indicative of a spectral center of gravity of a chord included in the fragment associated therewith, and

said descriptor generation section determines a chord on the basis of the input data, determines a spectral center of gravity of the determined chord and generates said second descriptor including information indicative of the determined spectral center of gravity of the determined chord.

7. The tone processing apparatus as claimed in claim 3 wherein said first descriptor includes information indicative of a degree of variation of a tone within the fragment associated therewith,

said input data includes after-touch data indicative of a sustained operating state of a performance operator member of the performance device following operational triggering, by the user, of the performance operator member, and

said descriptor generation section generates said second descriptor that includes degree-of-variation information corresponding to the after-touch data.

8. The tone processing apparatus as claimed in claim 1 wherein said first descriptor includes information indicative of a tempo in the fragment associated therewith,

said input data includes beat point data indicative of a beat point synchronous with an input motion of the user, and

said descriptor generation section generates said second descriptor that includes information indicative of a tempo corresponding to the beat point indicated by the beat point data.

9. The tone processing apparatus as claimed in claim 1 wherein said input data includes beat point data indicative of a beat point synchronous with an input motion of the user, and

said data generation section includes a connecting section that time-serially arranges the tone data of each of the fragments, sequentially selected by said selection section, in such a manner that the tone data synchronizes with the beat point indicated by the beat point data.

10. The tone processing apparatus as claimed in claim 9 wherein said data generation section further includes a processing section that processes a respective time length of the tone data of each of the fragments, sequentially selected by said selection section, in such a manner that the tone data has a time length corresponding to a time interval between the beat points indicated by the beat point data.

11. The tone processing apparatus as claimed in claim 1 wherein said first descriptor and said second descriptor each include a character value of each of a plurality of types of musical character elements, and

which further comprises a setting section that sets weighting, as desired by the user, individually for each of the plurality of types of musical character elements, said determination section using a character value, weighted for each of the musical character elements, to determine similarity between said second descriptor and said first descriptor of each of the musical character elements.

12. The tone processing apparatus as claimed in claim 1 wherein said data generation section outputs, as the tone data to be outputted, the tone data of the at least one fragment selected by said selection section.

13. The tone processing apparatus as claimed in claim 1 wherein said data generation section generates the tone data to be outputted, by mixing the tone data of a plurality of fragments selected by said selection section.

14. The tone processing apparatus as claimed in claim 1 wherein said first descriptor includes information indicative of a degree of complexity of a tone color of a tone included in the fragment associated therewith, and

said descriptor generation section generates, on the basis of tone-generation instructing information included in the input data, said second descriptor that includes information indicative of a degree of complexity of a tone color.

15. The tone processing apparatus as claimed in claim 3 wherein said input data includes after-touch data indicative of a sustained operating state of a performance operator member of the performance device following operational triggering, by the user, of the performance operator, and

said data generation section generates the tone data to be outputted, by mixing a particular number of tone data, corresponding to a value of the after-touch data, of the tone data of the at least one fragment selected by said fragment selection section.

16. The tone processing apparatus as claimed in claim 1 wherein said first descriptor and said second descriptor each include a character value of each of a plurality of types of musical character elements, and

said determination section determines, on the basis of respective character values of a plurality of types of the musical character elements, similarity between said second descriptor and said first descriptor of each of the musical character elements.

17. The tone processing apparatus as claimed in claim 1 which comprises a plurality of processing channels each including said descriptor generation section, said determination section, said selection section and said data generation section, said processing channels corresponding to a plurality of ranges, and

wherein the input data generated in response to performance operation, by the user, in each of the ranges of the performance device is input to said descriptor generation section of the processing channel corresponding to the range.

18. The tone processing apparatus as claimed in claim 17 wherein, for a plurality of music pieces, said storage section has stored therein the tone data and the first descriptor of each of the fragments, and

the tone data and the first descriptor of each of the fragments for a same music piece are used in each different one of the processing channels.

19. The tone processing apparatus as claimed in claim 17 wherein, for a plurality of music pieces, said storage section has stored therein the tone data and the first descriptor of each of the fragments, and

the tone data and the first descriptor of each of the fragments for different music pieces are used in each different one of the processing channels.

20. A method for processing a tone by use of a storage section that, for at least one music piece, stores tone data of each of a plurality of fragments segmented from the music piece and stores a first descriptor indicative of a musical character of each of the fragments in association with the fragment, said method comprising:

a step of receiving input data based on operation by a user and generating a second descriptor, indicative of a musical character, on the basis of the received input data;

a determination step of determining similarity between said second descriptor and said first descriptor of each of the fragments;

a selection step of selecting the tone data of at least one of the fragments from the storage section on the basis of a result of similarity determination by said determination step; and

a step of, on the basis of the tone data of the at least one fragment, generating tone data to be outputted.

21. A computer-readable storage medium containing a program for causing a computer to perform a tone processing procedure by use of a storage section that, for at least one music piece, stores tone data of each of a plurality of fragments segmented from the music piece and stores a first descriptor indicative of a musical character of each of the fragments in association with the fragment, said tone processing procedure comprising:

a step of receiving input data based on operation by a user and generating a second descriptor, indicative of a musical character, on the basis of the received input data;

a determination step of determining similarity between said second descriptor and said first descriptor of each of the fragments;

a selection step of selecting the tone data of at least one of the fragments from the storage section on the basis of a result of similarity determination by said determination step; and

a step of, on the basis of the tone data of the at least one fragment, generating tone data to be outputted.