MUSICAL PERFORMANCE-RELATED INFORMATION OUTPUT DEVICE, SYSTEM INCLUDING MUSICAL PERFORMANCE-RELATED INFORMATION OUTPUT DEVICE, AND ELECTRONIC MUSICAL INSTRUMENT

• US 20110023691A1
• Filed: 07/29/2009
• Published: 02/03/2011
• Est. Priority Date: 07/29/2008
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Iwase, Hiroyuki, Fukui, Mitsuru, Sone, Takuro
• Granted Patent: US 8,697,975 B2
• Time in Patent Office: Days
• US Class Current: 84/612
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 1/06 Circuits for establishing the harmonic content of tones , or other arrangements for changing the tone colour
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2220/301 Fret-like switch array arrangements for guitar necks
• CPC Class Codes: G10H 2220/391 Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device angles measured by an accelerometer or gravimeter G10H2220/395; angles calculated from 3D position sensing G10H2220/401; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2240/031 File merging MIDI, i.e. merging or mixing a MIDI-like file or stream with a non-MIDI file or stream, e.g. audio or video
• CPC Class Codes: G10H 2240/205 Synchronous transmission of an analog or digital signal, e.g. according to a specific intrinsic timing, or according to a separate clock
• CPC Class Codes: G10H 2240/215 Spread spectrum, i.e. transmission on a bandwidth considerably larger than the frequency content of the original information
• CPC Class Codes: G10H 2240/225 Frequency division multiplexing
• CPC Class Codes: G10H 3/188 for converting the signal to digital format transmission using a MIDI interface G10H1/0066

Abstract

Provided are a musical performance-related information output device and a musical performance system capable of superimposing musical performance-related information on an audio signal without damaging the general versatility of the audio signal. The musical performance-related information output device includes a musical performance-related information acquiring section that is adapted to acquire musical performance-related information related to a musical performance of a performer, a superimposing section that is adapted to superimpose the musical performance-related information on an analog audio signal such that a modulated component of the musical performance-related information is included in a band higher than the frequency component of the analog audio signal generated in accordance with the musical performance manipulation of the performer, and an output section that outputs the analog audio signal on which the superimposing section superimposes the musical performance-related information.

Claims

1. :

A musical performance-related information output device comprising;

a musical performance-related information acquiring section that is configured to acquire musical performance-related information related to a musical performance of a performer;

a superimposing section that is configured to superimpose the musical performance-related information on an analog audio signal such that a modulated component of the musical performance-related information is included in a band higher than a frequency component of the analog audio signal generated in accordance with a musical performance manipulation of the performer; and

an output section that outputs the analog audio signal on which the superimposing section superimposes the musical performance-related information.

2. :

The musical performance-related information output device according to claim 1, wherein

the musical performance-related information acquiring section acquires musical performance information indicating the musical performance manipulation of the performer as the musical performance-related information.

3. :

The musical performance-related information output device according to claim 2, wherein the superimposing section includes;

a spread code generating section which generates a spread code having a predetermined cycle;

a modulating section which phase-modulates the spread code in each cycle on the basis of the musical performance information; and

a synthesizing section which synthesizes a modulated signal generated on the basis of the phase-modulated spread code and the analog audio signal in the frequency band higher than the frequency component of the analog audio signal, and outputs the resultant signal as a synthesized signal.

4. :

The musical performance-related information output device according to claim 2, further comprising generating section that is adapted to detect vibration generated in accordance with the musical performance manipulation and generating an analog audio signal, wherein

the superimposing section superimposes the musical performance information on the analog audio signal generated by the generating section.

5. :

A musical performance system comprising;

the musical performance-related information output device according to claim 2; and

a reproducing device, wherein

the reproducing device includes;

an input section for inputting the analog audio signal output from the output section of the musical performance-related information output device;

a decoding section that is adapted to extract the musical performance-related information from the analog audio signal input to the input section and decode the musical performance-related information; and

a synchronous output section that synchronously outputs the analog audio signal and the musical performance information on the basis of the time required for superimposition and decoding of the musical performance information.

6. :

The musical performance-related information output device according to claim 1, wherein

the musical performance-related information acquiring section acquires tempo information indicating a musical performance tempo as the musical performance-related information.

7. :

The musical performance-related information output device according to claim 6, wherein

the musical performance-related information acquiring section receives a reference tempo signal, which is the reference of the musical performance tempo, from the outside, and extracts the tempo information on the basis of the reference tempo signal.

8. :

A sound processing system comprising;

the musical performance-related information output device according to claim 6; and

a decoding device that is adapted to decode the tempo information, wherein

the superimposing section of the musical performance-related information output device superimposes pseudo noise on the analog audio signal with a timing based on the musical performance tempo so as to superimpose the tempo information, and

the decoding device includes;

an input section for inputting the analog audio signal; and

a decoding section that is adapted to calculate a correlation between the analog audio signal input to the input section and the pseudo noise, and to decode the tempo information on the basis of a peak-generated timing of the correlation.

9. :

The sound processing system according to claim 8, wherein

the musical performance-related information acquiring section of the musical performance-related information output device extracts multiple kinds of tempo information in accordance with the respective timings of the musical performance tempo,

the superimposing section superimposes multiple kinds of pseudo noise to superimpose the multiple kinds of tempo information, and

the decoding section of the decoding device calculates correlations between the analog audio signal input to the input section and the respective multiple kinds of pseudo noise, and decodes the multiple kinds of tempo information on the basis of the peak-generated timings of the respective correlations.

10. :

The sound processing system according to claim 8, wherein

the superimposing section of the musical performance-related information output device includes;

a spread code generating section which generates the pseudo noise as a spread code having a predetermined cycle;

a modulating section which phase-modulates the spread code in each cycle on the basis of the tempo information; and

a synthesizing section which synthesizes a modulated signal generated on the basis of the phase-modulated spread code and the analog audio signal in the frequency band higher than the frequency component of the analog audio signal, and outputs the resultant signal as a synthesized signal.

11. :

An electronic musical instrument comprising the musical performance-related information output device according to claim 6.

12. :

The musical performance-related information output device according to claim 1, further comprising;

an input section for receiving an input of a manipulation for controlling an external apparatus; and

a control signal generating section that is adapted to generate a control signal for controlling the external apparatus in accordance with the manipulation received by the input section, wherein

the musical performance-related information acquiring section acquires the control signal as the musical performance-related information.

13. :

The musical performance-related information output device according to claim 12, wherein

the superimposing section includes;

a spread code generating section which generates a spread code having a predetermined cycle;

a modulating section which phase-modulates the spread code in each cycle on the basis of the control signal; and

a synthesizing section which synthesizes a modulated signal generated on the basis of the phase-modulated spread code and the analog audio signal in the frequency band higher than the frequency component of the analog audio signal, and outputs the resultant signal as a synthesized signal.

14. :

The musical performance-related information output device according to claim 12, further comprising;

a musical performance information acquiring section that is adapted to acquire musical performance information indicating content of the musical performance manipulation; and

a storage section for storing the musical performance information and the control signal in association with each other, wherein

the input section acquires the musical performance information as the input of the manipulation, and

the control signal generating section generates the control signal with reference to the storage section by the musical performance information acquired by the input section.

15. :

The musical performance-related information output device according to claim 14, further comprising

a pose sensor which detects the pose of the device to generate pose information, wherein

the storage section stores the pose information and the control signal in association with each other,

the input section acquires the pose information as the input of the manipulation, and

the control signal generating section generates the control signal with reference to the storage section by the pose information acquired by the input section.

16. :

The musical performance-related information output device according to claim 14, further comprising

a measuring section that is adapted to measure an elapsed time after the musical performance manipulation starts, wherein

the storage section further stores a reception period, for which the input of the manipulation is received, in association with the control signal, and

the control signal generating section generates the control signal when the elapsed time measured by the measuring section is within the reception period.

17. :

The musical performance-related information output device according to claim 14, further comprising;

a control signal input section for inputting the control signal; and

a registering section that is adapted to register the control signal input from the control signal input section and the manipulation input from the input section in the storage section in association with each other.

18. :

The musical performance-related information output device according to claim 12, comprising;

an audio signal generating section that is adapted to generate an audio signal based on vibration generated in accordance with the musical performance manipulation, wherein

the superimposing section superimposes the control signal on the audio signal generated by the audio signal generating section.

19. :

The musical performance-related information output device according to claim 1, further comprising;

a reference clock generating section that is adapted to generate a reference clock at predetermined intervals;

a time difference detecting section that is adapted to detect the time difference between a timing of superimposing sequence data and the reference clock, wherein

the musical performance-related information acquiring section acquires information regarding the reference clock, the sequence data, the timing of superimposing the sequence data, and the time difference, as the musical performance-related information.

20. :

The musical performance-related information output device according to claim 19, comprising;

a manipulation input section for inputting a manipulation of the performer; and

a data generating section that is adapted to generate the sequence data in accordance with a manipulation input of the manipulation input section, wherein

the time difference detecting section detects the time difference between the timing of the manipulation input and the timing of superimposing the sequence data by a difference from the reference clock, and information regarding the time difference is represented by the difference.

21. :

The musical performance-related information output device according to claim 19, wherein

the superimposing section includes;

a spread code generating section which generates a spread code having a predetermined cycle,

a modulating section which phase-modulates the spread code in each cycle on the basis of superimposing information, and

a synthesizing section which synthesizes a modulated signal generated on the basis of the phase-modulated spread code and the analog audio signal in the frequency band higher than the frequency of the analog audio signal, and outputs the resultant signal as a synthesized signal.

22. :

A sound processing system comprising;

the musical performance-related information output device according to claim 19; and

a decoding device which is adapted to decode information superimposed on the analog audio signal,

wherein the decoding device includes a synchronizing section that is adapted to receive the analog audio signal in advance, and to synchronize the analog audio signal and the sequence data on the basis of the reference clock decoded from the analog audio signal and information regarding the time difference.

23. :

The sound processing system according to claim 22, wherein

the superimposing section of the musical performance-related information output device superimposes pseudo noise on the audio signal with a timing based on the reference clock to superimpose the reference clock, and

the decoding device includes a decoding section that is adapted to calculate a correlation between the audio signal and the pseudo noise, and decode the reference clock on the basis of a peak-generated timing of the correlation.

24. :

The musical performance-related information output device according to claim 19, wherein

tempo information in which a musical performance tempo of the performer is reflected is used as the reference clock.

25. :

An electronic musical instrument comprising the musical performance-related information output device according to claim 19.