Audio signal generating apparatus, audio signal generating system, audio system, audio signal generating method, program, and storage medium

• US 7,161,079 B2
• Filed: 05/09/2002
• Issued: 01/09/2007
• Est. Priority Date: 05/11/2001
• Status: Expired due to Fees

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Usa, Satoshi, Miki, Akira, Nishitani, Yoshiki, Kobayashi, Eiko
• Primary Examiner(s): Donovan; Lincoln
• Assistant Examiner(s): Warren; David S.
• Application Number:
  US10/143,086
• Publication Number:
  US 20020166439A1
• Time in Patent Office: 1,706 Days
• Field of Search: 84600-609, 846/12, 846/36, 846/15, 846/52, 846/53, 846/68
• US Class Current: 84/612
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/0083 using wireless transmission, e.g. radio, light, infrared
• CPC Class Codes: G10H 2210/295 Spatial effects, musical uses of multiple audio channels, e.g. stereo Helmholtz resonance effects G10H2210/275; reverberation or echo G10H2210/281
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/321 Garment sensors, i.e. musical control means with trigger surfaces or joint angle sensors, worn as a garment by the player, e.g. bracelet, intelligent clothing vital parameter sensing G10H2220/371; wearable interfaces in general G06F3/00
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression
• CPC Class Codes: G10H 2240/066 MPEG audio-visual compression file formats, e.g. MPEG-4 for coding of audio-visual objects MP3 G10H2240/061
• CPC Class Codes: G10H 2250/575 Adaptive MDCT-based compression, e.g. using a hybrid subband-MDCT, as in ATRAC non adaptive MDCT G10H2250/225

Abstract

An audio signal generating apparatus is provided which makes it possible to supply a new music entertainment that enables users to actively participate in performance of musical compositions based on audio data that is coded in a predetermined format from audio signals, and a program for implementing the method, and a storage medium storing the program. Motion information corresponding to a motion of a user is acquired. An audio signal is acquired from audio data coded from the audio signal according to the predetermined format, and processing is performed on the acquired audio signal according to acquired motion information.

Claims

1. An audio signal generating apparatus comprising:

a motion information acquiring device that acquires motion information corresponding to a motion of a user;

a storage device that stores audio data coded from an audio signal comprising a musical composition according to a predetermined format and tempo marks corresponding to the tempo of the musical composition at regular time intervals in a period of time in which the audio data are to be reproduced;

a reading-out device that reads out the audio data and tempo marks from said storage device at a predetermined readout speed;

an audio signal acquiring device that acquires waveform data corresponding to the audio signal from the audio data read out from said storage device by said reading-out device; and

a signal processing device that performs processing on the waveform data acquired by said audio signal acquiring device based on the tempo marks read out from said storage device by said reading-out device, and the motion information acquired by said motion information acquiring device.

2. An audio signal generating apparatus according to claim 1, further comprising a recording device that records the waveform data having been processed by said signal processing device according to the motion information.

3. An audio signal generating apparatus according to claim 1, wherein said motion information acquiring device receives motion information transmitted from at least one operating terminal capable of being carried by an operator, said operating terminal generating the motion information corresponding to a motion of the operator carrying the operating terminal, and said signal processing device performs processing on the waveform data acquired by said audio signal acquiring device according to the motion information received by said motion information acquiring device.

4. An audio signal generating apparatus according to claim 1, wherein said signal processing device performs processing for controlling at least one selected from the group consisting of tempo, volume, timing, tone color, and effect on the waveform data acquired by said audio signal acquiring device according to the motion information.

5. An audio signal generating apparatus according to claim 1, wherein said signal processing device performs time-base compression and expansion of the waveform data acquired by said audio signal acquiring device so as to convert the audio signal into an audio signal with a tempo corresponding to the motion information.

6. An audio signal generating apparatus according to claim 1, wherein said signal processing device performs tone image localization of the waveform data acquired by said audio signal acquiring device.

7. An audio signal generating apparatus according to claim 1, wherein said signal processing device carries out amplitude adjustment of the waveform data acquired by said audio signal acquiring device in every predetermined frequency band.

8. An audio signal generating apparatus according to claim 1, further comprising a determination device that determines an offset amount from an original tempo of the waveform data acquired by said audio signal acquiring device according to the motion information, and wherein said signal processing device changes the original tempo of the acquired audio signal by the determined offset amount.

9. An audio signal generating apparatus according to claim 1, wherein said motion information acquiring device comprises a plurality of motion information acquiring devices, and said signal processing device performs processing for controlling different objects according to the motion information acquired by respective ones of said motion information acquiring devices, on the waveform data acquired by said audio signal acquiring device.

15. An audio signal generating apparatus according to claim 9, further comprising a tone generator separating device that separates the waveform data acquired by said audio signal acquiring device into waveform data components of plural tone generator parts, wherein said signal processing device performs processing for controlling different objects according to the motion information acquired by respective ones of said motion information acquiring devices, on respective ones of the waveform data components separated by said tone generator separating device.

10. An audio signal generating system comprising:

at least one operating terminal capable of being carried by an operator, said operating terminal generating motion information corresponding to a motion of the operator carrying said operating terminal and transmitting the generated motion information; and

an audio signal generating device that generates an audio signal comprising a musical composition from audio data coded from the audio signal according to a predetermined format; and

wherein said audio signal generating device comprises a receiving device that receives the motion information transmitted from said operating terminal, a storage device that stores the audio data and tempo marks corresponding to the tempo of the musical composition at regular time intervals in a period of time in which the audio data are to be reproduced, a reading-out device that reads out the audio data and tempo marks from said storage device at a predetermined readout speed, an audio signal acquiring device that acquires waveform data corresponding to the audio signal from the audio data read out from said storage device by said reading-out device, and a signal processing device that performs processing on the waveform data acquired by said audio signal acquiring device based on the tempo marks read out from said storage device by said reading-out device, and the motion information received by said receiving device.

11. An audio system comprising:

at least one operating terminal capable of being carried by an operator, said operating terminal generating motion information corresponding to a motion of the operator carrying said operating terminal and transmitting the generated motion information;

a receiving device that receives the motion information transmitted from said operating terminal;

a storage device that stores audio data coded from an audio signal comprising a musical composition according to a predetermined format and tempo marks corresponding to the tempo of the musical composition at regular time intervals in a period of time in which the audio data are to be reproduced;

a reading-out device that reads out the audio data and tempo marks from said storage device at a predetermined readout speed;

a reproducing device that reproduces waveform data corresponding to the audio signal from the audio data read out from said storage device by said reading-out device;

a musical contents acquiring device that acquires first musical contents information including at least one of a pitch sequence and beats constituting the musical composition in the waveform data being reproduced by said reproducing device;

a musical contents information producing device that produces second musical contents information including at least one of pitch information and beat information based on the tempo marks read out from said storage device by said reading-out device, and the motion information received by said receiving device when the waveform data is being reproduced by said reproducing device; and

a determination device that compares the first musical contents information and the second musical contents information and outputs results of the comparison.

12. An audio signal generating method comprising the steps of:

acquiring motion information corresponding to a motion of a user;

storing to a storage device, audio data coded from an audio signal comprising a musical composition according to a predetermined format and tempo marks corresponding to the tempo of the musical composition at regular time intervals in a period of time in which the audio data are to be reproduced;

reading out the audio data and tempo marks from said storage device at a predetermined readout speed;

acquiring waveform data corresponding to the audio signal from the audio data read out from said storage device; and

performing processing on the acquired waveform data based on the tempo marks read out from said storage device, and the acquired motion information.

13. A program embodied on a computer-readable medium that causes a computer to execute an audio signal generating method comprising the steps of:

acquiring motion information corresponding to a motion of a user;

storing to a storage device, audio data coded from an audio signal comprising a musical composition according to a predetermined format and tempo marks corresponding to the tempo of the musical composition at regular time intervals in a period of time in which the audio data are to be reproduced;

reading out the audio data and tempo marks from said storage device at a predetermined readout speed;

acquiring waveform data corresponding to the audio signal from the audio data read out from said storage device; and

performing processing on the acquired waveform data based on the tempo marks read out from said storage device, and the acquired motion information.

14. A machine readable storage medium containing a group of instructions for causing a machine to execute an audio signal generating method comprising the steps of:

acquiring motion information corresponding to a motion of a user;

storing to a storage device, audio data coded from an audio signal comprising a musical composition according to a predetermined format and tempo marks corresponding to the tempo of the musical composition at regular time intervals in a period of time in which the audio data are to be reproduced;

reading out the audio data and tempo marks from said storage device at a predetermined readout speed;

acquiring waveform data corresponding to the audio signal from the audio data read out from said storage device; and

performing processing on the acquired waveform data signal based on the tempo marks read out from said storage device, and the acquired motion information.