Apparatus and Method for Detecting Performer's Motion to Interactively Control Performance of Music or the Like

• US 20100263518A1
• Filed: 05/14/2010
• Published: 10/21/2010
• Est. Priority Date: 01/11/2000
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Sato, Masaki, NISHITANI, Yoshiki, USA, Satoshi, Kobayashi, Eiko
• Granted Patent: US 8,106,283 B2
• Time in Patent Office: Days
• US Class Current: 84/612
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/34 Angular speed
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/805 Optical or opto-electronic sensors
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/00 Measuring physiological parameters of the user
• CPC Class Codes: A63B 2230/065 within a certain range
• CPC Class Codes: A63B 2230/62 posture
• CPC Class Codes: A63B 69/0028 for running, jogging or speed-walking movable endless bands A63B22/02
• CPC Class Codes: A63B 71/0686 Timers, rhythm indicators or pacing apparatus using electric or electronic means
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2220/135 Musical aspects of games or videogames; Musical instrument-shaped game input interfaces game background music G10H2210/026; musical game scoring or performance evaluation G10H2210/091
• CPC Class Codes: G10H 2220/206 Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
• CPC Class Codes: G10H 2220/371 Vital parameter control, i.e. musical instrument control based on body signals, e.g. brainwaves, pulsation, temperature, perspiration; biometric information signals from body positions or movements G10H2220/321
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2240/211 Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound beam G10H2220/405

Abstract

Performance interface system includes a motion detector provided for movement with a performer, and a control system for receiving detection data transmitted from the motion detector and controlling a performance of a tone in response to the received detection data. State of a performer'"'"'s motion is detected via a sensor of the motion detector, and detection data representative of the detected motion state is transmitted to the control system. The control system receives the detection data from the motion detector, analyzes the performer'"'"'s motion on the basis of the detection data, and then controls a tone performance in accordance with the analyzed data. With this arrangement, the performer can readily take part in the tone performance in the control system. For example, as the performer moves his or her hand, leg or trunk while listening to a manual or automatic performance of a music piece being carried out by a performance apparatus of the control system, the motion detector detects the performer'"'"'s motion and transmits corresponding detection data to the control system, which in turn variably controls a predetermined one of tonal factors in the music piece performance. This arrangement can readily provide interactive performance control and thereby allows an inexperienced or unskilled performer to take part in a performance with enjoyment.

Claims

1. A control apparatus for controlling readout of time-serial data, said control apparatus comprising:

a storage device adapted to store therein time-serial data of a plurality of data groups;

a data supplier adapted to supply tempo control data for each of the data groups; and

a readout controller coupled with said storage device and said data supplier and adapted to read out the time-serial data of the plurality of data groups from said storage device at a predetermined readout tempo, said readout controller being adapted to control the readout tempo for each of the data groups in accordance with the tempo control data supplied by said data supplier for the data group.

2. A control apparatus as claimed in claim 1 wherein the tempo control data for each of the data groups is stored in said storage device along with the time-serial data for the data group, and wherein said data supplier reads out, from said storage device, the tempo control data for each of the data groups and thereby supplies the tempo control data to said readout controller.

3. A control apparatus as claimed in claim 1 wherein said data supplier generates the tempo control data for each of the data groups on the basis of control data transmitted from a plurality of controllers.

4. A control apparatus as claimed in claim 3 wherein each of said control data represents a state of a motion made by a performer operating a corresponding one of said controllers.

5. A control apparatus as claimed in claim 3 wherein each of said control data represents a body state of a performer operating a corresponding one of said controllers.

6. A control apparatus as claimed in claim 1 wherein the tempo control data for each of the data groups, supplied to said readout controller by said data supplier, is further adapted to be written into said storage device.

7. A control apparatus as claimed in claim 1 wherein said data supplier generates first tempo control data on the basis of control data transmitted from one or more controllers and generates second tempo control data by reading out tempo control data stored in said storage device, and

wherein said readout controller controls the readout tempo of one or some of the time-serial data of the plurality of data groups on the basis of said first tempo control data and controls the readout tempo of other one or some of the time-serial data of the plurality of data groups on the basis of said second tempo control data.

8. A control apparatus as claimed in claim 1 wherein said data supplier is further adapted to generate modification data on the basis of control data transmitted from a controller and modify the tempo control data for each of the data groups on the basis of the modification data, and

wherein said readout controller controls the readout tempo for each of the data groups on the basis of the tempo control data for each of the data groups modified on the basis of the modification data.

9. A control apparatus as claimed in claim 1 wherein said storage device is further adapted to store therein display data corresponding to the plurality of data groups, and

wherein said readout controller is further adapted to read out the display data from said storage device on the basis of the tempo control data for each of the data groups supplied by said data supplier and cause a display device to display a visual image based on the display data read out from said storage device.

10. A control apparatus as claimed in claim 1 wherein said time-serial data are performance data.

11. A control apparatus as claimed in claim 1 wherein said time-serial data are image data.

12. A method for controlling readout of time-serial data of a plurality of data groups stored in a storage device, said method comprising the steps of:

supplying tempo control data for each of the data groups; and

reading out the time-serial data of the plurality of data groups from said storage device at a predetermined readout tempo, said step of reading out controlling the readout tempo for each of the data groups in accordance with the tempo control data supplied via said step of supplying for the data group.

13. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for controlling readout of time-serial data of a plurality of data groups stored in a storage device, said method comprising the steps of:

supplying tempo control data for each of the data groups; and

reading out the time-serial data of the plurality of data groups from said storage device at a predetermined readout tempo, said step of reading out controlling the readout tempo for each of the data groups in accordance with the tempo control data supplied via said step of supplying for the data group.

14. A signal to be transmitted comprising:

time-serial data of a plurality of data groups; and

tempo control data for controlling a reproduction tempo of the time-serial data for each of the data groups.

15. A signal to be transmitted as claimed in claim 14 wherein the time-serial data are performance data.

16. A signal to be transmitted as claimed in claim 14 wherein the time-serial data are image data.