Apparatus and method for detecting performer's motion to interactively control performance of music or the like

• US 7,179,984 B2
• Filed: 11/08/2002
• Issued: 02/20/2007
• Est. Priority Date: 01/11/2000
• Status: Expired due to Fees

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Sato, Masaki, Usa, Satoshi, Nishitani, Yoshiki, Kobayashi, Eiko
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US10/291,134
• Publication Number:
  US 20030066413A1
• Time in Patent Office: 1,565 Days
• Field of Search: 84600-602, 84609-612, 846/15, 84626-634, 84649-652, 84662-668, 84723-725, 847/30, 84737-741
• US Class Current: 84/723
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/34 Angular speed
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/805 Optical or opto-electronic sensors
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/00 Measuring physiological parameters of the user
• CPC Class Codes: A63B 2230/065 within a certain range
• CPC Class Codes: A63B 2230/62 posture
• CPC Class Codes: A63B 69/0028 for running, jogging or speed-walking movable endless bands A63B22/02
• CPC Class Codes: A63B 71/0686 Timers, rhythm indicators or pacing apparatus using electric or electronic means
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2220/135 Musical aspects of games or videogames; Musical instrument-shaped game input interfaces game background music G10H2210/026; musical game scoring or performance evaluation G10H2210/091
• CPC Class Codes: G10H 2220/206 Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
• CPC Class Codes: G10H 2220/371 Vital parameter control, i.e. musical instrument control based on body signals, e.g. brainwaves, pulsation, temperature, perspiration; biometric information signals from body positions or movements G10H2220/321
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2240/211 Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound beam G10H2220/405

Abstract

Performance interface system includes a motion detector provided for movement with a performer, and a control system for receiving detection data transmitted from the motion detector and controlling a performance of a tone in response to the received detection data. State of a performer'"'"'s motion is detected via a sensor of the motion detector, and detection data representative of the detected motion state is transmitted to the control system. The control system receives the detection data from the motion detector, analyzes the performer'"'"'s motion on the basis of the detection data, and then controls a tone performance in accordance with the analyzed data. With this arrangement, the performer can readily take part in the tone performance in the control system. For example, as the performer moves his or her hand, leg or trunk while listening to a manual or automatic performance of a music piece being carried out by a performance apparatus of the control system, the motion detector detects the performer'"'"'s motion and transmits corresponding detection data to the control system, which in turn variably controls a predetermined one of tonal factors in the music piece performance. This arrangement can readily provide interactive performance control and thereby allows an inexperienced or unskilled performer to take part in a performance with enjoyment.

Claims

1. A motion detector for movement with a performer comprising:

a sensor for detecting a plurality of states of a motion of the performer; and

a transmitter coupled with said sensor and for transmitting, to a performance control system, a signal including identification data for identifying said sensor, instruction data for designating a music piece performance control mode of the performance control system and detection data representing each of said plurality of states detected via said sensor, whereby said performance control system executes a music piece performance based on performance data in the music piece performance control mode designated, by the instruction data, from among a plurality of music piece performance control modes,

wherein said instruction data is preset in said motion detector and a setting of the instruction data is changeable by the performer.

2. A motion detector as claimed in claim 1 wherein said sensor detects acceleration of the motion in directions of two axes as said plurality of states.

3. A motion detector as claimed in claim 1 wherein said sensor detects acceleration of the motion in directions of three axes as said plurality of states.

4. A motion detector as claimed in claim 1 wherein said motion detector is held by a hand of the performer.

5. A motion detector as claimed in claim 1 wherein said motion detector is attached to a body of the performer.

6. A motion detector as claimed in claim 1 which further comprises a receiver for receiving guide data for providing a guide or assistance as to a motion to be made by the performer.

8. A motion detector as claimed in claim 1 wherein said performer is an animal.

9. A motion detector as claimed in claim 1 wherein said performer is a stand-alone intelligent robot.

10. A motion detector as claimed in claim 1 which further comprises a light-emitting device subjected to light emission control in accordance with said plurality of states detected via said sensor.

11. A motion detector as claimed in claim 1, wherein said performance control system includes at least an information reception/tone controller and a tone reproduction section.

12. A motion detector as claimed in claim 1, wherein the music piece performance control mode of said performance control system is either a group mode in which performance control is performed via said performance control system on the basis of an average value of detection data transmitted from a plurality of motion sensors, or an individual mode in which performance control is performed via said performance control system for each of the motion sensor on the basis of respective detection data transmitted from the plurality of motion sensors.

13. A motion detector as claimed in claim 1, wherein the music piece performance control mode of said performance control system is either a whole leading mode in which performance parameters are set for all performance tracks of performance data for use in a music piece performance to be executed via said performance control system, or a partial leading mode in which performance parameters are set for one or more, but not all, of performance tracks of performance data for use in a music piece performance to be executed via said performance control system.

7. A motion detector as claimed as claimed 1 wherein said performer is a human being.

14. A method for transmitting detection data corresponding to a motion of a performer, said method comprising the steps of:

detecting a plurality of states of a motion of the performer by use of a sensor that is included in a motion detector provided for movement with the performer; and

transmitting, to a performance control system, a signal including identification data for identifying said sensor, instruction data for designating a music piece performance control mode of the performance control system and detection data representing each of said plurality of states of a motion detected via said step of detecting, whereby said performance control system executes a music piece performance based on performance data in the music piece performance control mode designated, by the instruction data, from among a plurality of music piece performance control modes,

wherein said instruction data is preset in said motion detector and a setting of the instruction data is changeable by the performer.

15. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for transmitting detection data corresponding to a motion of a performer, said method comprising the steps of:

detecting a plurality of states of a motion of the performer by use of a sensor that is included in a motion detector provided for movement with the performer; and

transmitting, to a performance control system, a signal including identification data for identifying said sensor, instruction data for designating a music piece performance control mode of the performance control system and detection data representing each of said plurality of states of a motion detected via said step of detecting, whereby said performance control system executes a music piece performance based on performance data in the music piece performance control mode designated, by the instruction data, from among a plurality of music,

wherein said instruction data is preset in said motion detector and a setting of the instruction data is changeable by the performer.