Apparatus and method for detecting performer's motion to interactively control performance of music or the like

• US 7,135,637 B2
• Filed: 03/13/2003
• Issued: 11/14/2006
• Est. Priority Date: 01/11/2000
• Status: Expired due to Fees

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Kobayashi, Eiko, Nishitani, Yoshiki
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US10/387,811
• Publication Number:
  US 20030167908A1
• Time in Patent Office: 1,342 Days
• Field of Search: 84600-602, 84609-612, 84626-634, 84649-652, 84662-668, 84723-725, 847/30, 84737-741
• US Class Current: 84/723
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/34 Angular speed
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/805 Optical or opto-electronic sensors
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/00 Measuring physiological parameters of the user
• CPC Class Codes: A63B 2230/065 within a certain range
• CPC Class Codes: A63B 2230/62 posture
• CPC Class Codes: A63B 69/0028 for running, jogging or speed-walking movable endless bands A63B22/02
• CPC Class Codes: A63B 71/0686 Timers, rhythm indicators or pacing apparatus using electric or electronic means
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2220/135 Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
• CPC Class Codes: G10H 2220/206 Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
• CPC Class Codes: G10H 2220/371 Vital parameter control, i.e. musical instrument control based on body signals, e.g. brainwaves, pulsation, temperature or perspiration; Biometric information
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing
• CPC Class Codes: G10H 2240/211 Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound

Abstract

Performance interface system includes a motion detector provided for movement with a performer, and a control system for receiving detection data transmitted from the motion detector and controlling a performance of a tone in response to the received detection data. State of a performer'"'"'s motion is detected via a sensor of the motion detector, and detection data representative of the detected motion state is transmitted to the control system. The control system receives the detection data from the motion detector, analyzes the performer'"'"'s motion on the basis of the detection data, and then controls a tone performance in accordance with the analyzed data. With this arrangement, the performer can readily take part in the tone performance in the control system. For example, as the performer moves his or her hand, leg or trunk while listening to a manual or automatic performance of a music piece being carried out by a performance apparatus of the control system, the motion detector detects the performer'"'"'s motion and transmits corresponding detection data to the control system, which in turn variably controls a predetermined one of tonal factors in the music piece performance. This arrangement can readily provide interactive performance control and thereby allows an inexperienced or unskilled performer to take part in a performance with enjoyment.

Claims

1. A motion detector for movement with a performer comprising:

a sensor adapted to detect a state of a motion of the performer;

a receiver adapted to receive, from a source external to the motion detector, guide data for providing a guide or assistance as to a motion to be made by the performer, the guide data being data generated by the external source in accordance with a progression of a music performance, said music performance executed by the external source using a series of data indicative of the state of a motion detected via said sensor and automatic performance data; and

a guide device coupled with said receiver for illuminating a light emitting member provided on said motion detector or vibrating said motion detector on the basis of the guide data received via said receiver to instruct the performer on timing for moving said motion detector.

2. A motion detector as claimed in claim 1 which further comprises a transmitter adapted to transmit said state of a motion detected via said sensor as detection data to be used for controlling a tone performance.

3. A motion detector as claimed in claim 2 further comprising a display device that displays a tone volume value.

4. A motion detector as claimed in claim 1 wherein said motion detector is held by a hand of the performer.

5. A motion detector as claimed in claim 1 wherein said motion detector is attached to a body of the performer.

6. A motion detector as claimed as claimed 1 wherein said performer is a human being.

7. A motion detector as claimed in claim 1 wherein said performer is an animal.

8. A motion detector as claimed in claim 1 wherein said performer is a stand-alone intelligent robot.

9. A motion detector as claimed in claim 1 wherein said light emitting member is also illuminated in accordance with said state of a motion detected via said sensor.

10. A motion detector as claimed in claim 1 which further comprises a tone generator for generating a tone on the basis of said state of a motion detected via said sensor.

11. A control system comprising:

a data generator adapted to generate guide data for illuminating a light emitting member provided on a motion detector or vibrating said motion detector to instruct a performer, having said motion detector, on timing for moving said motion detector;

a transmitter coupled with said data generator and adapted to transmit the guide data, generated by said data generator, to the motion detector; and

a performance control section that executes a music performance using automatic performance data and a series of data indicative of the state of a motion detected via said motion detector,

wherein said guide data is generated by said data generator in accordance with a progression of a music performance executed by said performance control section.

12. A control system as claimed in claim 11 which further comprises:

a receiver adapted to receive detection data transmitted from the motion detector provided for movement with a performer, the detection data representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer;

a performance apparatus adapted to carry out a performance of a tone on the basis of performance data; and

a controller coupled with said receiver and said performance apparatus and adapted to control said performance of a tone by said performance apparatus in accordance with the detection data received via said receiver.

13. A control system as claimed in claim 12 wherein control of the tone by said controller controls a tone volume of the tone to be performed by said performance apparatus.

14. A control system as claimed in claim 12 wherein control of the tone by said controller controls a tempo of the tone to be performed by said performance apparatus.

15. A control system as claimed in claim 12 wherein control of the tone by said controller controls performance timing of the tone to be performed by said performance apparatus.

16. A control system as claimed in claim 12 wherein control of the tone by said controller controls a tone color of the tone to be performed by said performance apparatus.

17. A control system as claimed in claim 12 wherein control of the tone by said controller controls an effect of the tone to be performed by said performance apparatus.

18. A control system as claimed in claim 12 wherein control of the tone by said controller controls a tone pitch of the tone to be performed by said performance apparatus.

19. A control system as claimed in claim 12 wherein the performance data is automatic performance data, and said performance apparatus performs a tone on the basis of the automatic performance data.

20. A control system as claimed in claim 11 wherein said motion detector is held by a hand of the performer.

21. A control system as claimed in claim 11 wherein said motion detector is attached to a body of the performer.

22. A control system as claimed as claimed 11 wherein said performer is a human being.

23. A control system as claimed in claim 11 wherein said performer is an animal.

24. A control system as claimed in claim 11 wherein said performer is a stand-alone intelligent robot.

25. A method for providing guide data for a performer operating a motion detector, said method comprising the steps of:

detecting a state of a motion of the performer by use of said motion detector moving with the performer;

receiving, from a source external to said motion detector, guide data for providing a guide or assistance as to a motion to be made by the performer, the guide data being data generated by the external source in accordance with a progression of a music performance, said music performance executed by the external source using a series of data indicative of the state of a motion detected via said sensor and automatic performance data; and

illuminating a light emitting member provided on said motion detector or vibrating said motion detector on the basis of the guide data received via said step of receiving to instruct the performer on timing for moving said motion detector.

26. A method for providing guide data for a performer operating a motion detector, said method comprising the steps of:

generating guide data for illuminating a light emitting member provided on said motion detector or vibrating said motion detector to instruct the performer on timing for moving said motion detector;

transmitting the guide data, generated by said step of generating, to said motion detector; and

executing a music performance using automatic performance data and a series of data indicative of the state of a motion detected via said motion detector, wherein said guide data is generated in accordance with a progression of the music performance.

27. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for providing guide data for a performer operating a motion detector, said method comprising the steps of:

detecting a state of a motion of the performer by use of said motion detector moving with the performer;

receiving, from a source external to said motion detector, guide data for providing a guide or assistance as to a motion to be made by the performer, the guide data being data generated by the external source in accordance with a progression of a music performance, said music performance executed by the external source using a series of data indicative of the state of a motion detected via said sensor and automatic performance data; and

illuminating a light emitting member provided on said motion detector or vibrating said motion detector on the basis of the guide data received via said step of receiving to instruct the performer on timing for moving said motion detector.

28. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for providing guide data for a performer operating a motion detector, said method comprising the steps of:

generating guide data for illuminating a light emitting member provided on said motion detector or vibrating said motion detector to instruct the performer on timing for moving said motion detector;

transmitting the guide data, generated by said step of generating, to said motion detector; and

executing a music performance using automatic performance data and a series of data indicative of the state of a motion detected via said motion detector, wherein said guide data is generated in accordance with a progression of the music performance.