Apparatus and method for detecting performer's motion to interactively control performance of music or the like
First Claim
1. A control system comprising:
- a receiver adapted to receive detection data transmitted from a motion detector provided for movement with a performer, the detection data being time-serial detection data time-serially representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer;
a performance apparatus adapted to carry out a performance of a tone on the basis of performance data;
an analyzer coupled with said receiver and adapted to analyze the motion of the performer on the basis of the detection data and thereby generate a plurality of analyzed data, wherein said analyzer analyzes a time-varying waveform corresponding to the time-serial detection data and generates a plurality of kinds of characteristic parameters pertaining to a shape of the time-varying waveform; and
a controller coupled with said performance apparatus and said analyzer and adapted to control the performance of a tone by said performance apparatus in accordance with said plurality of kinds of characteristic parameters.
1 Assignment
0 Petitions
Accused Products
Abstract
Performance interface system includes a motion detector provided for movement with a performer, and a control system for receiving detection data transmitted from the motion detector and controlling a performance of a tone in response to the received detection data. State of a performer'"'"'s motion is detected via a sensor of the motion detector, and detection data representative of the detected motion state is transmitted to the control system. The control system receives the detection data from the motion detector, analyzes the performer'"'"'s motion on the basis of the detection data, and then controls a tone performance in accordance with the analyzed data. With this arrangement, the performer can readily take part in the tone performance in the control system. For example, as the performer moves his or her hand, leg or trunk while listening to a manual or automatic performance of a music piece being carried out by a performance apparatus of the control system, the motion detector detects the performer'"'"'s motion and transmits corresponding detection data to the control system, which in turn variably controls a predetermined one of tonal factors in the music piece performance. This arrangement can readily provide interactive performance control and thereby allows an inexperienced or unskilled performer to take part in a performance with enjoyment.
223 Citations
69 Claims
-
1. A control system comprising:
-
a receiver adapted to receive detection data transmitted from a motion detector provided for movement with a performer, the detection data being time-serial detection data time-serially representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer; a performance apparatus adapted to carry out a performance of a tone on the basis of performance data; an analyzer coupled with said receiver and adapted to analyze the motion of the performer on the basis of the detection data and thereby generate a plurality of analyzed data, wherein said analyzer analyzes a time-varying waveform corresponding to the time-serial detection data and generates a plurality of kinds of characteristic parameters pertaining to a shape of the time-varying waveform; and a controller coupled with said performance apparatus and said analyzer and adapted to control the performance of a tone by said performance apparatus in accordance with said plurality of kinds of characteristic parameters. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A control system comprising:
-
a receiver adapted to receive a plurality of detection data transmitted from a single motion detector provided for movement with a performer, said plurality of detection data being detection data of a plurality of axial components, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer; a performance apparatus adapted to carry out a performance of a tone on the basis of performance data; and a controller coupled with said receiver and said performance apparatus and adapted to control said performance of a tone by said performance apparatus in accordance with each of the detection data received via said receiver, wherein said controller identifies a type of operation of said motion detector by comparing the detection data of the plurality of axial components and controls the performance on the basis of the identified type of operation. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 49, 50)
-
-
40. A control system comprising:
-
a receiver adapted to receive detection data transmitted from a plurality of motion detectors provided for movement with a performer, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in a corresponding one of said motion detectors moving with the performer, said plurality of motion detectors comprising master and subordinate detectors; a performance apparatus adapted to carry out a performance of a tone on the basis of performance data; and a controller coupled with said receiver and said performance apparatus and adapted to control said performance of a tone by said performance apparatus in accordance with each of the detection data received from said motion detectors, wherein the form of control, by said controller, is determined in accordance with an operation mode that is designated on the basis of operation-type identifying data included in the detection data transmitted by the master detector. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48, 51, 52, 53, 55, 57, 58, 59, 60, 61, 62, 63)
-
-
54. A control system comprising:
-
a receiver adapted to receive detection data transmitted from a plurality of motion detectors provided for movement with a performer, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in a corresponding one of said motion detectors with the performer; a performance apparatus adapted to carry out a performance of a tone on the basis of performance data; and a controller coupled with said receiver and said performance apparatus and adapted to control said performance of a tone by said performance apparatus in accordance with each of the detection data received from said motion detectors, wherein the performance data is automatic performance data, and said performance apparatus performs a tone on the basis of the automatic performance data, wherein the automatic performance data comprises data of a plurality of parts, and wherein said controller controls a performance of tones of at least two of the parts in accordance with the detection data received from different ones of said motion detectors, wherein said controller performs separate control of respective performance tempos of the tones of the at least two parts in accordance with the detection data received from the different motion detectors, wherein said control system further comprises a storage device adapted to store therein display data separately for individual ones of the parts, and wherein said controller reads out the display data from said storage device in accordance with separate performance tempo control for the at least two parts and causes a display device to display visual images based on the read-out display data.
-
-
56. A control system comprising:
-
a receiver adapted to receive detection data transmitted from a plurality of motion detectors provided for movement with a performer, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in a corresponding one of said motion detectors moving with the performer; a performance apparatus adapted to carry out a performance of a tone on the basis of performance data; and a controller coupled with said receiver and said performance apparatus and adapted to control said performance of a tone by said performance apparatus in accordance with each of the detection data received from said motion detectors, wherein the performance data is automatic performance data, and said performance apparatus performs a tone on the basis of the automatic performance data, wherein the automatic performance data comprises data of a plurality of parts, and wherein said controller controls a performance of tones of at least two of the parts in accordance with the detection data received from different ones of said motion detectors, wherein said control system further comprises a storage device adapted to store therein, separately for individual ones of the parts, tempo control data for controlling a performance tempo, wherein said controller controls a performance tempo of one or some of the plurality of parts in accordance with the detection data received via said motion detector and controls a performance tempo of other one or some of the plurality of parts in accordance with the tempo control data stored in said storage device, wherein said storage device is further adapted to store therein display data separately for the individual parts, and wherein said controller reads out the display data from said storage device in accordance with separate performance tempo control for the at least two parts and causes a display device to display visual images based on the read-out display data.
-
-
64. A method for controlling a performance of a tone on the basis of detection data transmitted from a motion detector, said method comprising the steps of:
-
receiving detection data transmitted from said motion detector provided for movement with a performer, the detection data being time-serial detection data time-serially representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer; carrying out a performance of a tone on the basis of performance data; analyzing the motion of the performer on the basis of the detection data received via said step of receiving and thereby generating a plurality of analyzed data, wherein said step of analyzing comprises analyzing a time-varying waveform corresponding to the time-serial detection data and generating a plurality of kinds of characteristic parameters pertaining to a shape of the time-varying waveform; and controlling said performance of a tone carried out via said step of carrying out, in accordance with said plurality of kinds of characteristic parameters.
-
-
65. A method for controlling a performance of a tone on the basis of detection data transmitted from a motion detector, said method comprising the steps of:
-
receiving a plurality of detection data transmitted from a single motion detector provided for movement with a performer, said plurality of detection data being detection data of a plurality of axial components, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer; carrying out a performance of a tone on the basis of performance data; and controlling said performance of a tone by said step of carrying out, in accordance with each of the detection data received via said receiving, wherein said step of controlling comprises identifying a type of operation of said motion detector by comparing the detection data of the plurality of axial components and controlling the performance on the basis of the identified type of operation.
-
-
66. A method for controlling a performance of a tone on the basis of detection data transmitted from a plurality of motion detectors provided for movement with a performer, said method comprising the steps of:
-
receiving detection data transmitted from the plurality of the motion detectors, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in a corresponding one of said motion detectors moving with the performer, said plurality of motion detectors comprising master and subordinate detectors; carrying out a performance of a tone on the basis of performance data; and controlling said performance of a tone by said step of carrying out, in accordance with each of the detection data received from said motion detectors, wherein the form of control is determined in accordance with an operation mode that is designated on the basis of operation-type identifying data included in the detection data transmitted by the master detector.
-
-
67. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for controlling a performance of a tone on the basis of detection data transmitted from a motion detector, said method comprising the steps of:
-
receiving detection data transmitted from said motion detector provided for movement with a performer, the detection data being time-serial detection data serially representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer; carrying out a performance of a tone on the basis of performance data; analyzing the motion of the performer on the basis of the detection data received via said step of receiving and thereby generating a plurality of analyzed data, wherein said step of analyzing comprises analyzing a time-varying waveform corresponding to the time-serial detection data and generating a plurality of kinds of characteristic parameters pertaining to a shape of the time-varying waveform; and controlling said performance of a tone carried out via said step of carrying out, in accordance with said plurality of kinds of characteristic parameters.
-
-
68. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for controlling a performance of a tone on the basis of detection data transmitted from a motion detector, said method comprising the steps of:
-
receiving a plurality of detection data transmitted from a single motion detector provided for movement with a performer, said plurality of detection data being detection data of a plurality of axial components, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in said motion detector moving with the performer; carrying out a performance of a tone on the basis of performance data; and controlling said performance of a tone by said step of carrying out, in accordance with each of the detection data received via said receiving, wherein said step of controlling comprises identifying a type of operation of said motion detector by comparing the detection data of the plurality of axial components and controlling the performance on the basis of the identified type of operation.
-
-
69. A machine-readable storage medium containing a group of instructions to cause said machine to implement a method for controlling a performance of a tone on the basis of detection data transmitted from a plurality of motion detectors provided for movement with a performer, said method comprising the steps of:
-
receiving detection data transmitted from the plurality of the motion detectors, each of the detection data representing a state of a motion of the performer detected via a sensor that is included in a corresponding one of said motion detectors moving with the performer, said plurality of motions detectors comprising of master and subordinate detectors; carrying out a performance of a tone on the basis of performance data; and controlling said performance of a tone by said step of carrying out, in accordance with each of the detection data received from said motion detectors, wherein the form of control is determined in accordance with an operation mode that is designated on the basis of operation-type identifying data included in the detection data transmitted by the master detector.
-
Specification