Automatic performance control apparatus

• US 5,585,584 A
• Filed: 05/06/1996
• Issued: 12/17/1996
• Est. Priority Date: 05/09/1995
• Status: Expired due to Term

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Usa, Satoshi
• Primary Examiner(s): Shoop, Jr., William M.
• Assistant Examiner(s): FLETCHER, MARLON T
• Application Number:
  US08/643,851
• Time in Patent Office: 225 Days
• Field of Search: 84/609-612, 84/626, 84/634-636, 84/645, 84/649-652, 84/662, 84/666-668, 84/723-725, 84/DIG. 24, 84/600
• US Class Current: 84/600
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2220/206 Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
• CPC Class Codes: G10H 2220/391 Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device angles measured by an accelerometer or gravimeter G10H2220/395; angles calculated from 3D position sensing G10H2220/401; player body joint angle sensing G10H2220/321

Abstract

An automatic performance control apparatus provides a hand controller which contains gyro sensors in X, Y directions. The gyro sensors are employed to accurately detect hand-swing motion applied to the hand controller without being affected by gravity. When the hand controller is swung by a human operator like a conductor'"'"'s baton, angular velocity applied to the hand controller is detected based on detection values of the gyro sensors. The angular velocity becomes bottom at a change point of direction in a locus of the hand-swing motion of the hand controller; and a peak of the angular velocity appears between bottoms. So, peak detection process is performed on the angular velocity to determine a beat timing designated by the human operator. If the peak is detected, beat-timing detection data are automatically created and are transmitted to an electronic musical instrument having an automatic performance function. Based on the beat-timing detection data, the electronic musical instrument performs tempo control during progression of automatic performance in real time. Moreover, beat-number determination process is performed to make a decision as to which of beats in triple time corresponds to a current peak of the angular velocity. The tempo control of the automatic performance responds to a beat number determined, thus avoiding a deviation between beats of the automatic performance and beats designated by he human operator. Incidentally, it is possible to further provide acceleration sensors which cooperate with the gyro sensors to assist the peak detection.

Claims

1. An automatic performance control apparatus comprising:

automatic performance means for sequentially reading out automatic performance data so as to carry out automatic performance;

a hand controller, which is swung and manipulated by a human operator, for designating beat timings;

angular velocity detecting means, which is built in the hand controller, for detecting angular velocity applied to the hand controller;

beat-timing detecting means for detecting the beat timings, designated by the human operator, based on detection values of the angular velocity detecting means; and

tempo control means for controlling a tempo of the automatic performance based on result of detection made by the beat-timing detecting means.

2. An automatic performance control apparatus according to claim 1 further comprising:

swing-state detecting means for detecting an intensity of swinging of the hand controller based on the detection values of the angular velocity detecting means; and

tone-volume control means for controlling tone volume of the automatic performance based on result of detection made by the swing-state detecting means.

3. An automatic performance control apparatus according to claim 1 or 2 wherein the angular velocity detecting means consists of a plurality of gyro sensors each corresponding to a different axis of rotation.

4. An automatic performance control apparatus according to claim 1 wherein the beat-timing detecting means contains

beat-number detecting means for detecting a beat number representing which beat in a measure corresponds to a beat timing currently designated.

5. An automatic performance control apparatus according to claim 1 wherein the automatic performance data contain beat-timing data representing beat timings preset for the automatic performance;

and the tempo control means performs comparison between the beat-timing data, which are read out by the automatic performance means, and the beat timings, which are designated by the beat-timing detecting means, so that the tempo control is performed on the automatic performance based on result of the comparison.

6. An automatic performance control apparatus according to claim 1 wherein the beat-timing detecting means is designed to determine a peak of the angular velocity, detected by the angular velocity detecting means, as a beat timing.

7. An automatic performance control apparatus according to claim 1 wherein the beat-timing detecting means is designed to determine a bottom of the angular velocity, detected by the angular velocity detecting means, as a beat timing.

8. An automatic performance control apparatus according to claim 1 wherein the beat-timing detecting means is designed to determine a discontinuous change point In a swing direction of the hand controller, detected by the angular velocity detecting means as a beat timing.

9. An automatic performance control apparatus according to claim 1 wherein the beat-timing detecting means supplies control data to the automatic performance means in a form of note-on data of a specific MIDI channel.

10. An automatic performance control apparatus according to claim 1 further comprising

acceleration sensor means which is attached to the hand controller, wherein the beat-timing detecting means detects beat timings based on the detection values of the angular velocity detecting means as well as detection values of the acceleration sensor means.

11. An automatic performance control apparatus according to claim 1 further comprising

acceleration sensor means which is attached to the hand controller, wherein the beat-timing detecting means firstly uses the detection values of the angular velocity detecting means for detection of the beat timings, while if the beat-timing detecting means fails to do so, the beat-timing detecting means uses detection values of the acceleration sensor means for detection of the beat timings.

12. An automatic performance control apparatus according to claim 4 wherein the hand controller is swung in a different direction by each beat number;

and the beat-timing detecting means is designed to make a decision for a beat number, currently designated, by using an angular range to which a swing direction of the hand controller belongs.

13. An automatic performance control apparatus according to claim 4 wherein the hand controller is swung in a different direction by each beat number;

and the beat-number detecting means is designed to make a decision for a beat number, currently designated, by using an angle difference between a previous swing direction, which is applied to the hand controller for previous designation of beat, and a current swing direction which is applied to the hand controller for current designation of beat.

14. An automatic performance control apparatus according to one of claims 4, 12 and 13 wherein the beat-timing detecting means is designed to detect a beat number, currently designated, under consideration of a previous beat number corresponding to previous designation of beat.

15. An automatic performance control apparatus according to claim 5 wherein the beat-timing data of the automatic performance data contain beat-number data representing a beat number which corresponds to one of beats in a measure;

and the tempo control means performs comparison between the beat-number data, which are read out by the automatic performance means, and beat numbers, which are detected by the beat-timing detecting means, so that the tempo control is performed on the automatic performance based on result of the comparison.

16. An automatic performance control apparatus comprising:

automatic performance means for sequentially reading out automatic performance data so as to carry out automatic performance;

a hand controller, in which a plurality of swing detection means are built, for designating beat timings by being swung and manipulated by a human operator;

beat detection means for detecting a beat number based on output of the plurality of swing detection means, wherein the beat number represents which beat corresponds to a beat timing designated by the human operator; and

tempo control means for controlling a tempo of the automatic performance based on result of detection made by the beat detection means.

17. An automatic performance control apparatus according to claim 16 wherein the beat detection means, containing determination means, is designed to determine a peak timing, corresponding to a peak in output of the plurality of swing detection means, as a beat timing;

and the determination means determines a current peak timing, which occurs under a condition where a certain time or more is passed after a previous beat timing, as a current beat timing.

18. An automatic performance control apparatus according to claim 16 wherein the beat detection means, containing determination means, is designed to determine a peak timing, corresponding to a peak in output of the plurality of swing detection means, as a beat timing;

and the determination means determines a current peak timing, whose peak value is a certain number of times larger than a peak value of a previous beat timing, as a current beat timing.

19. An automatic performance control apparatus according to claim 16 wherein the beat detection means, containing determination means, determines a peak timing, corresponding to a peak in output of the plurality of swing detection means, as a beat timing;

and the determination means determines a current peak timing, which occurs under a condition where the output becomes lower than a threshold value after occurrence of a previous peak timing, as a current beat timing.

20. An automatic performance control apparatus according to claim 16 wherein the beat detection means contains direction detecting means which detects a swing direction of the hand controller based on output of the plurality of swing detection means, so that a beat number is detected responsive to an angle in the swing direction detected by the direction detecting means.

21. An automatic performance control apparatus according to claim 16 wherein the beat detection means contains direction detecting means which detects a swing direction of the hand controller based on output of the plurality of swing detection means, so that a current beat number is detected in response to difference between a previous angle in a previous swing direction and a current angle in a current swing direction.

22. An automatic performance control apparatus according to claim 16 wherein the beat detection means contains direction detecting means which detects a swing direction of the hand controller based on output of the plurality of swing detection means so that a beat number is detected responsive to an angle in a swing direction detected by the direction detection means, whereby a current beat number is determined responsive to a previous beat number.

23. An automatic performance control apparatus according to claim 16 wherein the hand controller uses an angular velocity sensor to detect a swing motion thereof.

24. An automatic performance control apparatus according to claim 16 wherein the hand controller uses an acceleration sensor to detect a swing motion thereof.

25. An automatic performance control apparatus according to claim 16 wherein the hand controller uses an angular velocity sensor and an acceleration sensor to detect a swing motion thereof.

26. An automatic performance control apparatus which is connected to an electronic musical instrument having an automatic performance function through data communication based on MIDI standard, the automatic performance control apparatus comprising:

a hand controller, containing two gyro sensors, which is swung and manipulated by a hand of a human operator, wherein the two gyro sensors are arranged to detect angular velocity in X and Y directions in a locus of hand-swing motion of the hand controller, so that the hand controller outputs angular velocity data;

beat detection means for detecting a beat timing based on a peak of angular velocity and/or a bottom of angular velocity on the basis of the angular velocity data;

beat-number determination means for determining a beat number, representing which of beats in a measure corresponds to a beat timing currently designated, on the basis of a beat number of a previous beat timing; and

means for creating beat-timing detection data based on the beat timing and the beat number, the beat-timing detection data being transmitted to the electronic musical instrument in a data form of MIDI standard,

whereby tempo control based on the beat-timing detection data is performed on automatic performance played by the electronic musical instrument.

27. An automatic performance control apparatus according to claim 26 further comprising

two acceleration sensors which are attached to the hand controller and which are arranged in the X and Y directions in the locus of hand-swing motion of the hand controller so as to assist detection of the beat timing.

28. An electronic musical instrument comprising:

automatic performance means for playing automatic performance based on automatic performance data;

a hand controller, containing two gyro sensors, which is swung and manipulated by a hand of a human operator, wherein the two gyro sensors are arranged to detect angular velocity in X and Y directions in a locus of hand-swing motion of the hand controller, so that the hand controller outputs angular velocity data;

beat detection means for detecting a beat timing based on a peak of angular velocity and/or a bottom of angular velocity on the basis of the angular velocity data;

beat-number determination means for determining a beat number, representing which of beats in a measure corresponds to a beat timing currently designated, on the basis of a beat number of a previous beat timing;

means for creating beat-timing detection data based on the beat timing and the beat number; and

tempo control means for controlling a tempo of the automatic performance in response to the beat-timing detection data in real time.

29. An electronic musical instrument according to claim 28 further comprising

two acceleration sensors which are attached to the hand controller and which are arranged in the X and Y directions in the locus of hand-swing motion of the hand controller so as to assist detection of the beat timing.

30. A method of controlling automatic performance, comprising the steps of:

detecting angular velocity applied to an object which is swung by a human operator like a conductor'"'"'s baton;

detecting a beat timing, which is designated by swing motion of the object swung by the human operator, based on a manner of variation of the angular velocity; and

controlling a tempo of the automatic performance in response to the beat timing.

31. A method of controlling automatic performance according to claim 30, wherein the beat timing is detected based on at least a peak of the angular velocity.

32. A method of controlling automatic performance according to claim 30, wherein the beat timing is detected based on a peak of the angular velocity in connection with a bottom of the angular velocity.

33. A method of controlling automatic performance, comprising the steps of:

detecting angular velocity applied to an object which is swung by a human operator like a conductor'"'"'s baton;

detecting a peak of the angular velocity;

determining a beat timing based on the peak of the angular velocity;

detecting an angle of a swing direction of the object;

determining a beat number, representing which of beats in a measure corresponds to a beat timing currently detected, on the basis of the angle of the swing direction of the object, wherein a current beat number is determined responsive to a previous beat number; and

controlling a tempo of the automatic performance in response to the beat timing and the beat number.

34. A method of controlling a tempo of automatic performance in response to a swing motion of an object which is swung by a human operator like a conductor'"'"'s baton, comprising the steps of:

setting time of a tune which is subjected to automatic performance;

detecting angular velocity of the object which varies responsive to the swing motion of the object;

performing analysis on a locus of the swing motion of the object on the basis of a manner of variation of the angular velocity;

determining a peak timing, corresponding to a peak of the angular velocity, as a beat timing, which is designated by the human operator who swings the object, on the basis of result of the analysis; and

controlling the tempo of the automatic performance in response to the beat timing.

35. A method according to claim 34, wherein if the tune has triple time, the locus of the swing motion of the object corresponds to an equilateral triangle, so that the peak appears three times in one measure.