Apparatus and method for analyzing vocal audio data to provide accompaniment to a vocalist

• US 5,693,903 A
• Filed: 04/04/1996
• Issued: 12/02/1997
• Est. Priority Date: 04/04/1996
• Status: Expired due to Term

• Current Assignee: MakeMusic Incorporated (LaunchEquity Acquisition Partners LLC)
• Original Assignee: Coda Music Technology, Inc. (LaunchEquity Acquisition Partners LLC)
• Inventors: Dunn, Mark E., Heidorn, Allen J., Paulson, John W.
• Primary Examiner(s): Shoop, Jr., William M.
• Assistant Examiner(s): DONELS, JEFFREY
• Application Number:
  US08/628,126
• Time in Patent Office: 607 Days
• Field of Search: 84/612, 84/636, 84/652, 84/668, 84/609, 84/610, 84/634, 84/635, 84/650, 84/651, 84/666, 84/663
• US Class Current: 84/668
• CPC Class Codes: G10H 1/361 Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/311 MIDI transmission G10H2240/056 takes precedence

Abstract

A system for interpreting the requests and performance of a vocal soloist, stated in the parlance of the musician and within the context of a specific published edition of music the soloist is using, to control the performance of a digitized musical accompaniment. Sound events and their associated attributes are extracted from the soloist vocal performance and are numerically encoded. The pitch, duration and event type of the encoded sound events are then compared to a desired sequence of the performance score to determine if a match exists between the soloist performance and the performance score. Variations in pitch due to vibrato are distinguished from changes in pitch due to the soloist moving from one note to another in the performance score. If a match exists between the soloist vocal performance and the performance score, the system instructs a music synthesizer module to provide an audible accompaniment for the vocal soloist.

Claims

1. A computerized method for interpreting soloist requests and soloist performance in order to control a digitized musical accompaniment performance of a performance score, the soloist performance including sound events having a pitch, time duration, and event time and type, the method comprising the steps of:

(a) converting at least a portion of the soloist performance into a sequence of sound related signals;

(b) determining a calculated pitch for a sound event by averaging together pitch variations contained in a sound event sample period of the sequence of sound related signals;

(c) comparing the calculated pitch, duration and event type of individual events of the soloist performance sound related signals to a desired sequence of the performance score to determine if a match exists between the soloist performance and the performance score; and

(d) providing accompaniment for the soloist performance if a match exists between the soloist performance sound related signals and the performance score.

2. The method of claim 1 further comprising the step of effecting a match between the soloist performance and the performance score if there is a departure from the performance score by the soloist performance.

3. The method of claim 1 further comprising the step of altering the accompaniment for the soloist performance in real-time based upon post-processing of past individual events of the soloist performance sound related signals.

4. The method of claim 1 wherein the step of determining a calculated pitch for a sound event comprises using musical instrument digital interface (MIDI) NoteOn and PitchBend information.

5. The method of claim 1 further comprising the step of selecting a percentage following of the accompaniment for the soloist performance by a value, the value of the percentage having a range between 0 and 100 percent.

6. The method of claim 1 further comprising the step of filtering individual events of the soloist performance by a percentage change value, the percentage change value having a range between 0 and 100 percent, such that the individual events of the soloist performance which are inconsistent with the performance score are removed.

7. A computerized method for interpreting soloist requests and soloist performance in order to control a digitized musical accompaniment performance of a performance score, the soloist performance including sound events having a pitch, time duration, and event time and type, the method comprising the steps of:

(a) editing a breath mark associated with the performance score to indicate a change in tempo of the accompaniment at a location within the performance score;

(b) converting at least a portion of the soloist performance into a sequence of sound related signals;

(c) comparing the pitch, duration and event type of individual events of the soloist performance sound related signals to a desired sequence of the performance score to determine if a match exists between the soloist performance and the performance score; and

(d) providing accompaniment for the soloist performance if a match exists between the soloist performance sound related signals and the performance score, increasing and decreasing the accompaniment tempo according to the breath mark.

8. The method of claim 7 wherein the breath mark comprises a large breath mark which reduces the tempo at the location within the performance score by 20 percent.

9. The method of claim 7 wherein the breath mark comprises a small breath mark which reduces the tempo at the location within the performance score by 10 percent.

10. The method of claim 7 further comprising the step of effecting a match between the soloist performance and the performance score if there is a departure from the performance score by the soloist performance.

11. The method of claim 7 further comprising the step of altering the accompaniment for the soloist performance in real-time based upon the post-processing of past individual events of the soloist performance sound related signals.

12. The method of claim 7 further comprising the step of selecting a percentage following of the accompaniment for the soloist performance by a value, the value of the percentage having a range between 0 and 100 percent.

13. The method of claim 7 further comprising the step of filtering individual events of the soloist performance by a percentage change value, the percentage change value having a range between 0 and 100 percent, such that individual events of the soloist performance which are inconsistent with the performance score are removed.

14. A computerized method for interpreting soloist requests and soloist performance in order to control a digitized musical accompaniment performance of a performance score, the soloist performance including sound events having a pitch, time duration, and event time and type, the method comprising the steps of:

(a) editing a tempo map associated with the performance score to indicate the tempo of the accompaniment at a location within the performance score;

(b) interpolating steps between changes of tempo of the accompaniment at the location within the performance score;

(c) converting at least a portion of the soloist performance into a sequence of sound related signals;

(d) comparing the pitch, duration and event type of individual events of the soloist performance sound related signals to a desired sequence of the performance score to determine if a match exists between the soloist performance and the performance score; and

(e) providing accompaniment for the soloist performance if a match exists between the soloist performance sound related signals and the performance score, increasing and decreasing the accompaniment tempo as indicated by the soloist performance and relative to the edited tempo map.

15. The method of claim 14 further comprising the step of effecting a match between the soloist performance and the performance score if there is a departure from the performance score by the soloist performance.

16. The method of claim 14 wherein the step of editing a tempo map associated with the performance score comprises the steps of:

(a) tapping a tempo with a data input device; and

(b) recording the tapped tempo as the tempo at the location within the performance score.

17. The method of claim 16 wherein the data input device comprises a foot pedal.

18. The method of claim 16 wherein the data input device comprises a keyboard.

19. The method of claim 14 wherein the step of editing a tempo map associated with the performance score comprises the steps of:

(a) the soloist playing a tempo performance;

(b) converting at least a portion of the tempo performance into a sequence of tempo related signals;

(c) analyzing the tempo related signals to derive a tempo for the tempo performance; and

(d) recording the tempo for the tempo performance as the tempo at the location within the performance score.

20. The method of claim 16 wherein the step of interpolating steps between changes of tempo of the accompaniment comprises applying a curve-fitting function to smooth the tempo changes over the location within the performance score.