Automatic page sequencing and other feedback action based on analysis of audio performance data

• US 7,579,541 B2
• Filed: 12/28/2006
• Issued: 08/25/2009
• Est. Priority Date: 12/28/2006
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Guldi, Richard
• Primary Examiner(s): Donels; Jeffrey
• Assistant Examiner(s): HORN, ROBERT WAYNE
• Application Number:
  US11/617,444
• Publication Number:
  US 20080156171A1
• Time in Patent Office: 971 Days
• Field of Search: 844/70.R
• US Class Current: 84/470.00R
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G09B 15/002 Electrically operated systems

Abstract

Speech or musical performance is electronically analyzed using DSP techniques and is compared to a stored text script or musical score, to enable display of and automated sequencing through multiple pages of the stored script or score. The performer can modify timing of sequencing if desired, for example dependent on performance speed or musical complexity. Automated highlighting or marking of measures or text assists the performer in keeping track of progress through the performance. During or after the performance, electronic comparison of the performance to the score or script provides feedback to the performer, highlighting differences between the actual performance and the desired performance as described by the score or script. Additional capabilities enhancing the learning process include digital recording and playback of the actual performance, and/or accompaniment by synthesis or playback of digital recording of other performance parts (for example, other instruments in an ensemble or other actors in a play).

Claims

1. A method for providing automatic feedback about a vocal, instrumental or similar performance, comprising:

electronically analyzing audio data signals derived from the performance to identify parameters associated with the performance, wherein the identified parameters relate to at least one of the score or the script of the performance;

comparing the identified parameters for providing the feedback, wherein the comparing is associated with the performance to parameters associated with at least one of the performance'"'"'s score or script, wherein the comparison relates to at least one of a score or script timing, score or script differences, or score or script displaying; and

electronically analyzing page turning in a first performance and setting an advance or delay for the timing of a page turn for a second performance based on the page turning history of the first performance.

2. The method of claim 1, wherein the analyzing and comparing steps operate to determine correspondence between time points in the performance and places in the score or script.

3. The method of claim 2, wherein the feedback comprises automatically sequencing pages of the score or script with the performance.

4. The method of claim 3, wherein the feedback comprises displaying a particular page of the score or script on a display at a particular time.

5. The method of claim 4, further comprising setting an advance or delay for the timing of page turns of the score or script;

and displaying the page of the score or script at a time determined by the analysis and comparison and the setting for the advance or delay.

6. The method of claim 5, further comprising marking the page of the score or script to show the current point in the performance.

7. The method of claim 6, further providing an alerting notification when a particular point in the performance is reached.

8. The method of claim 2, wherein the feedback relates to an event scheduled to occur at particular places in the at least one of score or script, wherein the feedback relates to the event'"'"'s timing.

9. The method of claim 8, further comprising providing synthesis of sounds in correspondence with the feedback.

10. The method of claim 9, wherein instrumental sounds of an instrument are provided in tempo correspondence with the event'"'"'s timing in the performance of instrumental sounds of another instrument.

11. Apparatus for providing automatic feedback about a vocal, instrumental or similar performance, comprising:

means for analyzing retrieved audio data signals and identifying parameters associated with the performance, wherein the identified parameters relate to at least one of the score or script of the performance;

means for comparing the identified parameters associated with the performance to parameters associated with at least one of the performance'"'"'s score or script, wherein the comparison relates to at least one of a score or script timing, score or script differences, or score or script displaying;

means for providing feedback about the performance based on the comparison, wherein the feedback relates to at least one of displaying the difference, commonality or relationship between compared parameters; and

means for electronically analyzing page turning in a first performance and setting an advance or delay for the timing of a page turn for a second performance based on the page turning history of the first performance.

12. Apparatus as in claim 11, wherein the means for analyzing and the means for comparing operate to determine correspondence between time points in the performance and places in the score or script.

13. Apparatus as in claim 12, wherein the means for providing feedback includes means for automatically sequencing pages of the score or script with the performance.

14. Apparatus as in claim 13, wherein the means for providing feedback includes a display, and a means for displaying a particular page of the score or script on the display.